Aug 04 15:59:48.546803 ip-10-0-141-219 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 04 15:59:48.546816 ip-10-0-141-219 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 04 15:59:48.546825 ip-10-0-141-219 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 04 15:59:48.547127 ip-10-0-141-219 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 04 15:59:58.795880 ip-10-0-141-219 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 04 15:59:58.795897 ip-10-0-141-219 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot aa64dbfc180c4f4b83dc81ba256cebd8 --
Aug 04 16:01:54.028071 ip-10-0-141-219 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 16:01:54.427232 ip-10-0-141-219 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 16:01:54.427232 ip-10-0-141-219 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 16:01:54.427232 ip-10-0-141-219 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 16:01:54.427232 ip-10-0-141-219 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 16:01:54.427232 ip-10-0-141-219 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 16:01:54.429586 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.429476    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 16:01:54.435551 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435535    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:54.435551 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435551    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435555    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435558    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435562    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435565    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435568    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435571    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435574    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435577    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435580    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435582    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435585    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435588    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435596    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435599    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435602    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435605    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435607    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435610    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:54.435614 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435612    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435615    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435618    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435620    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435623    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435626    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435630    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435634    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435638    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435641    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435644    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435647    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435649    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435652    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435655    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435658    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435661    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435666    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435668    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:54.436101 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435671    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435673    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435676    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435679    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435681    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435684    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435686    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435689    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435691    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435694    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435696    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435699    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435702    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435704    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435706    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435710    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435713    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435717    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435720    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435722    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:54.436552 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435725    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435727    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435729    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435732    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435734    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435737    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435739    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435742    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435758    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435762    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435767    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435771    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435775    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435778    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435781    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435783    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435786    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435788    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435792    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:54.437078 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435794    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435796    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435799    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435803    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435806    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435809    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435812    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435815    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435818    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435821    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435824    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435826    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435829    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435832    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435835    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435837    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435840    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435842    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435845    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435848    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:54.437535 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.435850    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436576    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436583    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436586    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436589    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436592    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436601    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436604    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436606    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436609    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436612    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436615    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436617    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436620    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436623    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436625    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436628    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436631    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436634    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436636    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:54.438068 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436639    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436642    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436645    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436647    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436650    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436652    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436655    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436657    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436660    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436663    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436667    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436671    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436673    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436676    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436678    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436681    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436684    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436686    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436689    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:54.438554 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436697    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436700    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436703    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436705    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436711    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436714    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436717    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436720    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436722    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436725    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436727    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436730    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436732    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436735    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436738    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436740    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436759    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436761    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436764    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436767    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:54.439065 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436769    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436772    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436775    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436778    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436780    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436783    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436785    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436788    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436790    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436793    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436795    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436798    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436800    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436809    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436812    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436815    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436818    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436822    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436824    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436827    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:54.439562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436829    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436832    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436834    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436837    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436839    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436841    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436846    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436849    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436852    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436855    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436858    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436860    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436863    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436865    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436868    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436872    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436875    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436878    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436881    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:54.440093 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436883    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.436886    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437321    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437327    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437331    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437334    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437344    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437347    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437350    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437352    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437355    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437358    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437360    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437363    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437365    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437368    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437370    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437373    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437375    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437378    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:54.440543 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437381    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437384    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437386    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437389    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437391    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437394    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437396    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437399    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437401    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437404    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437406    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437409    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437411    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437414    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437416    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437419    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437421    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437424    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437426    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:54.441039 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437435    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437438    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437441    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437443    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437446    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437448    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437451    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437453    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437456    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437458    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437461    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437465    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437468    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437470    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437473    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437475    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437478    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437480    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437483    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437486    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:54.441505 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437489    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437491    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437494    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437496    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437499    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437501    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437504    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437506    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437509    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437511    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437514    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437516    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437521    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437530    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437533    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437535    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437537    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437540    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437544    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437548    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:54.442010 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437550    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437553    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437555    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437559    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437562    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437564    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437567    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437569    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437572    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437574    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437577    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437579    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437581    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437584    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437587    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437589    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437591    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437594    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437597    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437599    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:54.442512 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437602    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.437606    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437692    2558 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437705    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437718    2558 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437722    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437731    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437735    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437739    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437757    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437760    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437763    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437767    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437770    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437773    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437778    2558 flags.go:64] FLAG: --cgroup-root=""
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437781    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437783    2558 flags.go:64] FLAG: --client-ca-file=""
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437786    2558 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437789    2558 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437796    2558 flags.go:64] FLAG: --cluster-domain=""
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437799    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437802    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 16:01:54.443055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437805    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437808    2558 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437812    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437815    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437818    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437821    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437824    2558 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437827    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437830    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437833    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437836    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437840    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437843    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437847    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437850    2558 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437853    2558 flags.go:64] FLAG: --enable-server="true"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437863    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437870    2558 flags.go:64] FLAG: --event-burst="100"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437873    2558 flags.go:64] FLAG: --event-qps="50"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437876    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437879    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437882    2558 flags.go:64] FLAG: --eviction-hard=""
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437886    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437889    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437893    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 16:01:54.443611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437896    2558 flags.go:64] FLAG: --eviction-soft=""
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437899    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437901    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437904    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437907    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437910    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437913    2558 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437915    2558 flags.go:64] FLAG: --feature-gates=""
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437919    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437922    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437938    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437949    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437953    2558 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437956    2558 flags.go:64] FLAG: --help="false"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437959    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437962    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437965    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437968    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437971    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437975    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437980    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437983    2558 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437985    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 16:01:54.444269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437988    2558 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.437997    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438001    2558 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438003    2558 flags.go:64] FLAG: --kube-reserved=""
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438006    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438009    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438012    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438015    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438019    2558 flags.go:64] FLAG: --lock-file=""
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438021    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438024    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438027    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438033    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438036    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438039    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438042    2558 flags.go:64] FLAG: --logging-format="text"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438045    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438048    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438051    2558 flags.go:64] FLAG: --manifest-url=""
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438053    2558 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438060    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438063    2558 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438067    2558 flags.go:64] FLAG: --max-pods="110"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438069    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438072    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 16:01:54.444898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438076    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438078    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438081    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438084    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438088    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438095    2558 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438098    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438101    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438104    2558 flags.go:64] FLAG: --pod-cidr=""
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438108    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438113    2558 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438116    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438119    2558 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438122    2558 flags.go:64] FLAG: --port="10250"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438125    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438135    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d629f4a88fd33619"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438140    2558 flags.go:64] FLAG: --qos-reserved=""
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438143    2558 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438146    2558 flags.go:64] FLAG: --register-node="true"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438149    2558 flags.go:64] FLAG: --register-with-taints=""
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438153    2558 flags.go:64] FLAG: --registry-burst="10"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438156    2558 flags.go:64] FLAG: --registry-qps="5"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438158    2558 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438161    2558 flags.go:64] FLAG: --reserved-memory=""
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438165    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 16:01:54.445520 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438168    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438171    2558 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438174    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438176    2558 flags.go:64] FLAG: --runonce="false"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438179    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438182    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438185    2558 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438187    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438190    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438193    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438196    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438199    2558 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438203    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438205    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438208    2558 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438211    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438214    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438218    2558 flags.go:64] FLAG: --system-cgroups=""
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438221    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438226    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438229    2558 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438232    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438239    2558 flags.go:64] FLAG: --tls-min-version=""
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438241    2558 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438244    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 16:01:54.446149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438247    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438250    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438253    2558 flags.go:64] FLAG: --v="2"
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438257    2558 flags.go:64] FLAG: --version="false"
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438260    2558 flags.go:64] FLAG: --vmodule=""
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438264    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.438267    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438398    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438403    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438406    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438409    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438412    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438416    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438419    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438422    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438425    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438427    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438430    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438433    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438438    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438441    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:54.446763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438443    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438446    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438448    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438451    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438454    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438456    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438459    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438462    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438465    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438467    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438470    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438474    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438477    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438479    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438482    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438485    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438489    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438493    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438496    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:54.447284 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438499    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438502    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438505    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438507    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438510    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438512    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438515    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438518    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438520    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438523    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438525    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438529    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438532    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438535    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438537    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438540    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438542    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438545    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438548    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438550    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:54.447758 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438553    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438556    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438559    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438561    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438564    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438566    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438569    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438571    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438574    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438577    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438579    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438582    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438584    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438587    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438589    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438592    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438594    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438597    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438601    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438604    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:54.448271 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438606    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438609    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438612    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438616    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438618    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438621    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438623    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438626    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438629    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438633    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438636    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438639    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438642    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438645    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438648    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438650    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438653    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438655    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438658    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438661    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:54.448771 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438664    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438667    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438670    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438673    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438676    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.438678    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.439247    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.446732    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.446764    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.447391    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.447398    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447473    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447479    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447482    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:54.449265 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447486    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447489    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447492    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447495    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447498    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447501    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447503    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447506    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447509    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447512    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447514    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447517    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447519    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447522    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447524    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447527    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447529    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447532    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447536    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:54.449613 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447540    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447544    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447549    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447552    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447555    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447557    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447560    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447570    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447573    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447575    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447578    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447581    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447583    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447587    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447591    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447595    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447599    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447602    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447605    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447607    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:54.450096 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447610    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447613    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447617    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447621    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447625    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447629    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447633    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447636    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447638    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447641    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447643    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447646    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447648    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447651    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447654    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447656    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447659    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447662    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447664    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:54.450593 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447667    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447677    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447680    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447683    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447685    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447688    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447691    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447693    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447699    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447704    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447709    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447714    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447716    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447719    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447722    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447724    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447727    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447729    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447732    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447734    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:54.451062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447737    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447739    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447741    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447758    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447761    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447764    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447767    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447770    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447772    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447775    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447779    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447783    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447788    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447792    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447809    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447812    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447814    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:54.451647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447817    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.447822    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447990    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.447998    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448001    2558 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448004    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448007    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448010    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448012    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448015    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448018    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448022    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448026    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448031    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448035    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 16:01:54.452062 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448039    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448042    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448045    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448049    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448053    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448056    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448058    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448061    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448063    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448066    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448068    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448070    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448073    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448075    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448078    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448086    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448089    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448092    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448094    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448097    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 16:01:54.452423 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448099    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448102    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448106    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448110    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448114    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448118    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448122    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448125    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448128    2558 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448131    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448133    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448135    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448138    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448140    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448143    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448145    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448147    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448150    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448153    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448155    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 16:01:54.453032 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448158    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448160    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448163    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448165    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448168    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448170    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448173    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448175    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448184    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448189    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448192    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448196    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448200    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448205    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448207    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448210    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448212    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448214    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448217    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448219    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 16:01:54.453491 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448222    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448225    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448227    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448229    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448232    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448234    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448236    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448239    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448241    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448244    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448246    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448249    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448251    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448254    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448256    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448258    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448261    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448265    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448270    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 16:01:54.453988 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448275    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448282    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448298    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448301    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448303    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448306    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:54.448309    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.448314    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.448436    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.451406    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.452793    2558 server.go:1019] "Starting client certificate rotation"
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.452889    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 16:01:54.454450 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.452923    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 16:01:54.455194 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.455181    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 16:01:54.458064 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.458043    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 16:01:54.467731 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.467714    2558 log.go:25] "Validated CRI v1 runtime API"
Aug 04 16:01:54.470027 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.470013    2558 log.go:25] "Validated CRI v1 image API"
Aug 04 16:01:54.470793 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.470777    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 16:01:54.474971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.474951    2558 fs.go:135] Filesystem UUIDs: map[473984cc-0a63-4a95-9c95-18140877db4c:/dev/nvme0n1p4 5cbdaf90-a5ed-4d37-bed0-cd90a084ec82:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Aug 04 16:01:54.475030 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.474971    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 16:01:54.480029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.479906    2558 manager.go:216] Machine: {Timestamp:2026-08-04 16:01:54.478759826 +0000 UTC m=+0.335232660 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093650 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20e9d36fb6e0afe0ea188bf55d10c3 SystemUUID:ec20e9d3-6fb6-e0af-e0ea-188bf55d10c3 BootID:aa64dbfc-180c-4f4b-83dc-81ba256cebd8 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f3:06:77:93:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f3:06:77:93:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:b0:dc:0a:9f:a7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 16:01:54.480029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.480016    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 16:01:54.480167 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.480114    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 16:01:54.481915 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.481900    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 16:01:54.482730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.482707    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 16:01:54.482871 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.482734    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-219.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 16:01:54.483431 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.483421    2558 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 16:01:54.483462 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.483434    2558 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 16:01:54.483462 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.483441    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 16:01:54.484201 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.484190    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 16:01:54.484973 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.484963    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 16:01:54.488369 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.488358    2558 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 16:01:54.488482 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.488472    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 16:01:54.488517 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.488500    2558 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 16:01:54.488517 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.488510    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 16:01:54.488570 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.488525    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 16:01:54.488570 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.488535    2558 kubelet.go:398] "Adding apiserver pod source"
Aug 04 16:01:54.488570 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.488544    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 16:01:54.488923 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.488910    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 16:01:54.488995 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.488930    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 16:01:54.491526 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.491507    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 16:01:54.493330 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.493312    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 16:01:54.493418 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.493351    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 16:01:54.495645 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495620    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 16:01:54.495737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495652    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 16:01:54.495737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495663    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 16:01:54.495737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495674    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 16:01:54.495737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495688    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 16:01:54.495737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495697    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 16:01:54.495737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495709    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 16:01:54.495737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495724    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 16:01:54.495737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495735    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 16:01:54.495737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495760    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 16:01:54.496142 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495774    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 16:01:54.496142 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.495783    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 16:01:54.496700 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.496683    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 16:01:54.496783 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.496773    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 16:01:54.499940 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.499923    2558 server.go:1268] "Started kubelet"
Aug 04 16:01:54.500058 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.499987    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 16:01:54.500324 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.500030    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 16:01:54.500428 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.500344    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 16:01:54.500883 ip-10-0-141-219 systemd[1]: Started Kubernetes Kubelet.
Aug 04 16:01:54.501089 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.500905    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-219.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 16:01:54.501664 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.501449    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 16:01:54.501664 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.501512    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-219.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 16:01:54.501664 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.501523    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 16:01:54.502385 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.502368    2558 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 16:01:54.505495 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.504409    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-219.ec2.internal.18c8a595ab96c657  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-219.ec2.internal,UID:ip-10-0-141-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-219.ec2.internal,},FirstTimestamp:2026-08-04 16:01:54.499896919 +0000 UTC m=+0.356369755,LastTimestamp:2026-08-04 16:01:54.499896919 +0000 UTC m=+0.356369755,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-219.ec2.internal,}"
Aug 04 16:01:54.505893 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.505872    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 16:01:54.506730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.506715    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 16:01:54.506831 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.506717    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 16:01:54.506931 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.506915    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-219.ec2.internal\" not found"
Aug 04 16:01:54.507421 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507403    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 16:01:54.507421 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507407    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 16:01:54.507561 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507446    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 16:01:54.507561 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507548    2558 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 16:01:54.507561 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507557    2558 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 16:01:54.507699 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507686    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 16:01:54.507828 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507699    2558 factory.go:55] Registering systemd factory
Aug 04 16:01:54.507828 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507708    2558 factory.go:223] Registration of the systemd container factory successfully
Aug 04 16:01:54.507912 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507900    2558 factory.go:153] Registering CRI-O factory
Aug 04 16:01:54.507954 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507914    2558 factory.go:223] Registration of the crio container factory successfully
Aug 04 16:01:54.507954 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507936    2558 factory.go:103] Registering Raw factory
Aug 04 16:01:54.507954 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.507948    2558 manager.go:1196] Started watching for new ooms in manager
Aug 04 16:01:54.508272 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.508253    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c625l"
Aug 04 16:01:54.508357 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.508345    2558 manager.go:349] Starting recovery of all containers
Aug 04 16:01:54.512353 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.512326    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 16:01:54.512461 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.512412    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-219.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 16:01:54.515308 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.515289    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c625l"
Aug 04 16:01:54.521517 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.521498    2558 manager.go:354] Recovery completed
Aug 04 16:01:54.526592 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.526578    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:54.528305 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.528289    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:54.528371 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.528316    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:54.528371 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.528326    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:54.528848 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.528833    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 16:01:54.528848 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.528847    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 16:01:54.528965 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.528853    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:54.528965 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.528864    2558 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 16:01:54.529514 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.529499    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:54.529566 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.529532    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:54.529566 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.529544    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:54.530010 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.529998    2558 policy_none.go:49] "None policy: Start"
Aug 04 16:01:54.530053 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.530015    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 16:01:54.530053 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.530026    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 16:01:54.530882 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.530816    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-219.ec2.internal.18c8a595ad483a20  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-219.ec2.internal,UID:ip-10-0-141-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-219.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-219.ec2.internal,},FirstTimestamp:2026-08-04 16:01:54.528303648 +0000 UTC m=+0.384776483,LastTimestamp:2026-08-04 16:01:54.528303648 +0000 UTC m=+0.384776483,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-219.ec2.internal,}"
Aug 04 16:01:54.531014 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.530995    2558 policy_none.go:47] "Start"
Aug 04 16:01:54.570657 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.570473    2558 manager.go:337] "Starting Device Plugin manager"
Aug 04 16:01:54.570776 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.570689    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 16:01:54.570776 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.570703    2558 server.go:87] "Starting device plugin registration server"
Aug 04 16:01:54.571027 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.571013    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 16:01:54.571089 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.571030    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 16:01:54.571157 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.571138    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 16:01:54.571261 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.571236    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 16:01:54.571261 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.571252    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 16:01:54.571823 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.571803    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 16:01:54.571928 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.571855    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-219.ec2.internal\" not found"
Aug 04 16:01:54.671989 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.671953    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:54.673521 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.673500    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:54.673585 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.673543    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:54.673585 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.673560    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:54.673672 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.673599    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.680017 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.679957    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.680017 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.679982    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-219.ec2.internal\": node \"ip-10-0-141-219.ec2.internal\" not found"
Aug 04 16:01:54.685137 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.685116    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 16:01:54.686435 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.686410    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 16:01:54.686508 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.686459    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 16:01:54.686508 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.686486    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 16:01:54.686593 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.686530    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 16:01:54.688267 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.688245    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:01:54.696779 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.696762    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-219.ec2.internal\" not found"
Aug 04 16:01:54.787758 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.787017    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal"]
Aug 04 16:01:54.787886 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.787828    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:54.789087 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.789072    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:54.789198 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.789108    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:54.789198 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.789125    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:54.790460 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.790443    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:54.790595 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.790581    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.790644 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.790612    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:54.791235 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.791220    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:54.791235 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.791226    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:54.791351 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.791247    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:54.791351 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.791252    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:54.791351 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.791259    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:54.791351 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.791275    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:54.792358 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.792342    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.792450 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.792367    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 16:01:54.793031 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.793013    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 16:01:54.793121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.793035    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 16:01:54.793121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.793050    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeHasSufficientPID"
Aug 04 16:01:54.796876 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.796858    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-219.ec2.internal\" not found"
Aug 04 16:01:54.809925 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.809907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ce7e1ec722c560af91b69ec211c1787-config\") pod \"kube-apiserver-proxy-ip-10-0-141-219.ec2.internal\" (UID: \"0ce7e1ec722c560af91b69ec211c1787\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.810007 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.809931    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c50b0697e001946451392e20de4c7632-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal\" (UID: \"c50b0697e001946451392e20de4c7632\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.810007 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.809959    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c50b0697e001946451392e20de4c7632-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal\" (UID: \"c50b0697e001946451392e20de4c7632\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.828460 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.828435    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-219.ec2.internal\" not found" node="ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.832961 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.832945    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-219.ec2.internal\" not found" node="ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.897223 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.897196    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-219.ec2.internal\" not found"
Aug 04 16:01:54.910560 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.910534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ce7e1ec722c560af91b69ec211c1787-config\") pod \"kube-apiserver-proxy-ip-10-0-141-219.ec2.internal\" (UID: \"0ce7e1ec722c560af91b69ec211c1787\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.910628 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.910565    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c50b0697e001946451392e20de4c7632-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal\" (UID: \"c50b0697e001946451392e20de4c7632\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.910628 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.910583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c50b0697e001946451392e20de4c7632-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal\" (UID: \"c50b0697e001946451392e20de4c7632\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.910628 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.910614    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c50b0697e001946451392e20de4c7632-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal\" (UID: \"c50b0697e001946451392e20de4c7632\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.910727 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.910631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0ce7e1ec722c560af91b69ec211c1787-config\") pod \"kube-apiserver-proxy-ip-10-0-141-219.ec2.internal\" (UID: \"0ce7e1ec722c560af91b69ec211c1787\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.910727 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:54.910650    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c50b0697e001946451392e20de4c7632-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal\" (UID: \"c50b0697e001946451392e20de4c7632\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:54.998123 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:54.998055    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-219.ec2.internal\" not found"
Aug 04 16:01:55.105256 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.105212    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-219.ec2.internal\" not found"
Aug 04 16:01:55.131589 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.131563    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:55.136190 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.135895    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:55.206528 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.206483    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-219.ec2.internal\" not found"
Aug 04 16:01:55.307214 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.307163    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-219.ec2.internal\" not found"
Aug 04 16:01:55.309213 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.309195    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:01:55.410679 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.410656    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:55.425060 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.425039    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 16:01:55.427081 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.427068    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal"
Aug 04 16:01:55.436640 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.436622    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 16:01:55.452967 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.452949    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 16:01:55.453084 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.453068    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 16:01:55.453127 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.453088    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 16:01:55.490081 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.490061    2558 apiserver.go:52] "Watching apiserver"
Aug 04 16:01:55.507946 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.507925    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 16:01:55.512703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.512681    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 16:01:55.513092 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.513071    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-btz62","openshift-ovn-kubernetes/ovnkube-node-9fzk5","kube-system/global-pull-secret-syncer-567wr","kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw","openshift-dns/node-resolver-zmjsp","openshift-image-registry/node-ca-5pqks","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal","openshift-multus/multus-65rhv","openshift-multus/network-metrics-daemon-mgh47","kube-system/konnectivity-agent-qt5hg","openshift-cluster-node-tuning-operator/tuned-hppxb","openshift-multus/multus-additional-cni-plugins-hm7nd","openshift-network-diagnostics/network-check-target-xlt82"]
Aug 04 16:01:55.514458 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.514441    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.515604 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.515585    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.517015 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.516999    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:55.517089 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.517059    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:01:55.518119 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.518104    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.518209 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.518192    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 16:01:55.518617 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.518598    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tflwv\""
Aug 04 16:01:55.518708 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.518683    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 16:01:55.518796 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.518720    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 16:01:55.519510 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.519486    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 15:56:54 +0000 UTC" deadline="2028-05-01 05:31:38.460969194 +0000 UTC"
Aug 04 16:01:55.519571 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.519511    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15253h29m42.941462309s"
Aug 04 16:01:55.519617 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.519607    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.519844 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.519821    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 16:01:55.520000 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.519973    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 16:01:55.520094 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.520048    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 16:01:55.520980 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.520966    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.521536 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.521512    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 16:01:55.521536 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.521529    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m9xcv\""
Aug 04 16:01:55.521745 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.521513    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 16:01:55.521745 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.521589    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 16:01:55.521745 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.521522    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 16:01:55.521745 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.521663    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 16:01:55.521992 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.521791    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 16:01:55.521992 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.521970    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zt7ql\""
Aug 04 16:01:55.522493 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.522478    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.522897 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.522880    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 16:01:55.522984 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.522924    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 16:01:55.523979 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.523958    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:55.524073 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.524044    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:01:55.524668 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.524456    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 16:01:55.524668 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.524462    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-422bp\""
Aug 04 16:01:55.524668 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.524502    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sbjbh\""
Aug 04 16:01:55.524668 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.524511    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 16:01:55.525408 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.525389    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:01:55.525489 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.525437    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 16:01:55.525806 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.525786    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 16:01:55.526041 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.526018    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fbpww\""
Aug 04 16:01:55.526162 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.526094    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 16:01:55.526162 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.526102    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 16:01:55.526346 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.526329    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 16:01:55.527791 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.527774    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.528324 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.528306    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 16:01:55.529180 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.528943    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 16:01:55.529504 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.529480    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 16:01:55.530127 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.530108    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.532577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.530876    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6z985\""
Aug 04 16:01:55.532577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.531602    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b58vm\""
Aug 04 16:01:55.532577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.531623    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 16:01:55.532577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.531773    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 16:01:55.532577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.532263    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:01:55.532577 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.532353    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:01:55.535097 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.535079    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-snrc2\""
Aug 04 16:01:55.535212 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.535198    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 16:01:55.535771 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.535755    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 16:01:55.562477 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.562461    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kjgs4"
Aug 04 16:01:55.572247 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.572227    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kjgs4"
Aug 04 16:01:55.591962 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.591946    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:01:55.608771 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.608756    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 16:01:55.612553 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-run-ovn-kubernetes\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.612614 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612560    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-sysctl-d\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.612614 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612580    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-cnibin\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.612614 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612605    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8cr6\" (UniqueName: \"kubernetes.io/projected/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-kube-api-access-r8cr6\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.612731 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612657    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34cb4228-a3d9-4bd8-982b-6a941e97db27-konnectivity-ca\") pod \"konnectivity-agent-qt5hg\" (UID: \"34cb4228-a3d9-4bd8-982b-6a941e97db27\") " pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:01:55.612731 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-cni-bin\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.612731 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-cni-netd\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.612840 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612768    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7kxb\" (UniqueName: \"kubernetes.io/projected/94745705-d59a-4672-b018-7a34bca41ca6-kube-api-access-k7kxb\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:55.612840 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612798    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-sys\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.612840 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612817    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwqn8\" (UniqueName: \"kubernetes.io/projected/260ae6f4-c39b-44c0-8283-f1917eaa49ed-kube-api-access-gwqn8\") pod \"node-ca-5pqks\" (UID: \"260ae6f4-c39b-44c0-8283-f1917eaa49ed\") " pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.612971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612837    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-socket-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.612971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612869    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfjdm\" (UniqueName: \"kubernetes.io/projected/be45fac3-d86d-4369-be0b-665833f105d9-kube-api-access-bfjdm\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.612971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612892    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-var-lib-kubelet\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.612971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612916    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-host\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.612971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.613154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612973    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6rkn\" (UniqueName: \"kubernetes.io/projected/539c6194-4c8c-4a36-aa43-5fb5237a4aa9-kube-api-access-r6rkn\") pod \"node-resolver-zmjsp\" (UID: \"539c6194-4c8c-4a36-aa43-5fb5237a4aa9\") " pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.613154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.612989    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-var-lib-openvswitch\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.613154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613004    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-system-cni-dir\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.613154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613022    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-cnibin\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.613154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70e1a8ed-3f32-4741-88f6-83c335916944-cni-binary-copy\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.613154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613094    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-run-k8s-cni-cncf-io\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.613154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613120    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-var-lib-kubelet\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.613392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613174    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-run-multus-certs\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.613392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.613392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613245    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-node-log\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.613392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63d91ee8-a85a-4c4d-895a-abe24006c931-env-overrides\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.613392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdmnp\" (UniqueName: \"kubernetes.io/projected/63d91ee8-a85a-4c4d-895a-abe24006c931-kube-api-access-fdmnp\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.613392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-etc-kubernetes\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.613392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613335    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-sysconfig\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.613392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613352    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.613392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539c6194-4c8c-4a36-aa43-5fb5237a4aa9-tmp-dir\") pod \"node-resolver-zmjsp\" (UID: \"539c6194-4c8c-4a36-aa43-5fb5237a4aa9\") " pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613444    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e4f2666-ba1d-4da0-9d68-80d60704fbf4-host-slash\") pod \"iptables-alerter-btz62\" (UID: \"3e4f2666-ba1d-4da0-9d68-80d60704fbf4\") " pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613469    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-run-openvswitch\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613492    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-log-socket\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613511    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-device-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613553    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/70e1a8ed-3f32-4741-88f6-83c335916944-multus-daemon-config\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613585    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-systemd\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-tuned\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1970ae52-3a87-4857-86ee-7b8f65d2b970-kubelet-config\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/539c6194-4c8c-4a36-aa43-5fb5237a4aa9-hosts-file\") pod \"node-resolver-zmjsp\" (UID: \"539c6194-4c8c-4a36-aa43-5fb5237a4aa9\") " pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.613703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/260ae6f4-c39b-44c0-8283-f1917eaa49ed-serviceca\") pod \"node-ca-5pqks\" (UID: \"260ae6f4-c39b-44c0-8283-f1917eaa49ed\") " pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613760    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-run-systemd\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613785    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63d91ee8-a85a-4c4d-895a-abe24006c931-ovnkube-config\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613812    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-multus-cni-dir\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613840    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1209e993-fa64-4195-a8f2-d2ccf43f9390-tmp\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613868    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djj89\" (UniqueName: \"kubernetes.io/projected/1209e993-fa64-4195-a8f2-d2ccf43f9390-kube-api-access-djj89\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1970ae52-3a87-4857-86ee-7b8f65d2b970-dbus\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.613990    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-etc-openvswitch\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-var-lib-cni-multus\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614033    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-sysctl-conf\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-lib-modules\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614072    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-699tt\" (UniqueName: \"kubernetes.io/projected/3e4f2666-ba1d-4da0-9d68-80d60704fbf4-kube-api-access-699tt\") pod \"iptables-alerter-btz62\" (UID: \"3e4f2666-ba1d-4da0-9d68-80d60704fbf4\") " pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.614086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-kubelet\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-systemd-units\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-run\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614167    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-os-release\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-run-netns\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-run-ovn\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614266    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614283    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-multus-conf-dir\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614303    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4mv2\" (UniqueName: \"kubernetes.io/projected/70e1a8ed-3f32-4741-88f6-83c335916944-kube-api-access-w4mv2\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614345    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34cb4228-a3d9-4bd8-982b-6a941e97db27-agent-certs\") pod \"konnectivity-agent-qt5hg\" (UID: \"34cb4228-a3d9-4bd8-982b-6a941e97db27\") " pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-sys-fs\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-os-release\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-hostroot\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-system-cni-dir\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.614497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614454    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-multus-socket-dir-parent\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614472    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-modprobe-d\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e4f2666-ba1d-4da0-9d68-80d60704fbf4-iptables-alerter-script\") pod \"iptables-alerter-btz62\" (UID: \"3e4f2666-ba1d-4da0-9d68-80d60704fbf4\") " pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614515    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-registration-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614531    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63d91ee8-a85a-4c4d-895a-abe24006c931-ovn-node-metrics-cert\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614547    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63d91ee8-a85a-4c4d-895a-abe24006c931-ovnkube-script-lib\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614570    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614607    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-run-netns\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614627    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-var-lib-cni-bin\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/260ae6f4-c39b-44c0-8283-f1917eaa49ed-host\") pod \"node-ca-5pqks\" (UID: \"260ae6f4-c39b-44c0-8283-f1917eaa49ed\") " pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-slash\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614724    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:55.615037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.614742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-kubernetes\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.714941 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.714916    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63d91ee8-a85a-4c4d-895a-abe24006c931-ovn-node-metrics-cert\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.715086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.714949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63d91ee8-a85a-4c4d-895a-abe24006c931-ovnkube-script-lib\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.715086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.714974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.715086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.714996    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-run-netns\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.715256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-var-lib-cni-bin\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.715256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/260ae6f4-c39b-44c0-8283-f1917eaa49ed-host\") pod \"node-ca-5pqks\" (UID: \"260ae6f4-c39b-44c0-8283-f1917eaa49ed\") " pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.715256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715166    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-run-netns\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.715256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-slash\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.715256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715201    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-var-lib-cni-bin\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.715256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-slash\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.715256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715222    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/260ae6f4-c39b-44c0-8283-f1917eaa49ed-host\") pod \"node-ca-5pqks\" (UID: \"260ae6f4-c39b-44c0-8283-f1917eaa49ed\") " pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.715256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715169    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.715256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715267    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-kubernetes\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-run-ovn-kubernetes\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.715299    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715310    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-sysctl-d\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-cnibin\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715362    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-run-ovn-kubernetes\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.715371    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs podName:94745705-d59a-4672-b018-7a34bca41ca6 nodeName:}" failed. No retries permitted until 2026-08-04 16:01:56.21534793 +0000 UTC m=+2.071820779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs") pod "network-metrics-daemon-mgh47" (UID: "94745705-d59a-4672-b018-7a34bca41ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715379    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-kubernetes\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715379    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-cnibin\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8cr6\" (UniqueName: \"kubernetes.io/projected/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-kube-api-access-r8cr6\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34cb4228-a3d9-4bd8-982b-6a941e97db27-konnectivity-ca\") pod \"konnectivity-agent-qt5hg\" (UID: \"34cb4228-a3d9-4bd8-982b-6a941e97db27\") " pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715474    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-cni-bin\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715492    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-sysctl-d\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715498    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-cni-netd\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715529    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-cni-netd\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7kxb\" (UniqueName: \"kubernetes.io/projected/94745705-d59a-4672-b018-7a34bca41ca6-kube-api-access-k7kxb\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:55.715714 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-cni-bin\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-sys\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715593    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwqn8\" (UniqueName: \"kubernetes.io/projected/260ae6f4-c39b-44c0-8283-f1917eaa49ed-kube-api-access-gwqn8\") pod \"node-ca-5pqks\" (UID: \"260ae6f4-c39b-44c0-8283-f1917eaa49ed\") " pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-sys\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-socket-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfjdm\" (UniqueName: \"kubernetes.io/projected/be45fac3-d86d-4369-be0b-665833f105d9-kube-api-access-bfjdm\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715765    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-var-lib-kubelet\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715812    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-host\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715840    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-socket-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715852    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-var-lib-kubelet\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6rkn\" (UniqueName: \"kubernetes.io/projected/539c6194-4c8c-4a36-aa43-5fb5237a4aa9-kube-api-access-r6rkn\") pod \"node-resolver-zmjsp\" (UID: \"539c6194-4c8c-4a36-aa43-5fb5237a4aa9\") " pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-var-lib-openvswitch\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715902    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63d91ee8-a85a-4c4d-895a-abe24006c931-ovnkube-script-lib\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-system-cni-dir\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715944    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-var-lib-openvswitch\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715945    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-cnibin\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.716605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715895    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-host\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70e1a8ed-3f32-4741-88f6-83c335916944-cni-binary-copy\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-cnibin\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.715999    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-run-k8s-cni-cncf-io\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-system-cni-dir\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716042    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-var-lib-kubelet\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716055    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-run-k8s-cni-cncf-io\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34cb4228-a3d9-4bd8-982b-6a941e97db27-konnectivity-ca\") pod \"konnectivity-agent-qt5hg\" (UID: \"34cb4228-a3d9-4bd8-982b-6a941e97db27\") " pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716073    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-run-multus-certs\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716110    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-var-lib-kubelet\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716112    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-run-multus-certs\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716125    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-node-log\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63d91ee8-a85a-4c4d-895a-abe24006c931-env-overrides\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716168    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-node-log\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716175    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdmnp\" (UniqueName: \"kubernetes.io/projected/63d91ee8-a85a-4c4d-895a-abe24006c931-kube-api-access-fdmnp\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716220    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-etc-kubernetes\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.717483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-sysconfig\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716316    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-etc-kubernetes\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716396    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-sysconfig\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716322    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539c6194-4c8c-4a36-aa43-5fb5237a4aa9-tmp-dir\") pod \"node-resolver-zmjsp\" (UID: \"539c6194-4c8c-4a36-aa43-5fb5237a4aa9\") " pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.716546    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.716599    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret podName:1970ae52-3a87-4857-86ee-7b8f65d2b970 nodeName:}" failed. No retries permitted until 2026-08-04 16:01:56.216581733 +0000 UTC m=+2.073054576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret") pod "global-pull-secret-syncer-567wr" (UID: "1970ae52-3a87-4857-86ee-7b8f65d2b970") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70e1a8ed-3f32-4741-88f6-83c335916944-cni-binary-copy\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716610    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63d91ee8-a85a-4c4d-895a-abe24006c931-env-overrides\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716641    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716678    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e4f2666-ba1d-4da0-9d68-80d60704fbf4-host-slash\") pod \"iptables-alerter-btz62\" (UID: \"3e4f2666-ba1d-4da0-9d68-80d60704fbf4\") " pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-run-openvswitch\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716734    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-log-socket\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716768    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-device-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716795    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/70e1a8ed-3f32-4741-88f6-83c335916944-multus-daemon-config\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716815    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e4f2666-ba1d-4da0-9d68-80d60704fbf4-host-slash\") pod \"iptables-alerter-btz62\" (UID: \"3e4f2666-ba1d-4da0-9d68-80d60704fbf4\") " pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.718437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716822    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-systemd\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716870    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-systemd\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716881    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716892    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-tuned\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716890    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/539c6194-4c8c-4a36-aa43-5fb5237a4aa9-tmp-dir\") pod \"node-resolver-zmjsp\" (UID: \"539c6194-4c8c-4a36-aa43-5fb5237a4aa9\") " pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716905    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-device-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-log-socket\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1970ae52-3a87-4857-86ee-7b8f65d2b970-kubelet-config\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716990    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-run-openvswitch\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.716994    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1970ae52-3a87-4857-86ee-7b8f65d2b970-kubelet-config\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717033    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/539c6194-4c8c-4a36-aa43-5fb5237a4aa9-hosts-file\") pod \"node-resolver-zmjsp\" (UID: \"539c6194-4c8c-4a36-aa43-5fb5237a4aa9\") " pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717066    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/260ae6f4-c39b-44c0-8283-f1917eaa49ed-serviceca\") pod \"node-ca-5pqks\" (UID: \"260ae6f4-c39b-44c0-8283-f1917eaa49ed\") " pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-run-systemd\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717117    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/539c6194-4c8c-4a36-aa43-5fb5237a4aa9-hosts-file\") pod \"node-resolver-zmjsp\" (UID: \"539c6194-4c8c-4a36-aa43-5fb5237a4aa9\") " pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717127    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63d91ee8-a85a-4c4d-895a-abe24006c931-ovnkube-config\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-multus-cni-dir\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717183    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-run-systemd\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717193    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1209e993-fa64-4195-a8f2-d2ccf43f9390-tmp\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.719296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717262    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djj89\" (UniqueName: \"kubernetes.io/projected/1209e993-fa64-4195-a8f2-d2ccf43f9390-kube-api-access-djj89\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717295    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1970ae52-3a87-4857-86ee-7b8f65d2b970-dbus\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717318    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/70e1a8ed-3f32-4741-88f6-83c335916944-multus-daemon-config\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717326    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717327    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-multus-cni-dir\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717392    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1970ae52-3a87-4857-86ee-7b8f65d2b970-dbus\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717502    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-etc-openvswitch\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-var-lib-cni-multus\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-sysctl-conf\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-lib-modules\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-etc-openvswitch\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717613    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63d91ee8-a85a-4c4d-895a-abe24006c931-ovnkube-config\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717634    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-host-var-lib-cni-multus\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717625    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-699tt\" (UniqueName: \"kubernetes.io/projected/3e4f2666-ba1d-4da0-9d68-80d60704fbf4-kube-api-access-699tt\") pod \"iptables-alerter-btz62\" (UID: \"3e4f2666-ba1d-4da0-9d68-80d60704fbf4\") " pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717770    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/260ae6f4-c39b-44c0-8283-f1917eaa49ed-serviceca\") pod \"node-ca-5pqks\" (UID: \"260ae6f4-c39b-44c0-8283-f1917eaa49ed\") " pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717809    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-sysctl-conf\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-kubelet\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717886    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-systemd-units\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717894    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-kubelet\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717911    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-lib-modules\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-run\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717966    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-os-release\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717992    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-run-netns\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-run-ovn\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718042    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718046    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-etc-selinux\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.717965    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-systemd-units\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-multus-conf-dir\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718099    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4mv2\" (UniqueName: \"kubernetes.io/projected/70e1a8ed-3f32-4741-88f6-83c335916944-kube-api-access-w4mv2\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718113    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-run\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718129    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718157    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718160    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34cb4228-a3d9-4bd8-982b-6a941e97db27-agent-certs\") pod \"konnectivity-agent-qt5hg\" (UID: \"34cb4228-a3d9-4bd8-982b-6a941e97db27\") " pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718162    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-os-release\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.720626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718226    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-host-run-netns\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-multus-conf-dir\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718317    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-sys-fs\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718369    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-sys-fs\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718390    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63d91ee8-a85a-4c4d-895a-abe24006c931-run-ovn\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718403    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-os-release\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718438    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-hostroot\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-system-cni-dir\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-os-release\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-multus-socket-dir-parent\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-modprobe-d\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-hostroot\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718547    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e4f2666-ba1d-4da0-9d68-80d60704fbf4-iptables-alerter-script\") pod \"iptables-alerter-btz62\" (UID: \"3e4f2666-ba1d-4da0-9d68-80d60704fbf4\") " pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-system-cni-dir\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/70e1a8ed-3f32-4741-88f6-83c335916944-multus-socket-dir-parent\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-registration-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718632    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/be45fac3-d86d-4369-be0b-665833f105d9-registration-dir\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.721148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.718837    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-modprobe-d\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.721637 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.719191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e4f2666-ba1d-4da0-9d68-80d60704fbf4-iptables-alerter-script\") pod \"iptables-alerter-btz62\" (UID: \"3e4f2666-ba1d-4da0-9d68-80d60704fbf4\") " pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.721637 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.719281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.721637 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.719643    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1209e993-fa64-4195-a8f2-d2ccf43f9390-etc-tuned\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.721637 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.719793    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1209e993-fa64-4195-a8f2-d2ccf43f9390-tmp\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.721637 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.719880    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63d91ee8-a85a-4c4d-895a-abe24006c931-ovn-node-metrics-cert\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.721637 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.720464    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34cb4228-a3d9-4bd8-982b-6a941e97db27-agent-certs\") pod \"konnectivity-agent-qt5hg\" (UID: \"34cb4228-a3d9-4bd8-982b-6a941e97db27\") " pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:01:55.734292 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.734270    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:01:55.734376 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.734295    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:01:55.734376 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.734310    2558 projected.go:196] Error preparing data for projected volume kube-api-access-czt2p for pod openshift-network-diagnostics/network-check-target-xlt82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:01:55.734376 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:55.734372    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p podName:d206ef89-b02a-450a-8ee6-5e90c4a8f3fb nodeName:}" failed. No retries permitted until 2026-08-04 16:01:56.234357497 +0000 UTC m=+2.090830321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-czt2p" (UniqueName: "kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p") pod "network-check-target-xlt82" (UID: "d206ef89-b02a-450a-8ee6-5e90c4a8f3fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:01:55.736212 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.736181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6rkn\" (UniqueName: \"kubernetes.io/projected/539c6194-4c8c-4a36-aa43-5fb5237a4aa9-kube-api-access-r6rkn\") pod \"node-resolver-zmjsp\" (UID: \"539c6194-4c8c-4a36-aa43-5fb5237a4aa9\") " pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.737497 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.737475    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwqn8\" (UniqueName: \"kubernetes.io/projected/260ae6f4-c39b-44c0-8283-f1917eaa49ed-kube-api-access-gwqn8\") pod \"node-ca-5pqks\" (UID: \"260ae6f4-c39b-44c0-8283-f1917eaa49ed\") " pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.737935 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.737917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdmnp\" (UniqueName: \"kubernetes.io/projected/63d91ee8-a85a-4c4d-895a-abe24006c931-kube-api-access-fdmnp\") pod \"ovnkube-node-9fzk5\" (UID: \"63d91ee8-a85a-4c4d-895a-abe24006c931\") " pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.738013 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.737993    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8cr6\" (UniqueName: \"kubernetes.io/projected/0affb8f6-4aea-42d6-ab48-ffe1fb5b682b-kube-api-access-r8cr6\") pod \"multus-additional-cni-plugins-hm7nd\" (UID: \"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b\") " pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:55.738093 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.738042    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfjdm\" (UniqueName: \"kubernetes.io/projected/be45fac3-d86d-4369-be0b-665833f105d9-kube-api-access-bfjdm\") pod \"aws-ebs-csi-driver-node-g9hzw\" (UID: \"be45fac3-d86d-4369-be0b-665833f105d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.738186 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.738170    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4mv2\" (UniqueName: \"kubernetes.io/projected/70e1a8ed-3f32-4741-88f6-83c335916944-kube-api-access-w4mv2\") pod \"multus-65rhv\" (UID: \"70e1a8ed-3f32-4741-88f6-83c335916944\") " pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.738494 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.738473    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7kxb\" (UniqueName: \"kubernetes.io/projected/94745705-d59a-4672-b018-7a34bca41ca6-kube-api-access-k7kxb\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:55.738661 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.738645    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-699tt\" (UniqueName: \"kubernetes.io/projected/3e4f2666-ba1d-4da0-9d68-80d60704fbf4-kube-api-access-699tt\") pod \"iptables-alerter-btz62\" (UID: \"3e4f2666-ba1d-4da0-9d68-80d60704fbf4\") " pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.743480 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.743459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djj89\" (UniqueName: \"kubernetes.io/projected/1209e993-fa64-4195-a8f2-d2ccf43f9390-kube-api-access-djj89\") pod \"tuned-hppxb\" (UID: \"1209e993-fa64-4195-a8f2-d2ccf43f9390\") " pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.841417 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.841346    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btz62"
Aug 04 16:01:55.861308 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.861285    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:01:55.876856 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.876829    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw"
Aug 04 16:01:55.887005 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.886989    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:01:55.889079 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.889064    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zmjsp"
Aug 04 16:01:55.902700 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.902673    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5pqks"
Aug 04 16:01:55.920556 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.920534    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-65rhv"
Aug 04 16:01:55.930611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.930592    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:01:55.945534 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.945514    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hppxb"
Aug 04 16:01:55.950403 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:55.950388    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hm7nd"
Aug 04 16:01:56.224084 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.224055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:56.224256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.224096    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:56.224256 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:56.224199    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:01:56.224256 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:56.224202    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:01:56.224256 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:56.224250    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret podName:1970ae52-3a87-4857-86ee-7b8f65d2b970 nodeName:}" failed. No retries permitted until 2026-08-04 16:01:57.224236375 +0000 UTC m=+3.080709199 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret") pod "global-pull-secret-syncer-567wr" (UID: "1970ae52-3a87-4857-86ee-7b8f65d2b970") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:01:56.224394 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:56.224263    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs podName:94745705-d59a-4672-b018-7a34bca41ca6 nodeName:}" failed. No retries permitted until 2026-08-04 16:01:57.224256913 +0000 UTC m=+3.080729738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs") pod "network-metrics-daemon-mgh47" (UID: "94745705-d59a-4672-b018-7a34bca41ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:01:56.325140 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.325106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:01:56.325363 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:56.325272    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:01:56.325363 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:56.325291    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:01:56.325363 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:56.325300    2558 projected.go:196] Error preparing data for projected volume kube-api-access-czt2p for pod openshift-network-diagnostics/network-check-target-xlt82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:01:56.325363 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:56.325348    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p podName:d206ef89-b02a-450a-8ee6-5e90c4a8f3fb nodeName:}" failed. No retries permitted until 2026-08-04 16:01:57.325334316 +0000 UTC m=+3.181807140 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-czt2p" (UniqueName: "kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p") pod "network-check-target-xlt82" (UID: "d206ef89-b02a-450a-8ee6-5e90c4a8f3fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:01:56.337296 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.337272    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:01:56.410097 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:56.410043    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe45fac3_d86d_4369_be0b_665833f105d9.slice/crio-8b73c22536ae38736cf0213302c290af6b05f305ff7b44a06de2f637ee58c78d WatchSource:0}: Error finding container 8b73c22536ae38736cf0213302c290af6b05f305ff7b44a06de2f637ee58c78d: Status 404 returned error can't find the container with id 8b73c22536ae38736cf0213302c290af6b05f305ff7b44a06de2f637ee58c78d
Aug 04 16:01:56.410370 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:56.410341    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539c6194_4c8c_4a36_aa43_5fb5237a4aa9.slice/crio-15f2e3dcc41ed22fa3b27da9e4eb799f2b5769702946aab76755d447a9d5df84 WatchSource:0}: Error finding container 15f2e3dcc41ed22fa3b27da9e4eb799f2b5769702946aab76755d447a9d5df84: Status 404 returned error can't find the container with id 15f2e3dcc41ed22fa3b27da9e4eb799f2b5769702946aab76755d447a9d5df84
Aug 04 16:01:56.411248 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:56.411224    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34cb4228_a3d9_4bd8_982b_6a941e97db27.slice/crio-1613755df9cfaa2ea2c9e400da7e8580025890992367c12c4fbeb6bfce87681b WatchSource:0}: Error finding container 1613755df9cfaa2ea2c9e400da7e8580025890992367c12c4fbeb6bfce87681b: Status 404 returned error can't find the container with id 1613755df9cfaa2ea2c9e400da7e8580025890992367c12c4fbeb6bfce87681b
Aug 04 16:01:56.411839 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:56.411815    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0affb8f6_4aea_42d6_ab48_ffe1fb5b682b.slice/crio-c1e0792c127e815c80b2890660228ecc30066f67bfd34544ab06334d5c52289a WatchSource:0}: Error finding container c1e0792c127e815c80b2890660228ecc30066f67bfd34544ab06334d5c52289a: Status 404 returned error can't find the container with id c1e0792c127e815c80b2890660228ecc30066f67bfd34544ab06334d5c52289a
Aug 04 16:01:56.414633 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:56.414604    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63d91ee8_a85a_4c4d_895a_abe24006c931.slice/crio-1270ab7ebb9ece8a24701d06bcb6dc674717fc3bc0557c88db6f938c94aa04d2 WatchSource:0}: Error finding container 1270ab7ebb9ece8a24701d06bcb6dc674717fc3bc0557c88db6f938c94aa04d2: Status 404 returned error can't find the container with id 1270ab7ebb9ece8a24701d06bcb6dc674717fc3bc0557c88db6f938c94aa04d2
Aug 04 16:01:56.415994 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.415972    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:01:56.574081 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.573993    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 15:56:55 +0000 UTC" deadline="2028-02-13 05:57:25.594656589 +0000 UTC"
Aug 04 16:01:56.574081 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.574033    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13381h55m29.020627344s"
Aug 04 16:01:56.689452 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.689416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:01:56.689581 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:56.689543    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:01:56.689647 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.689620    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:56.689825 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:56.689800    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:01:56.692125 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.692084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" event={"ID":"63d91ee8-a85a-4c4d-895a-abe24006c931","Type":"ContainerStarted","Data":"1270ab7ebb9ece8a24701d06bcb6dc674717fc3bc0557c88db6f938c94aa04d2"}
Aug 04 16:01:56.692776 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.692751    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw" event={"ID":"be45fac3-d86d-4369-be0b-665833f105d9","Type":"ContainerStarted","Data":"8b73c22536ae38736cf0213302c290af6b05f305ff7b44a06de2f637ee58c78d"}
Aug 04 16:01:56.693763 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.693736    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zmjsp" event={"ID":"539c6194-4c8c-4a36-aa43-5fb5237a4aa9","Type":"ContainerStarted","Data":"15f2e3dcc41ed22fa3b27da9e4eb799f2b5769702946aab76755d447a9d5df84"}
Aug 04 16:01:56.694847 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.694824    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hm7nd" event={"ID":"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b","Type":"ContainerStarted","Data":"c1e0792c127e815c80b2890660228ecc30066f67bfd34544ab06334d5c52289a"}
Aug 04 16:01:56.695844 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:56.695807    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qt5hg" event={"ID":"34cb4228-a3d9-4bd8-982b-6a941e97db27","Type":"ContainerStarted","Data":"1613755df9cfaa2ea2c9e400da7e8580025890992367c12c4fbeb6bfce87681b"}
Aug 04 16:01:56.799538 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:56.799500    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce7e1ec722c560af91b69ec211c1787.slice/crio-92df9307ed8ef4763776e3ec8610cb30baa8018f68005dd8f4ea1fe89b568a90 WatchSource:0}: Error finding container 92df9307ed8ef4763776e3ec8610cb30baa8018f68005dd8f4ea1fe89b568a90: Status 404 returned error can't find the container with id 92df9307ed8ef4763776e3ec8610cb30baa8018f68005dd8f4ea1fe89b568a90
Aug 04 16:01:56.809600 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:56.809570    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50b0697e001946451392e20de4c7632.slice/crio-40a5888101c4f69de708199ddce1906994697f62ebb4143b1c186e3815ecbff7 WatchSource:0}: Error finding container 40a5888101c4f69de708199ddce1906994697f62ebb4143b1c186e3815ecbff7: Status 404 returned error can't find the container with id 40a5888101c4f69de708199ddce1906994697f62ebb4143b1c186e3815ecbff7
Aug 04 16:01:57.231209 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:57.231170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:57.231372 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:57.231252    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:57.231372 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:57.231345    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:01:57.231474 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:57.231417    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs podName:94745705-d59a-4672-b018-7a34bca41ca6 nodeName:}" failed. No retries permitted until 2026-08-04 16:01:59.231397472 +0000 UTC m=+5.087870300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs") pod "network-metrics-daemon-mgh47" (UID: "94745705-d59a-4672-b018-7a34bca41ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:01:57.231474 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:57.231345    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:01:57.231562 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:57.231474    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret podName:1970ae52-3a87-4857-86ee-7b8f65d2b970 nodeName:}" failed. No retries permitted until 2026-08-04 16:01:59.231460112 +0000 UTC m=+5.087932943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret") pod "global-pull-secret-syncer-567wr" (UID: "1970ae52-3a87-4857-86ee-7b8f65d2b970") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:01:57.332165 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:57.332107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:01:57.332344 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:57.332322    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:01:57.332418 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:57.332348    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:01:57.332418 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:57.332363    2558 projected.go:196] Error preparing data for projected volume kube-api-access-czt2p for pod openshift-network-diagnostics/network-check-target-xlt82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:01:57.332531 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:57.332427    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p podName:d206ef89-b02a-450a-8ee6-5e90c4a8f3fb nodeName:}" failed. No retries permitted until 2026-08-04 16:01:59.33240749 +0000 UTC m=+5.188880337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-czt2p" (UniqueName: "kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p") pod "network-check-target-xlt82" (UID: "d206ef89-b02a-450a-8ee6-5e90c4a8f3fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:01:57.568997 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:57.568913    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 16:01:57.574611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:57.574574    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 15:56:55 +0000 UTC" deadline="2028-04-18 16:28:08.946694794 +0000 UTC"
Aug 04 16:01:57.574611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:57.574608    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14952h26m11.37209099s"
Aug 04 16:01:57.675074 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:01:57.675041    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e1a8ed_3f32_4741_88f6_83c335916944.slice/crio-3169a7d8c7a32eef531b697eb0330e2259195a3c546f9a9422db95d22abe915e WatchSource:0}: Error finding container 3169a7d8c7a32eef531b697eb0330e2259195a3c546f9a9422db95d22abe915e: Status 404 returned error can't find the container with id 3169a7d8c7a32eef531b697eb0330e2259195a3c546f9a9422db95d22abe915e
Aug 04 16:01:57.687326 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:57.686859    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:57.687326 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:57.686995    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:01:57.701725 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:57.701695    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65rhv" event={"ID":"70e1a8ed-3f32-4741-88f6-83c335916944","Type":"ContainerStarted","Data":"3169a7d8c7a32eef531b697eb0330e2259195a3c546f9a9422db95d22abe915e"}
Aug 04 16:01:57.704939 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:57.704906    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal" event={"ID":"c50b0697e001946451392e20de4c7632","Type":"ContainerStarted","Data":"40a5888101c4f69de708199ddce1906994697f62ebb4143b1c186e3815ecbff7"}
Aug 04 16:01:57.708589 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:57.708563    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal" event={"ID":"0ce7e1ec722c560af91b69ec211c1787","Type":"ContainerStarted","Data":"92df9307ed8ef4763776e3ec8610cb30baa8018f68005dd8f4ea1fe89b568a90"}
Aug 04 16:01:58.687246 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:58.687210    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:01:58.687744 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:58.687221    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:58.687744 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:58.687360    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:01:58.687744 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:58.687442    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:01:59.249299 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:59.249259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:59.249504 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:59.249347    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:01:59.249504 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:59.249423    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:01:59.249628 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:59.249517    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret podName:1970ae52-3a87-4857-86ee-7b8f65d2b970 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:03.249493054 +0000 UTC m=+9.105965893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret") pod "global-pull-secret-syncer-567wr" (UID: "1970ae52-3a87-4857-86ee-7b8f65d2b970") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:01:59.249628 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:59.249535    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:01:59.249628 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:59.249592    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs podName:94745705-d59a-4672-b018-7a34bca41ca6 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:03.249575402 +0000 UTC m=+9.106048246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs") pod "network-metrics-daemon-mgh47" (UID: "94745705-d59a-4672-b018-7a34bca41ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:01:59.350486 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:59.350359    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:01:59.350676 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:59.350549    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:01:59.350676 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:59.350573    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:01:59.350676 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:59.350588    2558 projected.go:196] Error preparing data for projected volume kube-api-access-czt2p for pod openshift-network-diagnostics/network-check-target-xlt82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:01:59.350676 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:59.350653    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p podName:d206ef89-b02a-450a-8ee6-5e90c4a8f3fb nodeName:}" failed. No retries permitted until 2026-08-04 16:02:03.350633297 +0000 UTC m=+9.207106124 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-czt2p" (UniqueName: "kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p") pod "network-check-target-xlt82" (UID: "d206ef89-b02a-450a-8ee6-5e90c4a8f3fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:01:59.687080 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:01:59.687050    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:01:59.687261 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:01:59.687156    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:00.687201 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:00.687161    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:00.687401 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:00.687310    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:00.687401 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:00.687362    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:00.687830 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:00.687480    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:01.117393 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:02:01.117355    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260ae6f4_c39b_44c0_8283_f1917eaa49ed.slice/crio-fa758d0abe27603f288323935763fe24354684a9c9741efb3de1e063ddc706d5 WatchSource:0}: Error finding container fa758d0abe27603f288323935763fe24354684a9c9741efb3de1e063ddc706d5: Status 404 returned error can't find the container with id fa758d0abe27603f288323935763fe24354684a9c9741efb3de1e063ddc706d5
Aug 04 16:02:01.688637 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.687808    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:01.688637 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:01.688197    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:01.717888 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.717853    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hppxb" event={"ID":"1209e993-fa64-4195-a8f2-d2ccf43f9390","Type":"ContainerStarted","Data":"63ee9968dbce70d62cf35a3e19da3a4204614ec618d08c5ef638c32facef1279"}
Aug 04 16:02:01.721722 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.721692    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw" event={"ID":"be45fac3-d86d-4369-be0b-665833f105d9","Type":"ContainerStarted","Data":"83c05a6a884f9fcfd72f32bfe29faa33fb97b00ba3c6821b0f54b876815b13d9"}
Aug 04 16:02:01.723995 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.723973    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zmjsp" event={"ID":"539c6194-4c8c-4a36-aa43-5fb5237a4aa9","Type":"ContainerStarted","Data":"04e99e8eb72393ea997f4d4149898e942bb91cc4c38c5b1d9606b86869ffda7e"}
Aug 04 16:02:01.727122 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.727096    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btz62" event={"ID":"3e4f2666-ba1d-4da0-9d68-80d60704fbf4","Type":"ContainerStarted","Data":"7ab28fac94bcd920e8ffbdef6d1220b42b64165d4fbc8723310d14565fecb1da"}
Aug 04 16:02:01.734586 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.734561    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5pqks" event={"ID":"260ae6f4-c39b-44c0-8283-f1917eaa49ed","Type":"ContainerStarted","Data":"fa758d0abe27603f288323935763fe24354684a9c9741efb3de1e063ddc706d5"}
Aug 04 16:02:01.741968 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.741258    2558 generic.go:356] "Generic (PLEG): container finished" podID="0affb8f6-4aea-42d6-ab48-ffe1fb5b682b" containerID="0b220c70a0e73db33d99946aae716cc1d94f81f8fb7734dec24513e4fd3b328c" exitCode=0
Aug 04 16:02:01.741968 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.741334    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hm7nd" event={"ID":"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b","Type":"ContainerDied","Data":"0b220c70a0e73db33d99946aae716cc1d94f81f8fb7734dec24513e4fd3b328c"}
Aug 04 16:02:01.748349 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.748322    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qt5hg" event={"ID":"34cb4228-a3d9-4bd8-982b-6a941e97db27","Type":"ContainerStarted","Data":"d9d582f29822b1311e35b4c1a3a8fc5e997f09edebf268651b6f3c470ae7bc28"}
Aug 04 16:02:01.756731 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.756174    2558 generic.go:356] "Generic (PLEG): container finished" podID="c50b0697e001946451392e20de4c7632" containerID="4f566f41b6683f4a02faa3afc60482bd4970cac2bf42f354c3755b53279b1c32" exitCode=0
Aug 04 16:02:01.756731 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.756215    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal" event={"ID":"c50b0697e001946451392e20de4c7632","Type":"ContainerDied","Data":"4f566f41b6683f4a02faa3afc60482bd4970cac2bf42f354c3755b53279b1c32"}
Aug 04 16:02:01.783033 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.782978    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zmjsp" podStartSLOduration=2.081864387 podStartE2EDuration="6.782960098s" totalImagesPullingTime="4.701095711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:01.7467115 +0000 UTC m=+7.603184347" watchObservedRunningTime="2026-08-04 16:02:01.782960098 +0000 UTC m=+7.639432943"
Aug 04 16:02:01.797414 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:01.797361    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qt5hg" podStartSLOduration=2.154232793 podStartE2EDuration="6.797341764s" totalImagesPullingTime="4.643108971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:01.797249797 +0000 UTC m=+7.653722642" watchObservedRunningTime="2026-08-04 16:02:01.797341764 +0000 UTC m=+7.653814612"
Aug 04 16:02:02.687447 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:02.687412    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:02.687632 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:02.687568    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:02.687900 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:02.687858    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:02.688033 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:02.688007    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:02.761280 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:02.761231    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal" event={"ID":"c50b0697e001946451392e20de4c7632","Type":"ContainerStarted","Data":"257985f5e24d9a5f218a4bf91168145ac5022eb0aa043ffb30b14bd46a710b74"}
Aug 04 16:02:02.778811 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:02.778765    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-219.ec2.internal" podStartSLOduration=7.778729658 podStartE2EDuration="7.778729658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:02.77800288 +0000 UTC m=+8.634475726" watchObservedRunningTime="2026-08-04 16:02:02.778729658 +0000 UTC m=+8.635202503"
Aug 04 16:02:03.281971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:03.281309    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:03.281971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:03.281391    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:03.281971 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:03.281544    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:03.281971 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:03.281599    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs podName:94745705-d59a-4672-b018-7a34bca41ca6 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:11.281581912 +0000 UTC m=+17.138054752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs") pod "network-metrics-daemon-mgh47" (UID: "94745705-d59a-4672-b018-7a34bca41ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:03.282323 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:03.282001    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:03.282323 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:03.282056    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret podName:1970ae52-3a87-4857-86ee-7b8f65d2b970 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:11.282041842 +0000 UTC m=+17.138514663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret") pod "global-pull-secret-syncer-567wr" (UID: "1970ae52-3a87-4857-86ee-7b8f65d2b970") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:03.382587 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:03.381977    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:03.382587 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:03.382138    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:03.382587 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:03.382158    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:03.382587 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:03.382170    2558 projected.go:196] Error preparing data for projected volume kube-api-access-czt2p for pod openshift-network-diagnostics/network-check-target-xlt82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:03.382587 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:03.382224    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p podName:d206ef89-b02a-450a-8ee6-5e90c4a8f3fb nodeName:}" failed. No retries permitted until 2026-08-04 16:02:11.382206981 +0000 UTC m=+17.238679809 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-czt2p" (UniqueName: "kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p") pod "network-check-target-xlt82" (UID: "d206ef89-b02a-450a-8ee6-5e90c4a8f3fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:03.687121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:03.687071    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:03.687307 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:03.687185    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:03.766985 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:03.766916    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btz62" event={"ID":"3e4f2666-ba1d-4da0-9d68-80d60704fbf4","Type":"ContainerStarted","Data":"70ff4b756e626d67da9450049948da9f39f8f5659f5eec498f141a9e2bfd849a"}
Aug 04 16:02:04.384224 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:04.384050    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:02:04.384690 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:04.384537    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:02:04.401695 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:04.401042    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-btz62" podStartSLOduration=9.401023391 podStartE2EDuration="9.401023391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:03.783847035 +0000 UTC m=+9.640319895" watchObservedRunningTime="2026-08-04 16:02:04.401023391 +0000 UTC m=+10.257496237"
Aug 04 16:02:04.690111 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:04.689220    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:04.690111 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:04.689220    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:04.690111 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:04.689662    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:04.690111 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:04.689713    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:04.776252 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:04.775567    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5pqks" event={"ID":"260ae6f4-c39b-44c0-8283-f1917eaa49ed","Type":"ContainerStarted","Data":"c16ca6bcb7e4e54aa12e4c4f142064659caa0db14626bc3d0468af325db82c2a"}
Aug 04 16:02:04.780769 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:04.779697    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 04 16:02:04.780769 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:04.780377    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal" event={"ID":"0ce7e1ec722c560af91b69ec211c1787","Type":"ContainerStarted","Data":"f92ce5432c0546229f880910b9f82ee5734ae931be11bc771995d0f7267d367e"}
Aug 04 16:02:04.795576 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:04.795528    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5pqks" podStartSLOduration=6.538842078 podStartE2EDuration="9.79551069s" totalImagesPullingTime="3.256668612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:04.794780393 +0000 UTC m=+10.651253240" watchObservedRunningTime="2026-08-04 16:02:04.79551069 +0000 UTC m=+10.651983539"
Aug 04 16:02:05.687326 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:05.687295    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:05.687513 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:05.687432    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:06.687417 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:06.687386    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:06.688039 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:06.687525    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:06.688039 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:06.688029    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:06.688166 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:06.688148    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:07.687586 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:07.687503    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:07.688152 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:07.687639    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:08.687807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:08.687771    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:08.688389 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:08.687913    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:08.688389 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:08.687943    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:08.688389 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:08.688103    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:08.865970 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:08.865935    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:02:08.866122 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:08.866083    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 04 16:02:08.866775 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:08.866525    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qt5hg"
Aug 04 16:02:08.883483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:08.883435    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-219.ec2.internal" podStartSLOduration=13.883419062 podStartE2EDuration="13.883419062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:04.810249539 +0000 UTC m=+10.666722388" watchObservedRunningTime="2026-08-04 16:02:08.883419062 +0000 UTC m=+14.739891911"
Aug 04 16:02:09.687214 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:09.687180    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:09.687388 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:09.687289    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:10.687808 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:10.687768    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:10.688255 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:10.687768    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:10.688255 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:10.687918    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:10.688255 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:10.687959    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:11.353584 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:11.353546    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:11.353778 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:11.353606    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:11.353778 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:11.353688    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:11.353778 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:11.353718    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:11.353778 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:11.353774    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs podName:94745705-d59a-4672-b018-7a34bca41ca6 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:27.353755722 +0000 UTC m=+33.210228558 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs") pod "network-metrics-daemon-mgh47" (UID: "94745705-d59a-4672-b018-7a34bca41ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:11.353977 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:11.353791    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret podName:1970ae52-3a87-4857-86ee-7b8f65d2b970 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:27.353783362 +0000 UTC m=+33.210256184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret") pod "global-pull-secret-syncer-567wr" (UID: "1970ae52-3a87-4857-86ee-7b8f65d2b970") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:11.454083 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:11.454049    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:11.454247 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:11.454199    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:11.454247 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:11.454215    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:11.454247 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:11.454228    2558 projected.go:196] Error preparing data for projected volume kube-api-access-czt2p for pod openshift-network-diagnostics/network-check-target-xlt82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:11.454401 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:11.454279    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p podName:d206ef89-b02a-450a-8ee6-5e90c4a8f3fb nodeName:}" failed. No retries permitted until 2026-08-04 16:02:27.454265265 +0000 UTC m=+33.310738087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-czt2p" (UniqueName: "kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p") pod "network-check-target-xlt82" (UID: "d206ef89-b02a-450a-8ee6-5e90c4a8f3fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:11.687600 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:11.687568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:11.687811 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:11.687694    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:12.686887 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:12.686855    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:12.686887 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:12.686891    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:12.687379 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:12.686978    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:12.687379 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:12.687068    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:13.687266 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:13.687233    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:13.687813 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:13.687363    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:14.687919 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:14.687887    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:14.688360 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:14.688091    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:14.688360 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:14.688082    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:14.688360 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:14.688214    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:15.686842 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:15.686728    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:15.687033 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:15.686869    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:16.687762 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:16.687714    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:16.688175 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:16.687714    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:16.688175 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:16.687885    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:16.688175 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:16.687932    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:17.687146 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:17.687111    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:17.687519 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:17.687246    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:18.581844 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.581565    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 16:02:18.585919 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.585696    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T16:02:18.581822635Z","UUID":"3ddbf2f4-3421-46dc-8711-f179e659c9ef","Handler":null,"Name":"","Endpoint":""}
Aug 04 16:02:18.587878 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.587854    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 16:02:18.587977 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.587903    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 16:02:18.690688 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.690666    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:18.690821 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.690694    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:18.690821 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:18.690772    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:18.690912 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:18.690866    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:18.813165 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.813139    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65rhv" event={"ID":"70e1a8ed-3f32-4741-88f6-83c335916944","Type":"ContainerStarted","Data":"5d1c4afaba321fc6747ec1900c3787906cdef85fd21eae7cda2bf2e6493e85d7"}
Aug 04 16:02:18.815311 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.815288    2558 generic.go:356] "Generic (PLEG): container finished" podID="0affb8f6-4aea-42d6-ab48-ffe1fb5b682b" containerID="70eb71f417601b87bf0a70891cb63d3163022b985e63e8137150d15459d1c220" exitCode=0
Aug 04 16:02:18.815413 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.815382    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hm7nd" event={"ID":"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b","Type":"ContainerDied","Data":"70eb71f417601b87bf0a70891cb63d3163022b985e63e8137150d15459d1c220"}
Aug 04 16:02:18.817037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.817014    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hppxb" event={"ID":"1209e993-fa64-4195-a8f2-d2ccf43f9390","Type":"ContainerStarted","Data":"f263a1a7cf345823feaf6a8970ccc38bc41e21a5ec33b04134067a4bb2260635"}
Aug 04 16:02:18.819449 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.819428    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" event={"ID":"63d91ee8-a85a-4c4d-895a-abe24006c931","Type":"ContainerStarted","Data":"3891ebfe9f8f634d77caf00c72e6f910c6bdbfd9a6332239fc2ecf305164fdbe"}
Aug 04 16:02:18.819542 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.819502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" event={"ID":"63d91ee8-a85a-4c4d-895a-abe24006c931","Type":"ContainerStarted","Data":"503908dfb20cf424e6ad007bec4666638bb4cfa992d9dad23530d40dc17eb3bd"}
Aug 04 16:02:18.819602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.819557    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" event={"ID":"63d91ee8-a85a-4c4d-895a-abe24006c931","Type":"ContainerStarted","Data":"58dd911fdfb282e6eacd4912f7dd0518b4710d84a968de1587416d776ff5dd67"}
Aug 04 16:02:18.821061 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.821041    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw" event={"ID":"be45fac3-d86d-4369-be0b-665833f105d9","Type":"ContainerStarted","Data":"83090a51c7e1cdac62a2655d0cb7398b5b1e58cd44f2f3b726b836a8605f9ce4"}
Aug 04 16:02:18.836622 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.836573    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-65rhv" podStartSLOduration=3.064537967 podStartE2EDuration="23.836558339s" totalImagesPullingTime="20.772020372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:18.836127389 +0000 UTC m=+24.692600256" watchObservedRunningTime="2026-08-04 16:02:18.836558339 +0000 UTC m=+24.693031184"
Aug 04 16:02:18.875987 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:18.875941    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hppxb" podStartSLOduration=6.552707989 podStartE2EDuration="23.875923727s" totalImagesPullingTime="17.323215738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:18.875888278 +0000 UTC m=+24.732361122" watchObservedRunningTime="2026-08-04 16:02:18.875923727 +0000 UTC m=+24.732396575"
Aug 04 16:02:19.686890 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:19.686861    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:19.687289 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:19.686956    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:19.825738 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:19.825656    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" event={"ID":"63d91ee8-a85a-4c4d-895a-abe24006c931","Type":"ContainerStarted","Data":"f10052cc80fa0d105e4d2272df5c2577565f0a848b828084267ffcae2d07d0d0"}
Aug 04 16:02:19.825738 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:19.825723    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" event={"ID":"63d91ee8-a85a-4c4d-895a-abe24006c931","Type":"ContainerStarted","Data":"9560a9552897dcdd8126c714ef2cf48ab2fc53e1de7b4ba529f215e85f478724"}
Aug 04 16:02:19.825942 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:19.825770    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" event={"ID":"63d91ee8-a85a-4c4d-895a-abe24006c931","Type":"ContainerStarted","Data":"7c904ca592990c78880618d0588fea41965731e5b1a848381bff980fc7c87926"}
Aug 04 16:02:20.687631 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:20.687600    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:20.688113 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:20.687717    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:20.688113 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:20.687760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:20.688113 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:20.687836    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:21.687676 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:21.687647    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:21.688115 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:21.687740    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:21.833971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:21.833942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" event={"ID":"63d91ee8-a85a-4c4d-895a-abe24006c931","Type":"ContainerStarted","Data":"e56dafbd959652885c0007d7b0643d42d74ad30c5fb8f8e820c52a10915e9be0"}
Aug 04 16:02:21.835876 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:21.835852    2558 generic.go:356] "Generic (PLEG): container finished" podID="0affb8f6-4aea-42d6-ab48-ffe1fb5b682b" containerID="dd91a512693f9a1167dee554952811987236ea8312379e5d1c635c535e83c902" exitCode=0
Aug 04 16:02:21.835989 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:21.835892    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hm7nd" event={"ID":"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b","Type":"ContainerDied","Data":"dd91a512693f9a1167dee554952811987236ea8312379e5d1c635c535e83c902"}
Aug 04 16:02:22.687290 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:22.687259    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:22.687442 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:22.687382    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:22.687442 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:22.687432    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:22.687536 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:22.687517    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:23.686855 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:23.686638    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:23.687547 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:23.686958    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:23.847936 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:23.847884    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" event={"ID":"63d91ee8-a85a-4c4d-895a-abe24006c931","Type":"ContainerStarted","Data":"134486c95e6020f63d1028f96afb1ab50535c786c5d9eec42447173ac078bbf1"}
Aug 04 16:02:23.848202 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:23.848180    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:02:23.848290 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:23.848256    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:02:23.866971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:23.866940    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:02:23.879058 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:23.878992    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" podStartSLOduration=6.849220761 podStartE2EDuration="28.878973196s" totalImagesPullingTime="22.029752435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:23.878239883 +0000 UTC m=+29.734712727" watchObservedRunningTime="2026-08-04 16:02:23.878973196 +0000 UTC m=+29.735446041"
Aug 04 16:02:24.690231 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:24.690200    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:24.690609 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:24.690200    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:24.690609 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:24.690291    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:24.690609 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:24.690377    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:24.851978 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:24.851940    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw" event={"ID":"be45fac3-d86d-4369-be0b-665833f105d9","Type":"ContainerStarted","Data":"23673f88f49f6a3825339e0c0dd14d39fcfc0fcd2f6faf5d22e8d58f74fa9984"}
Aug 04 16:02:24.852314 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:24.852288    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:02:24.867340 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:24.867316    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:02:24.875864 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:24.875830    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g9hzw" podStartSLOduration=2.695568946 podStartE2EDuration="29.875818062s" totalImagesPullingTime="27.180249116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:24.875681125 +0000 UTC m=+30.732153972" watchObservedRunningTime="2026-08-04 16:02:24.875818062 +0000 UTC m=+30.732290921"
Aug 04 16:02:25.686957 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:25.686923    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:25.687165 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:25.687059    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:26.025081 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:26.025058    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zmjsp_539c6194-4c8c-4a36-aa43-5fb5237a4aa9/dns-node-resolver/0.log"
Aug 04 16:02:26.601642 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:26.601619    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pqks_260ae6f4-c39b-44c0-8283-f1917eaa49ed/node-ca/0.log"
Aug 04 16:02:26.686794 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:26.686764    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:26.686954 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:26.686876    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:26.686954 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:26.686909    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:26.687069 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:26.686957    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:26.858065 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:26.857989    2558 generic.go:356] "Generic (PLEG): container finished" podID="0affb8f6-4aea-42d6-ab48-ffe1fb5b682b" containerID="b9b4371177ce87e539cba0ef5c87ea4b4dae2d990565fe1d8ee06e270e37075a" exitCode=0
Aug 04 16:02:26.858195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:26.858081    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hm7nd" event={"ID":"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b","Type":"ContainerDied","Data":"b9b4371177ce87e539cba0ef5c87ea4b4dae2d990565fe1d8ee06e270e37075a"}
Aug 04 16:02:27.374349 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:27.374318    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:27.374805 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:27.374374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:27.374805 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:27.374469    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:27.374805 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:27.374482    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:27.374805 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:27.374514    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs podName:94745705-d59a-4672-b018-7a34bca41ca6 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:59.37450275 +0000 UTC m=+65.230975571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs") pod "network-metrics-daemon-mgh47" (UID: "94745705-d59a-4672-b018-7a34bca41ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:27.374805 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:27.374549    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret podName:1970ae52-3a87-4857-86ee-7b8f65d2b970 nodeName:}" failed. No retries permitted until 2026-08-04 16:02:59.374529341 +0000 UTC m=+65.231002163 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret") pod "global-pull-secret-syncer-567wr" (UID: "1970ae52-3a87-4857-86ee-7b8f65d2b970") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:27.475194 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:27.475163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:27.475321 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:27.475302    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:27.475321 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:27.475320    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:27.475402 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:27.475329    2558 projected.go:196] Error preparing data for projected volume kube-api-access-czt2p for pod openshift-network-diagnostics/network-check-target-xlt82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:27.475402 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:27.475370    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p podName:d206ef89-b02a-450a-8ee6-5e90c4a8f3fb nodeName:}" failed. No retries permitted until 2026-08-04 16:02:59.475357908 +0000 UTC m=+65.331830733 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-czt2p" (UniqueName: "kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p") pod "network-check-target-xlt82" (UID: "d206ef89-b02a-450a-8ee6-5e90c4a8f3fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:27.687178 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:27.687120    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:27.687279 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:27.687210    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:28.686760 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:28.686726    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:28.687189 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:28.686833    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:28.687189 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:28.686898    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:28.687189 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:28.687012    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:29.686998 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:29.686966    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:29.687388 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:29.687078    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:30.687616 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:30.687582    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:30.688089 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:30.687688    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:30.688089 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:30.687759    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:30.688089 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:30.687851    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:31.687086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:31.687048    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:31.687240 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:31.687192    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:32.686763 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:32.686722    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:32.687216 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:32.686900    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:32.687216 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:32.686940    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:32.687216 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:32.687049    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:33.687063 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:33.686904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:33.687063 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:33.687038    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:34.688136 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:34.687962    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:34.688495 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:34.688190    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:34.688495 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:34.688036    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:34.688495 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:34.688300    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:34.878228 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:34.878195    2558 generic.go:356] "Generic (PLEG): container finished" podID="0affb8f6-4aea-42d6-ab48-ffe1fb5b682b" containerID="d955bf150c96267982f2789e9c9c2b1a89c8b149e28e73e94da7c6f614e8be2f" exitCode=0
Aug 04 16:02:34.878382 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:34.878268    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hm7nd" event={"ID":"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b","Type":"ContainerDied","Data":"d955bf150c96267982f2789e9c9c2b1a89c8b149e28e73e94da7c6f614e8be2f"}
Aug 04 16:02:35.687287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:35.687256    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:35.687441 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:35.687357    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:35.883437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:35.883401    2558 generic.go:356] "Generic (PLEG): container finished" podID="0affb8f6-4aea-42d6-ab48-ffe1fb5b682b" containerID="ba27eb383440cbcdf70b84bbe7906f2ca5872512a3b28a76542dba1b09594654" exitCode=0
Aug 04 16:02:35.883829 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:35.883448    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hm7nd" event={"ID":"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b","Type":"ContainerDied","Data":"ba27eb383440cbcdf70b84bbe7906f2ca5872512a3b28a76542dba1b09594654"}
Aug 04 16:02:36.687335 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:36.687301    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:36.687493 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:36.687426    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:36.687493 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:36.687474    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:36.687581 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:36.687564    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:36.888319 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:36.888284    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hm7nd" event={"ID":"0affb8f6-4aea-42d6-ab48-ffe1fb5b682b","Type":"ContainerStarted","Data":"e4f218c0269f677c734d756d8c15a76aa1b2d09c6f5247682ef8c09e84a38a81"}
Aug 04 16:02:36.915052 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:36.915012    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hm7nd" podStartSLOduration=6.742380424 podStartE2EDuration="41.914998925s" totalImagesPullingTime="35.172618501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:02:36.914568788 +0000 UTC m=+42.771041635" watchObservedRunningTime="2026-08-04 16:02:36.914998925 +0000 UTC m=+42.771471768"
Aug 04 16:02:37.686964 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:37.686926    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:37.687128 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:37.687026    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:38.692765 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:38.692728    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:38.693112 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:38.692855    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:38.693112 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:38.692883    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:38.693112 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:38.692946    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:39.687306 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:39.687275    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:39.687531 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:39.687369    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:40.689686 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:40.689657    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:40.690057 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:40.689778    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:40.690057 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:40.689830    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:40.690057 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:40.689910    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:41.687643 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:41.687612    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:41.687850 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:41.687726    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:42.690156 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:42.690124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:42.690600 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:42.690124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:42.690600 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:42.690235    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:42.690600 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:42.690314    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:43.686972 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:43.686925    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:43.687162 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:43.687040    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:44.687822 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:44.687788    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:44.688254 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:44.687881    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:44.688254 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:44.687942    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:44.688254 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:44.688049    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:45.686761 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:45.686722    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:45.686922 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:45.686837    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:46.689871 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:46.689842    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:46.690288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:46.689846    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:46.690288 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:46.689932    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:46.690288 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:46.690009    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:47.687311 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:47.687282    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:47.687533 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:47.687377    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:48.687349 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:48.687318    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:48.687853 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:48.687321    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:48.687853 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:48.687430    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:48.687853 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:48.687508    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:49.687663 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:49.687634    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:49.688033 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:49.687728    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:50.687367 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:50.687336    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:50.687631 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:50.687467    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:50.687631 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:50.687527    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:50.688009 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:50.687659    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:51.686891 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:51.686859    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:51.687048 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:51.686959    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:52.687076 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:52.687037    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:52.687539 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:52.687182    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:52.687539 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:52.687233    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:52.687539 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:52.687345    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:53.687722 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:53.687688    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:53.688108 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:53.687803    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:54.687499 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:54.687466    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:54.687648 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:54.687541    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:54.687648 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:54.687563    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:54.687648 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:54.687632    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:55.687044 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:55.687010    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:55.687541 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:55.687122    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:56.687441 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:56.687407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:56.687901 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:56.687407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:56.687901 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:56.687517    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:56.687901 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:56.687572    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:56.868306 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:56.868262    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" podUID="63d91ee8-a85a-4c4d-895a-abe24006c931" containerName="ovnkube-controller" probeResult="failure" output=""
Aug 04 16:02:57.687165 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:57.687138    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:57.687330 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:57.687224    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:02:58.686828 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:58.686798    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:58.687249 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:58.686918    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:02:58.687249 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:58.686987    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:58.687249 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:58.687077    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:02:59.406579 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:59.406544    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:02:59.406783 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:59.406603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:59.406783 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:59.406696    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:59.406783 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:59.406716    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:59.406783 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:59.406775    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs podName:94745705-d59a-4672-b018-7a34bca41ca6 nodeName:}" failed. No retries permitted until 2026-08-04 16:04:03.406739886 +0000 UTC m=+129.263212708 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs") pod "network-metrics-daemon-mgh47" (UID: "94745705-d59a-4672-b018-7a34bca41ca6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 16:02:59.406932 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:59.406796    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret podName:1970ae52-3a87-4857-86ee-7b8f65d2b970 nodeName:}" failed. No retries permitted until 2026-08-04 16:04:03.406785988 +0000 UTC m=+129.263258812 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret") pod "global-pull-secret-syncer-567wr" (UID: "1970ae52-3a87-4857-86ee-7b8f65d2b970") : object "kube-system"/"original-pull-secret" not registered
Aug 04 16:02:59.507177 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:59.507136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:02:59.507303 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:59.507257    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 16:02:59.507303 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:59.507272    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 16:02:59.507303 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:59.507280    2558 projected.go:196] Error preparing data for projected volume kube-api-access-czt2p for pod openshift-network-diagnostics/network-check-target-xlt82: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:59.507406 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:59.507324    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p podName:d206ef89-b02a-450a-8ee6-5e90c4a8f3fb nodeName:}" failed. No retries permitted until 2026-08-04 16:04:03.507310548 +0000 UTC m=+129.363783370 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-czt2p" (UniqueName: "kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p") pod "network-check-target-xlt82" (UID: "d206ef89-b02a-450a-8ee6-5e90c4a8f3fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 16:02:59.686945 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:02:59.686876    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:02:59.687288 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:02:59.686969    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:00.687377 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:00.687347    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:00.687934 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:00.687439    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:00.687934 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:00.687498    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:00.687934 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:00.687618    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:01.687553 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:01.687521    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:01.687944 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:01.687634    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:02.687333 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:02.687293    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:02.687568 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:02.687430    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:02.687568 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:02.687470    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:02.687870 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:02.687570    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:03.686929 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:03.686896    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:03.687090 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:03.686999    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:03.948860 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:03.948786    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:03:03.948860 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:03.948825    2558 generic.go:356] "Generic (PLEG): container finished" podID="70e1a8ed-3f32-4741-88f6-83c335916944" containerID="5d1c4afaba321fc6747ec1900c3787906cdef85fd21eae7cda2bf2e6493e85d7" exitCode=1
Aug 04 16:03:03.949251 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:03.948875    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65rhv" event={"ID":"70e1a8ed-3f32-4741-88f6-83c335916944","Type":"ContainerDied","Data":"5d1c4afaba321fc6747ec1900c3787906cdef85fd21eae7cda2bf2e6493e85d7"}
Aug 04 16:03:03.949251 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:03.949211    2558 scope.go:117] "RemoveContainer" containerID="5d1c4afaba321fc6747ec1900c3787906cdef85fd21eae7cda2bf2e6493e85d7"
Aug 04 16:03:04.688000 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:04.687965    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:04.688164 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:04.688073    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:04.688164 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:04.688129    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:04.688241 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:04.688220    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:04.953283 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:04.953209    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:03:04.953283 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:04.953261    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-65rhv" event={"ID":"70e1a8ed-3f32-4741-88f6-83c335916944","Type":"ContainerStarted","Data":"b0f1b0d7ad21aa0adcfe57cdea4c680d32724c359a2e674c2fd903ddd08f4126"}
Aug 04 16:03:05.686949 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:05.686918    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:05.687113 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:05.687015    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:06.687655 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:06.687623    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:06.688071 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:06.687630    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:06.688071 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:06.687737    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:06.688071 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:06.687819    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:07.687038 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:07.687008    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:07.687194 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:07.687101    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:08.687547 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:08.687517    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:08.687991 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:08.687612    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:08.687991 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:08.687641    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:08.687991 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:08.687693    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:09.687384 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:09.687355    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:09.687551 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:09.687444    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:10.687393 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:10.687361    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:10.687940 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:10.687450    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:10.687940 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:10.687532    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:10.687940 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:10.687663    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:11.687074 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:11.687044    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:11.687233 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:11.687137    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:12.686803 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:12.686773    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:12.686803 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:12.686788    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:12.687180 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:12.686869    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:12.687180 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:12.686986    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:13.687036 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:13.687002    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:13.687381 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:13.687099    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:14.687516 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:14.687482    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:14.688001 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:14.687584    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:14.688001 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:14.687644    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:14.688001 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:14.687767    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:15.687469 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:15.687439    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:15.687620 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:15.687532    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:16.687057 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:16.686934    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:16.687217 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:16.687074    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:16.687217 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:16.687130    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:16.687337 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:16.687234    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:17.687212 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:17.687179    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:17.687668 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:17.687295    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:18.686935 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:18.686905    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:18.687123 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:18.687064    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:18.687123 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:18.687109    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:18.687240 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:18.687208    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:19.687634 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:19.687606    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:19.687996 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:19.687696    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:20.687096 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:20.687065    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:20.687253 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:20.687195    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:20.687253 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:20.687244    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:20.687352 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:20.687334    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:21.686872 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:21.686844    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:21.687215 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:21.686938    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:22.687685 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:22.687649    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:22.687685 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:22.687649    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:22.688213 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:22.687902    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:22.688213 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:22.687974    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:23.687607 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:23.687576    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:23.687791 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:23.687676    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:24.687665 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:24.687635    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:24.687874 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:24.687713    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:24.688178 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:24.687878    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:24.688178 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:24.687981    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:25.686631 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:25.686607    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:25.686804 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:25.686703    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:26.687562 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:26.687525    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:26.687963 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:26.687525    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:26.687963 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:26.687638    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:26.687963 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:26.687711    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:26.867985 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:26.867948    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" podUID="63d91ee8-a85a-4c4d-895a-abe24006c931" containerName="ovnkube-controller" probeResult="failure" output=""
Aug 04 16:03:27.687037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:27.687007    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:27.687212 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:27.687115    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:28.686715 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:28.686683    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:28.687173 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:28.686869    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:28.687173 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:28.686892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:28.687173 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:28.687008    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:29.687292 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:29.687266    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:29.687627 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:29.687353    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:30.687173 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:30.687142    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:30.687364 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:30.687269    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:30.687364 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:30.687330    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:30.687707 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:30.687405    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:31.687725 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:31.687686    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:31.688123 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:31.687805    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:31.696733 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:31.696696    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5" podUID="63d91ee8-a85a-4c4d-895a-abe24006c931" containerName="ovnkube-controller" probeResult="failure" output=""
Aug 04 16:03:32.687446 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:32.687412    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:32.687446 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:32.687426    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:32.687675 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:32.687618    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:32.687743 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:32.687722    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:33.687113 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:33.687085    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:33.687273 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:33.687177    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:34.687462 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:34.687433    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:34.687840 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:34.687529    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:34.687840 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:34.687582    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:34.687840 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:34.687661    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:35.686665 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:35.686637    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:35.686839 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:35.686815    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:36.687084 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:36.687051    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:36.687536 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:36.687162    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:36.687536 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:36.687209    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:36.687536 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:36.687294    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:37.687270 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:37.687241    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:37.687620 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:37.687337    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:38.686731 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:38.686698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:38.686902 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:38.686825    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:38.686943 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:38.686903    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:38.687016 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:38.686998    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:39.687059 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:39.687030    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:39.687460 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:39.687119    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:40.686902 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:40.686872    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:40.687067 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:40.686969    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:40.687067 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:40.686999    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:40.687067 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:40.687054    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:41.687319 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:41.687292    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:41.687665 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:41.687387    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:42.686803 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:42.686768    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:42.686803 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:42.686793    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:42.687002 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:42.686907    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:42.687050 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:42.686999    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:43.487274 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:43.487244    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-567wr"]
Aug 04 16:03:43.487870 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:43.487848    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:43.487987 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:43.487967    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:43.490537 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:43.490514    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mgh47"]
Aug 04 16:03:43.490808 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:43.490792    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:43.491082 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:43.491037    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:43.491374 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:43.491352    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xlt82"]
Aug 04 16:03:43.491453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:43.491435    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:43.491549 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:43.491524    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:45.687449 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:45.687276    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:45.687917 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:45.687316    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:45.687917 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:45.687534    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-567wr" podUID="1970ae52-3a87-4857-86ee-7b8f65d2b970"
Aug 04 16:03:45.687917 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:45.687332    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:45.687917 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:45.687600    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xlt82" podUID="d206ef89-b02a-450a-8ee6-5e90c4a8f3fb"
Aug 04 16:03:45.687917 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:03:45.687664    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgh47" podUID="94745705-d59a-4672-b018-7a34bca41ca6"
Aug 04 16:03:47.115127 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.115095    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pqks_260ae6f4-c39b-44c0-8283-f1917eaa49ed/node-ca/0.log"
Aug 04 16:03:47.442112 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.442055    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-219.ec2.internal" event="NodeReady"
Aug 04 16:03:47.442209 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.442168    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 16:03:47.480886 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.480858    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55567984d8-pb5wt"]
Aug 04 16:03:47.483280 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.483265    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.485957 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.485932    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s5xs2\""
Aug 04 16:03:47.486075 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.485963    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 16:03:47.486075 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.485934    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 16:03:47.486075 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.486053    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 16:03:47.493709 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.493692    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 16:03:47.497134 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.497111    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55567984d8-pb5wt"]
Aug 04 16:03:47.500955 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.500936    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gjs4z"]
Aug 04 16:03:47.503491 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.503475    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vv65q"]
Aug 04 16:03:47.503603 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.503589    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gjs4z"
Aug 04 16:03:47.506181 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.506165    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 16:03:47.506349 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.506328    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 16:03:47.506349 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.506356    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-svsf8\""
Aug 04 16:03:47.506489 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.506398    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.506489 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.506418    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 16:03:47.509204 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.509185    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d2pjg\""
Aug 04 16:03:47.509418 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.509312    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 16:03:47.509418 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.509321    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 16:03:47.515128 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.515099    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gjs4z"]
Aug 04 16:03:47.515831 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.515814    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vv65q"]
Aug 04 16:03:47.522375 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.522357    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tlmpb"]
Aug 04 16:03:47.525212 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.525191    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.527978 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.527959    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 16:03:47.528074 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.528016    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 16:03:47.528136 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.527989    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 16:03:47.528759 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.528731    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-svpvj\""
Aug 04 16:03:47.528854 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.528831    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 16:03:47.539031 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.539011    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tlmpb"]
Aug 04 16:03:47.581193 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-image-registry-private-configuration\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.581273 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581195    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-trusted-ca\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.581273 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581216    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwzxp\" (UniqueName: \"kubernetes.io/projected/4cddeb9d-83a3-4912-aa95-87a787061f13-kube-api-access-lwzxp\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.581347 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-registry-tls\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.581347 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581293    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-registry-certificates\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.581347 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c-cert\") pod \"ingress-canary-gjs4z\" (UID: \"a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c\") " pod="openshift-ingress-canary/ingress-canary-gjs4z"
Aug 04 16:03:47.581347 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q42p\" (UniqueName: \"kubernetes.io/projected/a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c-kube-api-access-7q42p\") pod \"ingress-canary-gjs4z\" (UID: \"a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c\") " pod="openshift-ingress-canary/ingress-canary-gjs4z"
Aug 04 16:03:47.581466 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581371    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-bound-sa-token\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.581466 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cddeb9d-83a3-4912-aa95-87a787061f13-crio-socket\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.581466 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581416    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff3ee70-603d-4e02-b093-fa8a34dfce43-config-volume\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.581466 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cddeb9d-83a3-4912-aa95-87a787061f13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.581466 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581452    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6mnp\" (UniqueName: \"kubernetes.io/projected/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-kube-api-access-q6mnp\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.581713 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cddeb9d-83a3-4912-aa95-87a787061f13-data-volume\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.581713 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581489    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-ca-trust-extracted\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.581713 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-installation-pull-secrets\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.581713 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581525    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cddeb9d-83a3-4912-aa95-87a787061f13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.581713 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6hhr\" (UniqueName: \"kubernetes.io/projected/1ff3ee70-603d-4e02-b093-fa8a34dfce43-kube-api-access-v6hhr\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.581713 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ff3ee70-603d-4e02-b093-fa8a34dfce43-metrics-tls\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.581713 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.581594    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff3ee70-603d-4e02-b093-fa8a34dfce43-tmp-dir\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.681841 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.681816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-installation-pull-secrets\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.681841 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.681845    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cddeb9d-83a3-4912-aa95-87a787061f13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.681982 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.681874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6hhr\" (UniqueName: \"kubernetes.io/projected/1ff3ee70-603d-4e02-b093-fa8a34dfce43-kube-api-access-v6hhr\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.681982 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.681903    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ff3ee70-603d-4e02-b093-fa8a34dfce43-metrics-tls\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.681982 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.681931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff3ee70-603d-4e02-b093-fa8a34dfce43-tmp-dir\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.681982 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.681976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-image-registry-private-configuration\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.682169 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682000    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-trusted-ca\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.682169 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682045    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzxp\" (UniqueName: \"kubernetes.io/projected/4cddeb9d-83a3-4912-aa95-87a787061f13-kube-api-access-lwzxp\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.682302 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682282    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ff3ee70-603d-4e02-b093-fa8a34dfce43-tmp-dir\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.682592 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-registry-tls\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.682687 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-registry-certificates\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.682687 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c-cert\") pod \"ingress-canary-gjs4z\" (UID: \"a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c\") " pod="openshift-ingress-canary/ingress-canary-gjs4z"
Aug 04 16:03:47.682687 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q42p\" (UniqueName: \"kubernetes.io/projected/a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c-kube-api-access-7q42p\") pod \"ingress-canary-gjs4z\" (UID: \"a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c\") " pod="openshift-ingress-canary/ingress-canary-gjs4z"
Aug 04 16:03:47.682687 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682675    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-bound-sa-token\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.682889 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682703    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cddeb9d-83a3-4912-aa95-87a787061f13-crio-socket\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.682889 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff3ee70-603d-4e02-b093-fa8a34dfce43-config-volume\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.682889 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cddeb9d-83a3-4912-aa95-87a787061f13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.682889 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6mnp\" (UniqueName: \"kubernetes.io/projected/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-kube-api-access-q6mnp\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.682889 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682868    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cddeb9d-83a3-4912-aa95-87a787061f13-data-volume\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.683104 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.682907    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-ca-trust-extracted\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.683104 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.683052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-trusted-ca\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.683339 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.683227    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-ca-trust-extracted\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.683399 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.683345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4cddeb9d-83a3-4912-aa95-87a787061f13-crio-socket\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.683797 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.683774    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-registry-certificates\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.683957 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.683848    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1ff3ee70-603d-4e02-b093-fa8a34dfce43-config-volume\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.684356 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.684330    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4cddeb9d-83a3-4912-aa95-87a787061f13-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.684651 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.684628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4cddeb9d-83a3-4912-aa95-87a787061f13-data-volume\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.686572 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.686524    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1ff3ee70-603d-4e02-b093-fa8a34dfce43-metrics-tls\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.686572 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.686541    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c-cert\") pod \"ingress-canary-gjs4z\" (UID: \"a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c\") " pod="openshift-ingress-canary/ingress-canary-gjs4z"
Aug 04 16:03:47.686572 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.686547    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-installation-pull-secrets\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.686730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.686598    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4cddeb9d-83a3-4912-aa95-87a787061f13-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.686730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.686671    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:03:47.686730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.686699    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:03:47.686730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.686675    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:03:47.686943 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.686731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-registry-tls\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.686943 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.686733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-image-registry-private-configuration\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.689418 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.689245    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 16:03:47.689418 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.689298    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kb5nq\""
Aug 04 16:03:47.689618 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.689523    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 16:03:47.689672 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.689635    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 16:03:47.689774 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.689738    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv4gp\""
Aug 04 16:03:47.689935 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.689916    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 16:03:47.690499 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.690476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6hhr\" (UniqueName: \"kubernetes.io/projected/1ff3ee70-603d-4e02-b093-fa8a34dfce43-kube-api-access-v6hhr\") pod \"dns-default-vv65q\" (UID: \"1ff3ee70-603d-4e02-b093-fa8a34dfce43\") " pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.690717 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.690698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwzxp\" (UniqueName: \"kubernetes.io/projected/4cddeb9d-83a3-4912-aa95-87a787061f13-kube-api-access-lwzxp\") pod \"insights-runtime-extractor-tlmpb\" (UID: \"4cddeb9d-83a3-4912-aa95-87a787061f13\") " pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.691848 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.691822    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-bound-sa-token\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.691951 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.691874    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q42p\" (UniqueName: \"kubernetes.io/projected/a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c-kube-api-access-7q42p\") pod \"ingress-canary-gjs4z\" (UID: \"a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c\") " pod="openshift-ingress-canary/ingress-canary-gjs4z"
Aug 04 16:03:47.692327 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.692292    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6mnp\" (UniqueName: \"kubernetes.io/projected/b8d38fb3-9509-44cd-953e-2d3d0fb62f6e-kube-api-access-q6mnp\") pod \"image-registry-55567984d8-pb5wt\" (UID: \"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e\") " pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.792727 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.792700    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:47.812952 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.812933    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gjs4z"
Aug 04 16:03:47.820268 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.820234    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:47.833144 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.833124    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tlmpb"
Aug 04 16:03:47.995136 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.995109    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55567984d8-pb5wt"]
Aug 04 16:03:47.999239 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:47.999212    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gjs4z"]
Aug 04 16:03:48.002350 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:03:48.002324    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13f1b0b_f1fe_4c3b_a7e5_cd4d773d859c.slice/crio-55bc95f588fadf2a67e6692331ef3f76a5e4c1d1d9b59463d96af87f5dbe65b0 WatchSource:0}: Error finding container 55bc95f588fadf2a67e6692331ef3f76a5e4c1d1d9b59463d96af87f5dbe65b0: Status 404 returned error can't find the container with id 55bc95f588fadf2a67e6692331ef3f76a5e4c1d1d9b59463d96af87f5dbe65b0
Aug 04 16:03:48.006919 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:48.006900    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vv65q"]
Aug 04 16:03:48.010487 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:03:48.010462    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff3ee70_603d_4e02_b093_fa8a34dfce43.slice/crio-da4fbe9ffab1d2aeb81a46c5f8ed0c517a0a1d60509ecd591cf78cfe6daf21e9 WatchSource:0}: Error finding container da4fbe9ffab1d2aeb81a46c5f8ed0c517a0a1d60509ecd591cf78cfe6daf21e9: Status 404 returned error can't find the container with id da4fbe9ffab1d2aeb81a46c5f8ed0c517a0a1d60509ecd591cf78cfe6daf21e9
Aug 04 16:03:48.021379 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:48.021274    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tlmpb"]
Aug 04 16:03:48.033599 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:03:48.033577    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cddeb9d_83a3_4912_aa95_87a787061f13.slice/crio-8d97a8c9e3e6c02f308f2fb31ab03fc2429b5f9d1b13cc206f33887dc3ea4bd2 WatchSource:0}: Error finding container 8d97a8c9e3e6c02f308f2fb31ab03fc2429b5f9d1b13cc206f33887dc3ea4bd2: Status 404 returned error can't find the container with id 8d97a8c9e3e6c02f308f2fb31ab03fc2429b5f9d1b13cc206f33887dc3ea4bd2
Aug 04 16:03:48.041164 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:48.041138    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlmpb" event={"ID":"4cddeb9d-83a3-4912-aa95-87a787061f13","Type":"ContainerStarted","Data":"8d97a8c9e3e6c02f308f2fb31ab03fc2429b5f9d1b13cc206f33887dc3ea4bd2"}
Aug 04 16:03:48.042457 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:48.042424    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vv65q" event={"ID":"1ff3ee70-603d-4e02-b093-fa8a34dfce43","Type":"ContainerStarted","Data":"da4fbe9ffab1d2aeb81a46c5f8ed0c517a0a1d60509ecd591cf78cfe6daf21e9"}
Aug 04 16:03:48.043537 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:48.043510    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gjs4z" event={"ID":"a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c","Type":"ContainerStarted","Data":"55bc95f588fadf2a67e6692331ef3f76a5e4c1d1d9b59463d96af87f5dbe65b0"}
Aug 04 16:03:48.044541 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:48.044518    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55567984d8-pb5wt" event={"ID":"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e","Type":"ContainerStarted","Data":"b69383601286fe29386ec95cca6d17396df7a72b87abfd3005baea1b8efbba9e"}
Aug 04 16:03:49.049670 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:49.049636    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55567984d8-pb5wt" event={"ID":"b8d38fb3-9509-44cd-953e-2d3d0fb62f6e","Type":"ContainerStarted","Data":"b799432c684f609da702fd07c575440de88ef23544d0d2ec073506f1b066b8c2"}
Aug 04 16:03:49.050374 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:49.050045    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:03:49.052468 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:49.052445    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlmpb" event={"ID":"4cddeb9d-83a3-4912-aa95-87a787061f13","Type":"ContainerStarted","Data":"c67d2735809aa989bee3c7c373255bcb64c7b5a691b7a0cc0b757a9eacff135c"}
Aug 04 16:03:49.076914 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:49.076865    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55567984d8-pb5wt" podStartSLOduration=8.076846814 podStartE2EDuration="8.076846814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:03:49.074409117 +0000 UTC m=+114.930881960" watchObservedRunningTime="2026-08-04 16:03:49.076846814 +0000 UTC m=+114.933319660"
Aug 04 16:03:50.057028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:50.056994    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlmpb" event={"ID":"4cddeb9d-83a3-4912-aa95-87a787061f13","Type":"ContainerStarted","Data":"3f9ed26dcd28153264f096a82c9a6543b4e72cc97d86a95cd7b4cff34996846e"}
Aug 04 16:03:51.066341 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:51.066070    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vv65q" event={"ID":"1ff3ee70-603d-4e02-b093-fa8a34dfce43","Type":"ContainerStarted","Data":"e60c6469fa73b1a3283a08ee3655867d5e023d5d202d9fb218f90e542ea1eb1f"}
Aug 04 16:03:51.066727 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:51.066407    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vv65q" event={"ID":"1ff3ee70-603d-4e02-b093-fa8a34dfce43","Type":"ContainerStarted","Data":"fb0592ea26abe41d9ca63e029da8b4466832ebff01a9ad0fd24c2da99bbfedd6"}
Aug 04 16:03:51.066727 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:51.066449    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vv65q"
Aug 04 16:03:51.068554 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:51.068525    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gjs4z" event={"ID":"a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c","Type":"ContainerStarted","Data":"c30b877329444de991ebb7a9603264b7d76dd97b6b2ad40dcb008f138861d3be"}
Aug 04 16:03:51.087021 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:51.086938    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vv65q" podStartSLOduration=1.2708380049999999 podStartE2EDuration="4.086922538s" totalImagesPullingTime="2.816084533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:03:51.085027357 +0000 UTC m=+116.941500200" watchObservedRunningTime="2026-08-04 16:03:51.086922538 +0000 UTC m=+116.943395373"
Aug 04 16:03:51.102686 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:51.102634    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gjs4z" podStartSLOduration=1.278155784 podStartE2EDuration="4.102613492s" totalImagesPullingTime="2.824457708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:03:51.101670486 +0000 UTC m=+116.958143330" watchObservedRunningTime="2026-08-04 16:03:51.102613492 +0000 UTC m=+116.959086337"
Aug 04 16:03:52.073519 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:52.073427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tlmpb" event={"ID":"4cddeb9d-83a3-4912-aa95-87a787061f13","Type":"ContainerStarted","Data":"fb282f086e78b4b96a6c37f16abe72faf1e52e09a28a9ab06f7b10be8e1dfa36"}
Aug 04 16:03:52.101569 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:03:52.101525    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tlmpb" podStartSLOduration=1.547284448 podStartE2EDuration="5.101509522s" totalImagesPullingTime="3.554225074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:03:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:03:52.10005577 +0000 UTC m=+117.956528618" watchObservedRunningTime="2026-08-04 16:03:52.101509522 +0000 UTC m=+117.957982365"
Aug 04 16:04:01.698718 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:01.698501    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9fzk5"
Aug 04 16:04:02.079458 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:02.079383    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vv65q"
Aug 04 16:04:03.501791 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.501742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:04:03.502155 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.501800    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:04:03.505263 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.505247    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 16:04:03.506379 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.506352    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 16:04:03.516481 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.516457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1970ae52-3a87-4857-86ee-7b8f65d2b970-original-pull-secret\") pod \"global-pull-secret-syncer-567wr\" (UID: \"1970ae52-3a87-4857-86ee-7b8f65d2b970\") " pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:04:03.516624 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.516459    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94745705-d59a-4672-b018-7a34bca41ca6-metrics-certs\") pod \"network-metrics-daemon-mgh47\" (UID: \"94745705-d59a-4672-b018-7a34bca41ca6\") " pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:04:03.602916 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.602881    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:04:03.606126 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.606107    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 16:04:03.615066 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.615046    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-567wr"
Aug 04 16:04:03.616797 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.616780    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 16:04:03.623034 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.623010    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fv4gp\""
Aug 04 16:04:03.626396 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.626374    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czt2p\" (UniqueName: \"kubernetes.io/projected/d206ef89-b02a-450a-8ee6-5e90c4a8f3fb-kube-api-access-czt2p\") pod \"network-check-target-xlt82\" (UID: \"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb\") " pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:04:03.631004 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.630976    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgh47"
Aug 04 16:04:03.755640 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.755585    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-567wr"]
Aug 04 16:04:03.757918 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:04:03.757892    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1970ae52_3a87_4857_86ee_7b8f65d2b970.slice/crio-1c83a59f5484c08ec306f9891d67eb0d2cc80aeaf63f6d474d92a0cde575f76e WatchSource:0}: Error finding container 1c83a59f5484c08ec306f9891d67eb0d2cc80aeaf63f6d474d92a0cde575f76e: Status 404 returned error can't find the container with id 1c83a59f5484c08ec306f9891d67eb0d2cc80aeaf63f6d474d92a0cde575f76e
Aug 04 16:04:03.770899 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.770879    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mgh47"]
Aug 04 16:04:03.775235 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:04:03.775211    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94745705_d59a_4672_b018_7a34bca41ca6.slice/crio-04302ef88de3920953e239d7a19f0c10f50feaa78de85309b40ec01302bf7e0c WatchSource:0}: Error finding container 04302ef88de3920953e239d7a19f0c10f50feaa78de85309b40ec01302bf7e0c: Status 404 returned error can't find the container with id 04302ef88de3920953e239d7a19f0c10f50feaa78de85309b40ec01302bf7e0c
Aug 04 16:04:03.912665 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.912640    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kb5nq\""
Aug 04 16:04:03.920032 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:03.920016    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:04:04.041271 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:04.041250    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xlt82"]
Aug 04 16:04:04.043325 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:04:04.043296    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd206ef89_b02a_450a_8ee6_5e90c4a8f3fb.slice/crio-9699a1cdbfb4935bdbf4d68d7cb27a907fbcc6652b9ae54ed1a35a1752b7e191 WatchSource:0}: Error finding container 9699a1cdbfb4935bdbf4d68d7cb27a907fbcc6652b9ae54ed1a35a1752b7e191: Status 404 returned error can't find the container with id 9699a1cdbfb4935bdbf4d68d7cb27a907fbcc6652b9ae54ed1a35a1752b7e191
Aug 04 16:04:04.109177 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:04.109141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xlt82" event={"ID":"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb","Type":"ContainerStarted","Data":"9699a1cdbfb4935bdbf4d68d7cb27a907fbcc6652b9ae54ed1a35a1752b7e191"}
Aug 04 16:04:04.110213 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:04.110192    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mgh47" event={"ID":"94745705-d59a-4672-b018-7a34bca41ca6","Type":"ContainerStarted","Data":"04302ef88de3920953e239d7a19f0c10f50feaa78de85309b40ec01302bf7e0c"}
Aug 04 16:04:04.111237 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:04.111218    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-567wr" event={"ID":"1970ae52-3a87-4857-86ee-7b8f65d2b970","Type":"ContainerStarted","Data":"1c83a59f5484c08ec306f9891d67eb0d2cc80aeaf63f6d474d92a0cde575f76e"}
Aug 04 16:04:05.943618 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:05.943581    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7pvr5"]
Aug 04 16:04:05.947179 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:05.947157    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:05.952574 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:05.952546    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 16:04:05.952768 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:05.952611    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 16:04:05.953162 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:05.953084    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 16:04:05.953162 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:05.953119    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 16:04:05.953936 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:05.953918    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 16:04:05.954028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:05.953968    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j6txb\""
Aug 04 16:04:05.954230 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:05.954206    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 16:04:06.018725 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.018693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.018886 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.018760    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-textfile\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.018886 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.018790    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.018886 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.018823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-root\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.019027 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.018887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-wtmp\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.019027 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.018946    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-metrics-client-ca\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.019027 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.018975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7gmp\" (UniqueName: \"kubernetes.io/projected/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-kube-api-access-f7gmp\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.019027 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.019002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-sys\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.019027 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.019024    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-tls\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.120037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.119997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7gmp\" (UniqueName: \"kubernetes.io/projected/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-kube-api-access-f7gmp\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.120195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.120043    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-sys\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.120195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.120072    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-tls\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.120195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.120103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.120195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.120145    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-textfile\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.120195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.120170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.120482 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.120207    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-root\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.120482 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.120254    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-wtmp\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.120482 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.120288    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-metrics-client-ca\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.121038 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.120988    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-sys\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.121038 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.120992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-metrics-client-ca\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.121038 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.121013    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-root\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.121262 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.121102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-wtmp\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.121322 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.121281    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-textfile\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.121539 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.121477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-accelerators-collector-config\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.123195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.123173    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-tls\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.124787 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.124730    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.135757 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.135724    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7gmp\" (UniqueName: \"kubernetes.io/projected/3ef4138b-77ec-4cd6-a141-c91c1d0549f7-kube-api-access-f7gmp\") pod \"node-exporter-7pvr5\" (UID: \"3ef4138b-77ec-4cd6-a141-c91c1d0549f7\") " pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:06.260376 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:06.260298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7pvr5"
Aug 04 16:04:07.249462 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:04:07.249429    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef4138b_77ec_4cd6_a141_c91c1d0549f7.slice/crio-6105b1766699ffa523964f340ff6d0c497aad3eeb0fd18176bf14acae9f21b5c WatchSource:0}: Error finding container 6105b1766699ffa523964f340ff6d0c497aad3eeb0fd18176bf14acae9f21b5c: Status 404 returned error can't find the container with id 6105b1766699ffa523964f340ff6d0c497aad3eeb0fd18176bf14acae9f21b5c
Aug 04 16:04:08.127154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:08.127114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7pvr5" event={"ID":"3ef4138b-77ec-4cd6-a141-c91c1d0549f7","Type":"ContainerStarted","Data":"6105b1766699ffa523964f340ff6d0c497aad3eeb0fd18176bf14acae9f21b5c"}
Aug 04 16:04:09.132343 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:09.132301    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xlt82" event={"ID":"d206ef89-b02a-450a-8ee6-5e90c4a8f3fb","Type":"ContainerStarted","Data":"6b6ee07aa2d3a79a03c28d90cfff5af79856a93028536841989dbcf7ce3d7183"}
Aug 04 16:04:09.132823 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:09.132429    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:04:09.134175 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:09.134152    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-567wr" event={"ID":"1970ae52-3a87-4857-86ee-7b8f65d2b970","Type":"ContainerStarted","Data":"9416c66461bde5985ef2826292afefb3a38295c85f8c0db10a4a6994c4043d4b"}
Aug 04 16:04:09.151391 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:09.151345    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xlt82" podStartSLOduration=129.532823206 podStartE2EDuration="2m14.151332735s" totalImagesPullingTime="4.618509529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:09.150248404 +0000 UTC m=+135.006721248" watchObservedRunningTime="2026-08-04 16:04:09.151332735 +0000 UTC m=+135.007805557"
Aug 04 16:04:09.168235 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:09.168192    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-567wr" podStartSLOduration=129.2593058 podStartE2EDuration="2m14.168175963s" totalImagesPullingTime="4.908870163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:09.167998274 +0000 UTC m=+135.024471117" watchObservedRunningTime="2026-08-04 16:04:09.168175963 +0000 UTC m=+135.024648807"
Aug 04 16:04:10.061717 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.061692    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55567984d8-pb5wt"
Aug 04 16:04:10.138722 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.138693    2558 generic.go:356] "Generic (PLEG): container finished" podID="3ef4138b-77ec-4cd6-a141-c91c1d0549f7" containerID="1eebcd29a012ddfd22e941b40ec2518eba46fb1545474b3410b88a9a55c4adae" exitCode=0
Aug 04 16:04:10.139146 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.138805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7pvr5" event={"ID":"3ef4138b-77ec-4cd6-a141-c91c1d0549f7","Type":"ContainerDied","Data":"1eebcd29a012ddfd22e941b40ec2518eba46fb1545474b3410b88a9a55c4adae"}
Aug 04 16:04:10.140853 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.140828    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mgh47" event={"ID":"94745705-d59a-4672-b018-7a34bca41ca6","Type":"ContainerStarted","Data":"abd60e5f6b512991cb35501a5b99f17bc09a4e96346c87cafc483125312c171c"}
Aug 04 16:04:10.140954 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.140878    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mgh47" event={"ID":"94745705-d59a-4672-b018-7a34bca41ca6","Type":"ContainerStarted","Data":"d9013ec9d8857a3f25068391671e34dde11ff6f0c9668c8dbd449b520b9eb952"}
Aug 04 16:04:10.178245 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.178199    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mgh47" podStartSLOduration=129.249006151 podStartE2EDuration="2m15.178184115s" totalImagesPullingTime="5.929177964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:10.177287048 +0000 UTC m=+136.033759891" watchObservedRunningTime="2026-08-04 16:04:10.178184115 +0000 UTC m=+136.034656959"
Aug 04 16:04:10.310941 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.310913    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78874bbd75-8j8dt"]
Aug 04 16:04:10.344029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.344001    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78874bbd75-8j8dt"]
Aug 04 16:04:10.344145 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.344092    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.347499 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.347477    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5b0op2nonfbe9\""
Aug 04 16:04:10.347624 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.347499    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 04 16:04:10.347624 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.347521    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 04 16:04:10.347624 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.347571    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6xs6k\""
Aug 04 16:04:10.347878 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.347860    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 04 16:04:10.347878 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.347873    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 16:04:10.459454 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.459418    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/636ad6d4-461d-4690-85a2-1a91acdc5bcc-audit-log\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.459454 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.459459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/636ad6d4-461d-4690-85a2-1a91acdc5bcc-secret-metrics-server-tls\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.459665 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.459480    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636ad6d4-461d-4690-85a2-1a91acdc5bcc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.459665 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.459532    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/636ad6d4-461d-4690-85a2-1a91acdc5bcc-metrics-server-audit-profiles\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.459665 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.459605    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pcvj\" (UniqueName: \"kubernetes.io/projected/636ad6d4-461d-4690-85a2-1a91acdc5bcc-kube-api-access-9pcvj\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.459665 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.459651    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/636ad6d4-461d-4690-85a2-1a91acdc5bcc-secret-metrics-server-client-certs\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.459831 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.459690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/636ad6d4-461d-4690-85a2-1a91acdc5bcc-client-ca-bundle\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.560731 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.560666    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pcvj\" (UniqueName: \"kubernetes.io/projected/636ad6d4-461d-4690-85a2-1a91acdc5bcc-kube-api-access-9pcvj\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.560731 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.560704    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/636ad6d4-461d-4690-85a2-1a91acdc5bcc-secret-metrics-server-client-certs\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.560876 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.560733    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/636ad6d4-461d-4690-85a2-1a91acdc5bcc-client-ca-bundle\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.560919 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.560882    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/636ad6d4-461d-4690-85a2-1a91acdc5bcc-audit-log\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.560955 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.560936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/636ad6d4-461d-4690-85a2-1a91acdc5bcc-secret-metrics-server-tls\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.560992 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.560964    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636ad6d4-461d-4690-85a2-1a91acdc5bcc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.561032 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.560995    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/636ad6d4-461d-4690-85a2-1a91acdc5bcc-metrics-server-audit-profiles\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.561316 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.561289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/636ad6d4-461d-4690-85a2-1a91acdc5bcc-audit-log\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.561598 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.561579    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/636ad6d4-461d-4690-85a2-1a91acdc5bcc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.562125 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.562081    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/636ad6d4-461d-4690-85a2-1a91acdc5bcc-metrics-server-audit-profiles\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.563267 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.563247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/636ad6d4-461d-4690-85a2-1a91acdc5bcc-secret-metrics-server-client-certs\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.563371 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.563340    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/636ad6d4-461d-4690-85a2-1a91acdc5bcc-secret-metrics-server-tls\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.563468 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.563450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/636ad6d4-461d-4690-85a2-1a91acdc5bcc-client-ca-bundle\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.568945 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.568926    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pcvj\" (UniqueName: \"kubernetes.io/projected/636ad6d4-461d-4690-85a2-1a91acdc5bcc-kube-api-access-9pcvj\") pod \"metrics-server-78874bbd75-8j8dt\" (UID: \"636ad6d4-461d-4690-85a2-1a91acdc5bcc\") " pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.653498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.653472    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:10.678553 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.678526    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67bd5c5b4b-28zz4"]
Aug 04 16:04:10.681020 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.681000    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.684012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.683989    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 16:04:10.684102 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.684045    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bp8m6\""
Aug 04 16:04:10.684325 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.684306    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 16:04:10.684419 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.684335    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 16:04:10.684419 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.684350    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 16:04:10.684419 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.684366    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 16:04:10.684419 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.684314    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 16:04:10.685978 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.685963    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 16:04:10.692250 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.692231    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 16:04:10.692456 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.692419    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"]
Aug 04 16:04:10.697741 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.697720    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"
Aug 04 16:04:10.702130 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.701966    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 04 16:04:10.702212 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.702141    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5gj7s\""
Aug 04 16:04:10.702324 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.701969    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bd5c5b4b-28zz4"]
Aug 04 16:04:10.703895 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.703874    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"]
Aug 04 16:04:10.763249 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.763217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k76p6\" (UniqueName: \"kubernetes.io/projected/7124c698-aa3a-4dcc-9183-43c3d273f627-kube-api-access-k76p6\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.763387 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.763254    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6qts\" (UniqueName: \"kubernetes.io/projected/e0e4e77e-042a-4898-ab2d-6f571cc0dbd8-kube-api-access-n6qts\") pod \"monitoring-plugin-6dffbbd67-npsbr\" (UID: \"e0e4e77e-042a-4898-ab2d-6f571cc0dbd8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"
Aug 04 16:04:10.763387 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.763288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0e4e77e-042a-4898-ab2d-6f571cc0dbd8-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-npsbr\" (UID: \"e0e4e77e-042a-4898-ab2d-6f571cc0dbd8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"
Aug 04 16:04:10.763387 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.763318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-service-ca\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.763387 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.763348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-serving-cert\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.763387 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.763370    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-console-config\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.763579 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.763396    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-oauth-config\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.763579 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.763484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-trusted-ca-bundle\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.763579 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.763535    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-oauth-serving-cert\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.787201 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.787173    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78874bbd75-8j8dt"]
Aug 04 16:04:10.790119 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:04:10.790094    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636ad6d4_461d_4690_85a2_1a91acdc5bcc.slice/crio-df4855aa1067324611b4df12cd19aba5f79068c47e829cabf09a455c267115f8 WatchSource:0}: Error finding container df4855aa1067324611b4df12cd19aba5f79068c47e829cabf09a455c267115f8: Status 404 returned error can't find the container with id df4855aa1067324611b4df12cd19aba5f79068c47e829cabf09a455c267115f8
Aug 04 16:04:10.864847 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.864825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-oauth-config\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.864931 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.864855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-trusted-ca-bundle\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.864931 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.864883    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-oauth-serving-cert\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.865023 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.864936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k76p6\" (UniqueName: \"kubernetes.io/projected/7124c698-aa3a-4dcc-9183-43c3d273f627-kube-api-access-k76p6\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.865023 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.864964    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6qts\" (UniqueName: \"kubernetes.io/projected/e0e4e77e-042a-4898-ab2d-6f571cc0dbd8-kube-api-access-n6qts\") pod \"monitoring-plugin-6dffbbd67-npsbr\" (UID: \"e0e4e77e-042a-4898-ab2d-6f571cc0dbd8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"
Aug 04 16:04:10.865146 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.865114    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0e4e77e-042a-4898-ab2d-6f571cc0dbd8-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-npsbr\" (UID: \"e0e4e77e-042a-4898-ab2d-6f571cc0dbd8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"
Aug 04 16:04:10.865203 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.865173    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-service-ca\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.865257 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.865209    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-serving-cert\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.865257 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.865235    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-console-config\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.865806 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.865778    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-oauth-serving-cert\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.865806 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.865791    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-trusted-ca-bundle\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.865979 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.865858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-console-config\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.865979 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.865942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-service-ca\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.867295 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.867274    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-oauth-config\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.867482 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.867450    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-serving-cert\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.867625 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.867606    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0e4e77e-042a-4898-ab2d-6f571cc0dbd8-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-npsbr\" (UID: \"e0e4e77e-042a-4898-ab2d-6f571cc0dbd8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"
Aug 04 16:04:10.874530 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.874511    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k76p6\" (UniqueName: \"kubernetes.io/projected/7124c698-aa3a-4dcc-9183-43c3d273f627-kube-api-access-k76p6\") pod \"console-67bd5c5b4b-28zz4\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") " pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:10.874965 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.874949    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6qts\" (UniqueName: \"kubernetes.io/projected/e0e4e77e-042a-4898-ab2d-6f571cc0dbd8-kube-api-access-n6qts\") pod \"monitoring-plugin-6dffbbd67-npsbr\" (UID: \"e0e4e77e-042a-4898-ab2d-6f571cc0dbd8\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"
Aug 04 16:04:10.991249 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:10.991208    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:11.008843 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:11.008820    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"
Aug 04 16:04:11.124001 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:11.123928    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67bd5c5b4b-28zz4"]
Aug 04 16:04:11.126553 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:04:11.126522    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7124c698_aa3a_4dcc_9183_43c3d273f627.slice/crio-dbf68385aa4c145fc6f52422528ac7d80b3310a18f65beafdf007039430bf04d WatchSource:0}: Error finding container dbf68385aa4c145fc6f52422528ac7d80b3310a18f65beafdf007039430bf04d: Status 404 returned error can't find the container with id dbf68385aa4c145fc6f52422528ac7d80b3310a18f65beafdf007039430bf04d
Aug 04 16:04:11.143773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:11.143737    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"]
Aug 04 16:04:11.146354 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:11.146327    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7pvr5" event={"ID":"3ef4138b-77ec-4cd6-a141-c91c1d0549f7","Type":"ContainerStarted","Data":"959945c318d635d3b749bc884e14a8c406c071e9bde7440df31eb752069fe54c"}
Aug 04 16:04:11.146459 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:11.146379    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7pvr5" event={"ID":"3ef4138b-77ec-4cd6-a141-c91c1d0549f7","Type":"ContainerStarted","Data":"89fd817f13b061884a280680e31a9e4587162dac2a15da50bba26c675bb9a217"}
Aug 04 16:04:11.146869 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:04:11.146833    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e4e77e_042a_4898_ab2d_6f571cc0dbd8.slice/crio-989fa10501d3253faebfaf10a60eba8f8903fc0eac4e9d44a32b4f1682a0bd3c WatchSource:0}: Error finding container 989fa10501d3253faebfaf10a60eba8f8903fc0eac4e9d44a32b4f1682a0bd3c: Status 404 returned error can't find the container with id 989fa10501d3253faebfaf10a60eba8f8903fc0eac4e9d44a32b4f1682a0bd3c
Aug 04 16:04:11.147619 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:11.147603    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bd5c5b4b-28zz4" event={"ID":"7124c698-aa3a-4dcc-9183-43c3d273f627","Type":"ContainerStarted","Data":"dbf68385aa4c145fc6f52422528ac7d80b3310a18f65beafdf007039430bf04d"}
Aug 04 16:04:11.148790 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:11.148771    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt" event={"ID":"636ad6d4-461d-4690-85a2-1a91acdc5bcc","Type":"ContainerStarted","Data":"df4855aa1067324611b4df12cd19aba5f79068c47e829cabf09a455c267115f8"}
Aug 04 16:04:11.166433 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:11.166393    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7pvr5" podStartSLOduration=3.6156038759999998 podStartE2EDuration="6.166381004s" totalImagesPullingTime="2.451832713s" totalInitContainerRuntime="98.944415ms" isStatefulPod=true podCreationTimestamp="2026-08-04 16:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:11.166171848 +0000 UTC m=+137.022644707" watchObservedRunningTime="2026-08-04 16:04:11.166381004 +0000 UTC m=+137.022853846"
Aug 04 16:04:12.136632 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.136596    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 16:04:12.139637 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.139618    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.142855 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.142829    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 16:04:12.143225 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.142991    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 16:04:12.143225 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.143054    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 16:04:12.143225 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.143091    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 16:04:12.143225 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.143136    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 16:04:12.143225 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.143205    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 16:04:12.143542 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.143336    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 16:04:12.144423 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.143964    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 16:04:12.144423 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.143994    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fh79h\""
Aug 04 16:04:12.144423 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.144213    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 16:04:12.144423 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.144298    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 16:04:12.145513 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.145316    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 16:04:12.145513 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.145404    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 16:04:12.145633 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.145584    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c0f2upkacf8fj\""
Aug 04 16:04:12.149704 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.148765    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 16:04:12.150695 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.150673    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 16:04:12.153604 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.153579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr" event={"ID":"e0e4e77e-042a-4898-ab2d-6f571cc0dbd8","Type":"ContainerStarted","Data":"989fa10501d3253faebfaf10a60eba8f8903fc0eac4e9d44a32b4f1682a0bd3c"}
Aug 04 16:04:12.158262 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.157908    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 16:04:12.276062 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276236 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276236 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr8qc\" (UniqueName: \"kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-kube-api-access-nr8qc\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276236 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276236 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276200    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276493 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276493 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276292    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276493 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276334    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276647 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276647 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276726 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276788 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276725    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276841 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276790    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276841 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276931 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.276931 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.276880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.277130 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.277107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.277208 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.277147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.277265 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.277253    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.277312 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.277288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.378620 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.378572    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.378807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.378629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.378807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.378656    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.378807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.378677    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.378807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.378704    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.378807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.378730    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.378807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.378772    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.379107 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.378985    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.380195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.379716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.380195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380154    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.380379 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.380379 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.380494 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380398    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.380494 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380439    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.380591 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.380591 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380585    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.380690 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380614    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.380769 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380730    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.381966 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.381966 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr8qc\" (UniqueName: \"kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-kube-api-access-nr8qc\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.381966 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.380908    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.381966 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.381066    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.382972 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.382338    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.382972 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.382432    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.382972 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.382587    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.385453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.383271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.385453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.383624    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.385453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.384384    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.385453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.384439    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-web-config\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.385453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.384781    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.385453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.385232    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.385453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.385392    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.385828 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.385554    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.387444 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.386972    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.387616 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.387586    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.388298 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.388238    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.389861 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.389503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config-out\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.390873 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.390825    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.391739 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.391720    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.393429 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.393388    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr8qc\" (UniqueName: \"kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-kube-api-access-nr8qc\") pod \"prometheus-k8s-0\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:12.453370 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:12.453338    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:13.288073 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:13.288025    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 16:04:13.292131 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:04:13.292102    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf76da9_005c_4b7b_8ac4_f69185c962c5.slice/crio-57cfc637e49f81fcb50cc56647c380f6128b56421430a82329941f70f8278b27 WatchSource:0}: Error finding container 57cfc637e49f81fcb50cc56647c380f6128b56421430a82329941f70f8278b27: Status 404 returned error can't find the container with id 57cfc637e49f81fcb50cc56647c380f6128b56421430a82329941f70f8278b27
Aug 04 16:04:14.162437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:14.162402    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr" event={"ID":"e0e4e77e-042a-4898-ab2d-6f571cc0dbd8","Type":"ContainerStarted","Data":"b51ee69d6409b6f1f22a1797e2a1ceb830f78c05c0a974e8c7d58ed1d7c1844c"}
Aug 04 16:04:14.162695 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:14.162669    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"
Aug 04 16:04:14.164200 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:14.164169    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerStarted","Data":"57cfc637e49f81fcb50cc56647c380f6128b56421430a82329941f70f8278b27"}
Aug 04 16:04:14.165991 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:14.165959    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt" event={"ID":"636ad6d4-461d-4690-85a2-1a91acdc5bcc","Type":"ContainerStarted","Data":"86c0f4c5786abfc5b471e1e5efa2de3256af889efdf0ee783f2e90acc07842c3"}
Aug 04 16:04:14.168232 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:14.168197    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr"
Aug 04 16:04:14.181126 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:14.181082    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-npsbr" podStartSLOduration=2.194531977 podStartE2EDuration="4.181069979s" totalImagesPullingTime="1.986538002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:14.18080735 +0000 UTC m=+140.037280196" watchObservedRunningTime="2026-08-04 16:04:14.181069979 +0000 UTC m=+140.037542819"
Aug 04 16:04:14.203860 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:14.203821    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt" podStartSLOduration=1.857977666 podStartE2EDuration="4.203804614s" totalImagesPullingTime="2.345826948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:14.203516704 +0000 UTC m=+140.059989580" watchObservedRunningTime="2026-08-04 16:04:14.203804614 +0000 UTC m=+140.060277463"
Aug 04 16:04:15.170516 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:15.170475    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bd5c5b4b-28zz4" event={"ID":"7124c698-aa3a-4dcc-9183-43c3d273f627","Type":"ContainerStarted","Data":"acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa"}
Aug 04 16:04:15.172013 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:15.171985    2558 generic.go:356] "Generic (PLEG): container finished" podID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerID="2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981" exitCode=0
Aug 04 16:04:15.172102 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:15.172066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerDied","Data":"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"}
Aug 04 16:04:15.191538 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:15.191496    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67bd5c5b4b-28zz4" podStartSLOduration=1.911618962 podStartE2EDuration="5.191482363s" totalImagesPullingTime="3.279863401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:15.1911319 +0000 UTC m=+141.047604745" watchObservedRunningTime="2026-08-04 16:04:15.191482363 +0000 UTC m=+141.047955207"
Aug 04 16:04:20.192175 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:20.192138    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerStarted","Data":"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"}
Aug 04 16:04:20.192531 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:20.192226    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerStarted","Data":"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"}
Aug 04 16:04:20.991882 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:20.991845    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:20.992052 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:20.991920    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:20.997276 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:20.997249    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:21.200703 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:21.200676    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:04:22.203622 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:22.203584    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerStarted","Data":"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"}
Aug 04 16:04:22.204016 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:22.203669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerStarted","Data":"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"}
Aug 04 16:04:22.204016 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:22.203713    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerStarted","Data":"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"}
Aug 04 16:04:22.204016 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:22.203766    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerStarted","Data":"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"}
Aug 04 16:04:22.237537 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:22.237474    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.950901019 podStartE2EDuration="10.237453016s" totalImagesPullingTime="8.268357996s" totalInitContainerRuntime="18.194001ms" isStatefulPod=false podCreationTimestamp="2026-08-04 16:04:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:04:22.235514235 +0000 UTC m=+148.091987105" watchObservedRunningTime="2026-08-04 16:04:22.237453016 +0000 UTC m=+148.093925862"
Aug 04 16:04:22.454154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:22.454071    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:04:30.654114 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:30.654077    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:30.654492 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:30.654141    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:40.143123 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:40.143095    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xlt82"
Aug 04 16:04:50.660335 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:50.660235    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:04:50.664393 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:04:50.664370    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78874bbd75-8j8dt"
Aug 04 16:05:12.454425 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:12.454382    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:12.473826 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:12.473795    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:13.392180 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:13.392151    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:30.620468 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.620429    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 16:05:30.621012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.620739    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="thanos-sidecar" containerID="cri-o://d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2" gracePeriod=600
Aug 04 16:05:30.621012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.620731    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy" containerID="cri-o://0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865" gracePeriod=600
Aug 04 16:05:30.621012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.620802    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy-web" containerID="cri-o://2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139" gracePeriod=600
Aug 04 16:05:30.621012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.620729    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="prometheus" containerID="cri-o://79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a" gracePeriod=600
Aug 04 16:05:30.621012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.620834    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc" gracePeriod=600
Aug 04 16:05:30.621012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.620850    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="config-reloader" containerID="cri-o://55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618" gracePeriod=600
Aug 04 16:05:30.855654 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.855631    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:30.968286 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968215    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-web-config\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968286 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968252    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-tls-assets\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968286 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968270    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-2\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968291    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-metrics-client-ca\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968316    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968387    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-kubelet-serving-ca-bundle\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968419    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-grpc-tls\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968443    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-metrics-client-certs\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968778 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968658    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:05:30.968778 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968678    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:05:30.968778 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968718    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-serving-certs-ca-bundle\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968778 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968769    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968994 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968800    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968994 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968838    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr8qc\" (UniqueName: \"kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-kube-api-access-nr8qc\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968994 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968863    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-db\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.968994 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.968958    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-kube-rbac-proxy\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.969190 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969007    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config-out\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.969190 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969031    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-0\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.969190 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969067    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-tls\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.969190 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969097    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-thanos-prometheus-http-client-file\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.969190 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969104    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:05:30.969190 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969129    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-1\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.969190 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969139    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:05:30.969190 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969165    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-trusted-ca-bundle\") pod \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\" (UID: \"1cf76da9-005c-4b7b-8ac4-f69185c962c5\") "
Aug 04 16:05:30.969651 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969396    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:30.969651 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969415    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-metrics-client-ca\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:30.969651 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969431    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:30.969651 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969448    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:30.969867 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.969813    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:05:30.972863 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.971361    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:05:30.972863 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.971540    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:30.972863 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.972167    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:30.972863 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.972206    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:30.972863 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.972228    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:30.972863 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.972617    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:05:30.972863 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.972825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:05:30.973297 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.973054    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:30.973297 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.973097    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:05:30.973297 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.973284    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config" (OuterVolumeSpecName: "config") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:30.973480 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.973457    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:30.973541 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.973511    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:30.973996 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.973963    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-kube-api-access-nr8qc" (OuterVolumeSpecName: "kube-api-access-nr8qc") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "kube-api-access-nr8qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:05:30.974109 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.974065    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config-out" (OuterVolumeSpecName: "config-out") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:05:30.981012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:30.980990    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-web-config" (OuterVolumeSpecName: "web-config") pod "1cf76da9-005c-4b7b-8ac4-f69185c962c5" (UID: "1cf76da9-005c-4b7b-8ac4-f69185c962c5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:31.070410 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070382    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config-out\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070410 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070410    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070426    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070442    2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070455    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070469    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070481    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-web-config\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070492    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-tls-assets\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070505    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070520    2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-grpc-tls\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070534    2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-metrics-client-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070547    2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-config\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070561    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070576    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr8qc\" (UniqueName: \"kubernetes.io/projected/1cf76da9-005c-4b7b-8ac4-f69185c962c5-kube-api-access-nr8qc\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070590    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1cf76da9-005c-4b7b-8ac4-f69185c962c5-prometheus-k8s-db\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.070602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.070605    2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cf76da9-005c-4b7b-8ac4-f69185c962c5-secret-kube-rbac-proxy\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:05:31.438983 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.438951    2558 generic.go:356] "Generic (PLEG): container finished" podID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerID="0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc" exitCode=0
Aug 04 16:05:31.438983 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.438977    2558 generic.go:356] "Generic (PLEG): container finished" podID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerID="0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865" exitCode=0
Aug 04 16:05:31.438983 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.438984    2558 generic.go:356] "Generic (PLEG): container finished" podID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerID="2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139" exitCode=0
Aug 04 16:05:31.438983 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.438990    2558 generic.go:356] "Generic (PLEG): container finished" podID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerID="d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2" exitCode=0
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.438995    2558 generic.go:356] "Generic (PLEG): container finished" podID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerID="55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618" exitCode=0
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.439001    2558 generic.go:356] "Generic (PLEG): container finished" podID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerID="79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a" exitCode=0
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.439038    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerDied","Data":"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"}
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.439058    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.439134    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerDied","Data":"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"}
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.439163    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerDied","Data":"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"}
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.439189    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerDied","Data":"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"}
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.439212    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerDied","Data":"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"}
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.439234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerDied","Data":"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"}
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.439219    2558 scope.go:117] "RemoveContainer" containerID="0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"
Aug 04 16:05:31.439321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.439258    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1cf76da9-005c-4b7b-8ac4-f69185c962c5","Type":"ContainerDied","Data":"57cfc637e49f81fcb50cc56647c380f6128b56421430a82329941f70f8278b27"}
Aug 04 16:05:31.447244 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.447227    2558 scope.go:117] "RemoveContainer" containerID="0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"
Aug 04 16:05:31.453718 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.453703    2558 scope.go:117] "RemoveContainer" containerID="2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"
Aug 04 16:05:31.459561 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.459543    2558 scope.go:117] "RemoveContainer" containerID="d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"
Aug 04 16:05:31.465970 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.465949    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 16:05:31.466201 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.466186    2558 scope.go:117] "RemoveContainer" containerID="55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"
Aug 04 16:05:31.470842 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.470820    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 16:05:31.473016 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.472999    2558 scope.go:117] "RemoveContainer" containerID="79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"
Aug 04 16:05:31.479276 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.479260    2558 scope.go:117] "RemoveContainer" containerID="2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"
Aug 04 16:05:31.485411 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.485399    2558 scope.go:117] "RemoveContainer" containerID="0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"
Aug 04 16:05:31.485653 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:05:31.485634    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": container with ID starting with 0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc not found: ID does not exist" containerID="0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"
Aug 04 16:05:31.485710 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.485659    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"} err="failed to get container status \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": rpc error: code = NotFound desc = could not find container \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": container with ID starting with 0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc not found: ID does not exist"
Aug 04 16:05:31.485710 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.485685    2558 scope.go:117] "RemoveContainer" containerID="0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"
Aug 04 16:05:31.485912 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:05:31.485894    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": container with ID starting with 0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865 not found: ID does not exist" containerID="0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"
Aug 04 16:05:31.485955 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.485915    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"} err="failed to get container status \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": rpc error: code = NotFound desc = could not find container \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": container with ID starting with 0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865 not found: ID does not exist"
Aug 04 16:05:31.485955 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.485928    2558 scope.go:117] "RemoveContainer" containerID="2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"
Aug 04 16:05:31.486152 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:05:31.486136    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": container with ID starting with 2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139 not found: ID does not exist" containerID="2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"
Aug 04 16:05:31.486201 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.486155    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"} err="failed to get container status \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": rpc error: code = NotFound desc = could not find container \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": container with ID starting with 2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139 not found: ID does not exist"
Aug 04 16:05:31.486201 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.486169    2558 scope.go:117] "RemoveContainer" containerID="d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"
Aug 04 16:05:31.486392 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:05:31.486378    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": container with ID starting with d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2 not found: ID does not exist" containerID="d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"
Aug 04 16:05:31.486428 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.486395    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"} err="failed to get container status \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": rpc error: code = NotFound desc = could not find container \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": container with ID starting with d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2 not found: ID does not exist"
Aug 04 16:05:31.486428 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.486406    2558 scope.go:117] "RemoveContainer" containerID="55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"
Aug 04 16:05:31.486617 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:05:31.486602    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": container with ID starting with 55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618 not found: ID does not exist" containerID="55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"
Aug 04 16:05:31.486664 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.486619    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"} err="failed to get container status \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": rpc error: code = NotFound desc = could not find container \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": container with ID starting with 55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618 not found: ID does not exist"
Aug 04 16:05:31.486664 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.486630    2558 scope.go:117] "RemoveContainer" containerID="79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"
Aug 04 16:05:31.486874 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:05:31.486860    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": container with ID starting with 79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a not found: ID does not exist" containerID="79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"
Aug 04 16:05:31.486925 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.486876    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"} err="failed to get container status \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": rpc error: code = NotFound desc = could not find container \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": container with ID starting with 79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a not found: ID does not exist"
Aug 04 16:05:31.486925 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.486888    2558 scope.go:117] "RemoveContainer" containerID="2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"
Aug 04 16:05:31.487098 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:05:31.487081    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": container with ID starting with 2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981 not found: ID does not exist" containerID="2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"
Aug 04 16:05:31.487136 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.487104    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"} err="failed to get container status \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": rpc error: code = NotFound desc = could not find container \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": container with ID starting with 2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981 not found: ID does not exist"
Aug 04 16:05:31.487136 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.487118    2558 scope.go:117] "RemoveContainer" containerID="0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"
Aug 04 16:05:31.487343 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.487326    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"} err="failed to get container status \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": rpc error: code = NotFound desc = could not find container \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": container with ID starting with 0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc not found: ID does not exist"
Aug 04 16:05:31.487343 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.487342    2558 scope.go:117] "RemoveContainer" containerID="0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"
Aug 04 16:05:31.487526 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.487511    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"} err="failed to get container status \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": rpc error: code = NotFound desc = could not find container \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": container with ID starting with 0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865 not found: ID does not exist"
Aug 04 16:05:31.487568 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.487526    2558 scope.go:117] "RemoveContainer" containerID="2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"
Aug 04 16:05:31.487730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.487711    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"} err="failed to get container status \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": rpc error: code = NotFound desc = could not find container \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": container with ID starting with 2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139 not found: ID does not exist"
Aug 04 16:05:31.487804 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.487730    2558 scope.go:117] "RemoveContainer" containerID="d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"
Aug 04 16:05:31.487996 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.487980    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"} err="failed to get container status \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": rpc error: code = NotFound desc = could not find container \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": container with ID starting with d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2 not found: ID does not exist"
Aug 04 16:05:31.488034 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.487997    2558 scope.go:117] "RemoveContainer" containerID="55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"
Aug 04 16:05:31.488248 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.488226    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"} err="failed to get container status \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": rpc error: code = NotFound desc = could not find container \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": container with ID starting with 55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618 not found: ID does not exist"
Aug 04 16:05:31.488312 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.488280    2558 scope.go:117] "RemoveContainer" containerID="79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"
Aug 04 16:05:31.488530 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.488512    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"} err="failed to get container status \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": rpc error: code = NotFound desc = could not find container \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": container with ID starting with 79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a not found: ID does not exist"
Aug 04 16:05:31.488586 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.488530    2558 scope.go:117] "RemoveContainer" containerID="2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"
Aug 04 16:05:31.488875 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.488855    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"} err="failed to get container status \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": rpc error: code = NotFound desc = could not find container \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": container with ID starting with 2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981 not found: ID does not exist"
Aug 04 16:05:31.488875 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.488875    2558 scope.go:117] "RemoveContainer" containerID="0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"
Aug 04 16:05:31.489111 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.489094    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"} err="failed to get container status \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": rpc error: code = NotFound desc = could not find container \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": container with ID starting with 0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc not found: ID does not exist"
Aug 04 16:05:31.489157 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.489112    2558 scope.go:117] "RemoveContainer" containerID="0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"
Aug 04 16:05:31.489302 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.489285    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"} err="failed to get container status \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": rpc error: code = NotFound desc = could not find container \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": container with ID starting with 0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865 not found: ID does not exist"
Aug 04 16:05:31.489302 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.489301    2558 scope.go:117] "RemoveContainer" containerID="2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"
Aug 04 16:05:31.489483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.489461    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"} err="failed to get container status \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": rpc error: code = NotFound desc = could not find container \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": container with ID starting with 2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139 not found: ID does not exist"
Aug 04 16:05:31.489535 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.489485    2558 scope.go:117] "RemoveContainer" containerID="d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"
Aug 04 16:05:31.489686 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.489669    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"} err="failed to get container status \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": rpc error: code = NotFound desc = could not find container \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": container with ID starting with d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2 not found: ID does not exist"
Aug 04 16:05:31.489730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.489686    2558 scope.go:117] "RemoveContainer" containerID="55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"
Aug 04 16:05:31.489908 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.489892    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"} err="failed to get container status \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": rpc error: code = NotFound desc = could not find container \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": container with ID starting with 55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618 not found: ID does not exist"
Aug 04 16:05:31.489955 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.489910    2558 scope.go:117] "RemoveContainer" containerID="79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"
Aug 04 16:05:31.490104 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.490087    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"} err="failed to get container status \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": rpc error: code = NotFound desc = could not find container \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": container with ID starting with 79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a not found: ID does not exist"
Aug 04 16:05:31.490147 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.490104    2558 scope.go:117] "RemoveContainer" containerID="2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"
Aug 04 16:05:31.490279 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.490262    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"} err="failed to get container status \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": rpc error: code = NotFound desc = could not find container \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": container with ID starting with 2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981 not found: ID does not exist"
Aug 04 16:05:31.490320 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.490279    2558 scope.go:117] "RemoveContainer" containerID="0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"
Aug 04 16:05:31.490449 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.490433    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"} err="failed to get container status \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": rpc error: code = NotFound desc = could not find container \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": container with ID starting with 0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc not found: ID does not exist"
Aug 04 16:05:31.490490 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.490449    2558 scope.go:117] "RemoveContainer" containerID="0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"
Aug 04 16:05:31.490611 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.490596    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"} err="failed to get container status \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": rpc error: code = NotFound desc = could not find container \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": container with ID starting with 0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865 not found: ID does not exist"
Aug 04 16:05:31.490652 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.490611    2558 scope.go:117] "RemoveContainer" containerID="2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"
Aug 04 16:05:31.490884 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.490866    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"} err="failed to get container status \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": rpc error: code = NotFound desc = could not find container \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": container with ID starting with 2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139 not found: ID does not exist"
Aug 04 16:05:31.490884 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.490884    2558 scope.go:117] "RemoveContainer" containerID="d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"
Aug 04 16:05:31.491067 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.491049    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"} err="failed to get container status \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": rpc error: code = NotFound desc = could not find container \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": container with ID starting with d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2 not found: ID does not exist"
Aug 04 16:05:31.491105 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.491069    2558 scope.go:117] "RemoveContainer" containerID="55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"
Aug 04 16:05:31.491229 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.491213    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"} err="failed to get container status \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": rpc error: code = NotFound desc = could not find container \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": container with ID starting with 55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618 not found: ID does not exist"
Aug 04 16:05:31.491283 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.491229    2558 scope.go:117] "RemoveContainer" containerID="79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"
Aug 04 16:05:31.491471 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.491453    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"} err="failed to get container status \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": rpc error: code = NotFound desc = could not find container \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": container with ID starting with 79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a not found: ID does not exist"
Aug 04 16:05:31.491471 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.491471    2558 scope.go:117] "RemoveContainer" containerID="2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"
Aug 04 16:05:31.491684 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.491669    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"} err="failed to get container status \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": rpc error: code = NotFound desc = could not find container \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": container with ID starting with 2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981 not found: ID does not exist"
Aug 04 16:05:31.491684 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.491683    2558 scope.go:117] "RemoveContainer" containerID="0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"
Aug 04 16:05:31.491906 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.491888    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"} err="failed to get container status \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": rpc error: code = NotFound desc = could not find container \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": container with ID starting with 0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc not found: ID does not exist"
Aug 04 16:05:31.491954 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.491906    2558 scope.go:117] "RemoveContainer" containerID="0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"
Aug 04 16:05:31.492098 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.492083    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"} err="failed to get container status \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": rpc error: code = NotFound desc = could not find container \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": container with ID starting with 0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865 not found: ID does not exist"
Aug 04 16:05:31.492138 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.492098    2558 scope.go:117] "RemoveContainer" containerID="2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"
Aug 04 16:05:31.492282 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.492266    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"} err="failed to get container status \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": rpc error: code = NotFound desc = could not find container \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": container with ID starting with 2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139 not found: ID does not exist"
Aug 04 16:05:31.492325 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.492283    2558 scope.go:117] "RemoveContainer" containerID="d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"
Aug 04 16:05:31.492455 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.492438    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"} err="failed to get container status \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": rpc error: code = NotFound desc = could not find container \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": container with ID starting with d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2 not found: ID does not exist"
Aug 04 16:05:31.492455 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.492454    2558 scope.go:117] "RemoveContainer" containerID="55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"
Aug 04 16:05:31.492657 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.492639    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"} err="failed to get container status \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": rpc error: code = NotFound desc = could not find container \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": container with ID starting with 55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618 not found: ID does not exist"
Aug 04 16:05:31.492698 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.492658    2558 scope.go:117] "RemoveContainer" containerID="79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"
Aug 04 16:05:31.492871 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.492856    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"} err="failed to get container status \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": rpc error: code = NotFound desc = could not find container \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": container with ID starting with 79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a not found: ID does not exist"
Aug 04 16:05:31.492923 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.492871    2558 scope.go:117] "RemoveContainer" containerID="2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"
Aug 04 16:05:31.493090 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.493072    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"} err="failed to get container status \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": rpc error: code = NotFound desc = could not find container \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": container with ID starting with 2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981 not found: ID does not exist"
Aug 04 16:05:31.493138 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.493090    2558 scope.go:117] "RemoveContainer" containerID="0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"
Aug 04 16:05:31.493315 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.493299    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc"} err="failed to get container status \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": rpc error: code = NotFound desc = could not find container \"0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc\": container with ID starting with 0977f1d06c86e721f4ef104ce5946c71a8bc121a80545810098e9242f824c9cc not found: ID does not exist"
Aug 04 16:05:31.493356 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.493316    2558 scope.go:117] "RemoveContainer" containerID="0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"
Aug 04 16:05:31.493495 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.493480    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865"} err="failed to get container status \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": rpc error: code = NotFound desc = could not find container \"0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865\": container with ID starting with 0d13a01b50ce19a9af1451ff32fe69ab8782ae0fd7be69381cfc7029d72e0865 not found: ID does not exist"
Aug 04 16:05:31.493533 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.493495    2558 scope.go:117] "RemoveContainer" containerID="2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"
Aug 04 16:05:31.493681 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.493660    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139"} err="failed to get container status \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": rpc error: code = NotFound desc = could not find container \"2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139\": container with ID starting with 2010dbef4bfa08e550708f5ee887b54192d796426b43e69bcdf4583f723da139 not found: ID does not exist"
Aug 04 16:05:31.493718 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.493682    2558 scope.go:117] "RemoveContainer" containerID="d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"
Aug 04 16:05:31.493889 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.493868    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2"} err="failed to get container status \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": rpc error: code = NotFound desc = could not find container \"d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2\": container with ID starting with d3e4ccab7e395c0cc54130b37bc4881e3a574e6d9f400641c4b90e5d414cd7d2 not found: ID does not exist"
Aug 04 16:05:31.493938 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.493890    2558 scope.go:117] "RemoveContainer" containerID="55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"
Aug 04 16:05:31.494101 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.494085    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618"} err="failed to get container status \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": rpc error: code = NotFound desc = could not find container \"55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618\": container with ID starting with 55e2559905f5926382eee180a7470c5bfe81f352d37a982064501a6ce924f618 not found: ID does not exist"
Aug 04 16:05:31.494101 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.494100    2558 scope.go:117] "RemoveContainer" containerID="79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"
Aug 04 16:05:31.494333 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.494315    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a"} err="failed to get container status \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": rpc error: code = NotFound desc = could not find container \"79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a\": container with ID starting with 79e8aaa1de936bb872553c5735c7543c824c62a3c3a032ad6a182a9cc446205a not found: ID does not exist"
Aug 04 16:05:31.494374 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.494333    2558 scope.go:117] "RemoveContainer" containerID="2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"
Aug 04 16:05:31.494523 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.494505    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981"} err="failed to get container status \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": rpc error: code = NotFound desc = could not find container \"2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981\": container with ID starting with 2289e4dd79e8a42395c13a7ac917643316b44a4c8713e33af3d96ecf8552c981 not found: ID does not exist"
Aug 04 16:05:31.496989 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.496970    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 16:05:31.497212 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497198    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="init-config-reloader"
Aug 04 16:05:31.497212 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497213    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="init-config-reloader"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497220    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="thanos-sidecar"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497226    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="thanos-sidecar"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497233    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy-web"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497238    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy-web"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497245    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497250    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497255    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy-thanos"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497260    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy-thanos"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497268    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="prometheus"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497273    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="prometheus"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497278    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="config-reloader"
Aug 04 16:05:31.497288 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497282    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="config-reloader"
Aug 04 16:05:31.497650 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497327    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="config-reloader"
Aug 04 16:05:31.497650 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497335    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="thanos-sidecar"
Aug 04 16:05:31.497650 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497340    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy-web"
Aug 04 16:05:31.497650 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497345    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy"
Aug 04 16:05:31.497650 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497350    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="prometheus"
Aug 04 16:05:31.497650 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.497356    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" containerName="kube-rbac-proxy-thanos"
Aug 04 16:05:31.500621 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.500608    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.504823 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.504593    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 16:05:31.504823 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.504649    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 16:05:31.504823 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.504653    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 16:05:31.504823 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.504685    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 16:05:31.504823 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.504711    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 16:05:31.504823 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.504685    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 16:05:31.505165 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.504973    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 16:05:31.505165 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.504989    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 16:05:31.505165 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.504998    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 16:05:31.505286 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.505194    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c0f2upkacf8fj\""
Aug 04 16:05:31.505286 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.505198    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 16:05:31.505395 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.505295    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fh79h\""
Aug 04 16:05:31.505395 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.505387    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 16:05:31.505516 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.505500    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 16:05:31.507777 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.507759    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 16:05:31.512071 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.512042    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 16:05:31.528304 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.528284    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 16:05:31.573572 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573543    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.573572 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.573773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.573773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573610    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.573773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.573773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573649    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.573773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.573773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573685    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.573773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2691e708-a784-4d82-b0c6-a88b8e1be401-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.573773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573719    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.573773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573737    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.574121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573799    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2691e708-a784-4d82-b0c6-a88b8e1be401-config-out\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.574121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573845    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.574121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.574121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg4fs\" (UniqueName: \"kubernetes.io/projected/2691e708-a784-4d82-b0c6-a88b8e1be401-kube-api-access-sg4fs\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.574121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573905    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.574121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573921    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.574121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-config\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.574121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.573986    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.574121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.574040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-web-config\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.674887 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.674852    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.674891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg4fs\" (UniqueName: \"kubernetes.io/projected/2691e708-a784-4d82-b0c6-a88b8e1be401-kube-api-access-sg4fs\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.674974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675001    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675022    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-config\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675042    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675061    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-web-config\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675103    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675169    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675264 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675283    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675312    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675339    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675362    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2691e708-a784-4d82-b0c6-a88b8e1be401-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2691e708-a784-4d82-b0c6-a88b8e1be401-config-out\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675557    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675673    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.675827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.675740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.676365 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.676187    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.676365 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.676239    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.677024 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.676995    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.678287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.678088    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-config\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.678287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.678147    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-web-config\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.678287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.678254    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2691e708-a784-4d82-b0c6-a88b8e1be401-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.678968 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.678886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.678968 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.678958    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.679244 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.679163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.679509 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.679484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2691e708-a784-4d82-b0c6-a88b8e1be401-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.679642 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.679620    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.679716 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.679636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.680654 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.680634    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.680912 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.680898    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2691e708-a784-4d82-b0c6-a88b8e1be401-config-out\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.680981 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.680956    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.681598 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.681576    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2691e708-a784-4d82-b0c6-a88b8e1be401-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.685331 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.685311    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg4fs\" (UniqueName: \"kubernetes.io/projected/2691e708-a784-4d82-b0c6-a88b8e1be401-kube-api-access-sg4fs\") pod \"prometheus-k8s-0\" (UID: \"2691e708-a784-4d82-b0c6-a88b8e1be401\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.809883 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.809809    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:31.947321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:31.947296    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 16:05:31.948959 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:05:31.948935    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2691e708_a784_4d82_b0c6_a88b8e1be401.slice/crio-76216785702adfbfbe45b73c56a318d0ec6a55fd4ed1063bc7c9b09a20aeff8d WatchSource:0}: Error finding container 76216785702adfbfbe45b73c56a318d0ec6a55fd4ed1063bc7c9b09a20aeff8d: Status 404 returned error can't find the container with id 76216785702adfbfbe45b73c56a318d0ec6a55fd4ed1063bc7c9b09a20aeff8d
Aug 04 16:05:32.444816 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:32.444785    2558 generic.go:356] "Generic (PLEG): container finished" podID="2691e708-a784-4d82-b0c6-a88b8e1be401" containerID="069792bfade4369db2e0bfb8c1c98a0c43d33a68c38f5b0ad5fab52a68c1becd" exitCode=0
Aug 04 16:05:32.444985 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:32.444879    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2691e708-a784-4d82-b0c6-a88b8e1be401","Type":"ContainerDied","Data":"069792bfade4369db2e0bfb8c1c98a0c43d33a68c38f5b0ad5fab52a68c1becd"}
Aug 04 16:05:32.444985 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:32.444956    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2691e708-a784-4d82-b0c6-a88b8e1be401","Type":"ContainerStarted","Data":"76216785702adfbfbe45b73c56a318d0ec6a55fd4ed1063bc7c9b09a20aeff8d"}
Aug 04 16:05:32.692513 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:32.692483    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cf76da9-005c-4b7b-8ac4-f69185c962c5" path="/var/lib/kubelet/pods/1cf76da9-005c-4b7b-8ac4-f69185c962c5/volumes"
Aug 04 16:05:33.453525 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.453491    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2691e708-a784-4d82-b0c6-a88b8e1be401","Type":"ContainerStarted","Data":"92f32e6f662631c0ae154e4be082261641faa068d4e2ef0dc52ba27928336af0"}
Aug 04 16:05:33.453690 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.453554    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2691e708-a784-4d82-b0c6-a88b8e1be401","Type":"ContainerStarted","Data":"765e13904d563d9690e7aea26f8ae22695d659c1d577a2b98f64674325f9e261"}
Aug 04 16:05:33.453690 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.453580    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2691e708-a784-4d82-b0c6-a88b8e1be401","Type":"ContainerStarted","Data":"082eabaa15bef78b8bfff51a7cbfb132acbb9b79465143ae396b07b8515872db"}
Aug 04 16:05:33.453690 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.453611    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2691e708-a784-4d82-b0c6-a88b8e1be401","Type":"ContainerStarted","Data":"c07a6e7b8b0103b05e2e76d7a974edff86eb59e63b855e4e8bcbfe370627f2c4"}
Aug 04 16:05:33.453690 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.453637    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2691e708-a784-4d82-b0c6-a88b8e1be401","Type":"ContainerStarted","Data":"5ff3e38241c2bec77cc3ab4a9a40fa77874e1899eb14d511a707238305422f88"}
Aug 04 16:05:33.453690 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.453661    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2691e708-a784-4d82-b0c6-a88b8e1be401","Type":"ContainerStarted","Data":"6d421fef85c432afeeb5209b6ae300cdc054ba810a1b15c72cf95e6047465393"}
Aug 04 16:05:33.493862 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.493809    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.471041608 podStartE2EDuration="2.493792916s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.751308ms" isStatefulPod=false podCreationTimestamp="2026-08-04 16:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:05:33.490938893 +0000 UTC m=+219.347411741" watchObservedRunningTime="2026-08-04 16:05:33.493792916 +0000 UTC m=+219.350265760"
Aug 04 16:05:33.626836 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.626806    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-845b79cfd8-hzhtz"]
Aug 04 16:05:33.628945 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.628929    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.650549 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.650527    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845b79cfd8-hzhtz"]
Aug 04 16:05:33.792724 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.792629    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-oauth-serving-cert\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.792724 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.792677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd9zc\" (UniqueName: \"kubernetes.io/projected/3a57b6f2-5410-4971-b0f9-fb9828b88303-kube-api-access-wd9zc\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.792724 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.792704    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-service-ca\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.793178 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.792774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-config\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.793178 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.792798    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-oauth-config\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.793178 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.792818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-serving-cert\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.793178 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.792852    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-trusted-ca-bundle\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.894283 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.894256    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd9zc\" (UniqueName: \"kubernetes.io/projected/3a57b6f2-5410-4971-b0f9-fb9828b88303-kube-api-access-wd9zc\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.894437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.894290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-service-ca\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.894437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.894318    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-config\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.894437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.894342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-oauth-config\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.894437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.894365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-serving-cert\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.894437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.894395    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-trusted-ca-bundle\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.894619 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.894437    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-oauth-serving-cert\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.895238 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.895203    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-oauth-serving-cert\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.895363 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.895243    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-service-ca\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.895363 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.895265    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-config\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.895363 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.895326    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-trusted-ca-bundle\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.896951 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.896928    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-oauth-config\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.897043 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.896931    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-serving-cert\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.904198 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.904172    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd9zc\" (UniqueName: \"kubernetes.io/projected/3a57b6f2-5410-4971-b0f9-fb9828b88303-kube-api-access-wd9zc\") pod \"console-845b79cfd8-hzhtz\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") " pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:33.937223 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:33.937192    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:34.064543 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:34.064516    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-845b79cfd8-hzhtz"]
Aug 04 16:05:34.066903 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:05:34.066876    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a57b6f2_5410_4971_b0f9_fb9828b88303.slice/crio-e89561bcb386dcf9e55202bbe1ff5200bf9a163b539d0ba5e0f8c8e14a6e786b WatchSource:0}: Error finding container e89561bcb386dcf9e55202bbe1ff5200bf9a163b539d0ba5e0f8c8e14a6e786b: Status 404 returned error can't find the container with id e89561bcb386dcf9e55202bbe1ff5200bf9a163b539d0ba5e0f8c8e14a6e786b
Aug 04 16:05:34.458998 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:34.458965    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b79cfd8-hzhtz" event={"ID":"3a57b6f2-5410-4971-b0f9-fb9828b88303","Type":"ContainerStarted","Data":"fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf"}
Aug 04 16:05:34.459170 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:34.459018    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b79cfd8-hzhtz" event={"ID":"3a57b6f2-5410-4971-b0f9-fb9828b88303","Type":"ContainerStarted","Data":"e89561bcb386dcf9e55202bbe1ff5200bf9a163b539d0ba5e0f8c8e14a6e786b"}
Aug 04 16:05:34.489857 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:34.489794    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-845b79cfd8-hzhtz" podStartSLOduration=1.4897808559999999 podStartE2EDuration="1.489780856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:05:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:05:34.488085018 +0000 UTC m=+220.344557863" watchObservedRunningTime="2026-08-04 16:05:34.489780856 +0000 UTC m=+220.346253700"
Aug 04 16:05:36.810037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:36.810000    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:05:43.938099 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:43.938060    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:43.938459 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:43.938131    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:43.942872 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:43.942850    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:44.502969 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:44.502939    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:05:44.551662 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:05:44.551634    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bd5c5b4b-28zz4"]
Aug 04 16:06:09.570207 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.570151    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67bd5c5b4b-28zz4" podUID="7124c698-aa3a-4dcc-9183-43c3d273f627" containerName="console" containerID="cri-o://acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa" gracePeriod=15
Aug 04 16:06:09.806609 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.806585    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:06:09.866088 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866065    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-trusted-ca-bundle\") pod \"7124c698-aa3a-4dcc-9183-43c3d273f627\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") "
Aug 04 16:06:09.866214 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866116    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-console-config\") pod \"7124c698-aa3a-4dcc-9183-43c3d273f627\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") "
Aug 04 16:06:09.866214 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866145    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-service-ca\") pod \"7124c698-aa3a-4dcc-9183-43c3d273f627\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") "
Aug 04 16:06:09.866214 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866168    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-serving-cert\") pod \"7124c698-aa3a-4dcc-9183-43c3d273f627\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") "
Aug 04 16:06:09.866214 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866194    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k76p6\" (UniqueName: \"kubernetes.io/projected/7124c698-aa3a-4dcc-9183-43c3d273f627-kube-api-access-k76p6\") pod \"7124c698-aa3a-4dcc-9183-43c3d273f627\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") "
Aug 04 16:06:09.866412 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866232    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-oauth-serving-cert\") pod \"7124c698-aa3a-4dcc-9183-43c3d273f627\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") "
Aug 04 16:06:09.866412 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866274    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-oauth-config\") pod \"7124c698-aa3a-4dcc-9183-43c3d273f627\" (UID: \"7124c698-aa3a-4dcc-9183-43c3d273f627\") "
Aug 04 16:06:09.866568 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866541    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7124c698-aa3a-4dcc-9183-43c3d273f627" (UID: "7124c698-aa3a-4dcc-9183-43c3d273f627"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:06:09.866636 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866568    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-console-config" (OuterVolumeSpecName: "console-config") pod "7124c698-aa3a-4dcc-9183-43c3d273f627" (UID: "7124c698-aa3a-4dcc-9183-43c3d273f627"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:06:09.866636 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866577    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-service-ca" (OuterVolumeSpecName: "service-ca") pod "7124c698-aa3a-4dcc-9183-43c3d273f627" (UID: "7124c698-aa3a-4dcc-9183-43c3d273f627"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:06:09.866791 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.866641    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7124c698-aa3a-4dcc-9183-43c3d273f627" (UID: "7124c698-aa3a-4dcc-9183-43c3d273f627"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:06:09.868510 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.868488    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7124c698-aa3a-4dcc-9183-43c3d273f627-kube-api-access-k76p6" (OuterVolumeSpecName: "kube-api-access-k76p6") pod "7124c698-aa3a-4dcc-9183-43c3d273f627" (UID: "7124c698-aa3a-4dcc-9183-43c3d273f627"). InnerVolumeSpecName "kube-api-access-k76p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:06:09.868577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.868518    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7124c698-aa3a-4dcc-9183-43c3d273f627" (UID: "7124c698-aa3a-4dcc-9183-43c3d273f627"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:06:09.868577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.868562    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7124c698-aa3a-4dcc-9183-43c3d273f627" (UID: "7124c698-aa3a-4dcc-9183-43c3d273f627"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:06:09.966791 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.966763    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-oauth-config\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:06:09.966791 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.966789    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-trusted-ca-bundle\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:06:09.966950 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.966802    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-console-config\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:06:09.966950 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.966814    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-service-ca\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:06:09.966950 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.966825    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7124c698-aa3a-4dcc-9183-43c3d273f627-console-serving-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:06:09.966950 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.966835    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k76p6\" (UniqueName: \"kubernetes.io/projected/7124c698-aa3a-4dcc-9183-43c3d273f627-kube-api-access-k76p6\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:06:09.966950 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:09.966849    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7124c698-aa3a-4dcc-9183-43c3d273f627-oauth-serving-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:06:10.588716 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:10.588685    2558 generic.go:356] "Generic (PLEG): container finished" podID="7124c698-aa3a-4dcc-9183-43c3d273f627" containerID="acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa" exitCode=0
Aug 04 16:06:10.589141 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:10.588734    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67bd5c5b4b-28zz4"
Aug 04 16:06:10.589141 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:10.588775    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bd5c5b4b-28zz4" event={"ID":"7124c698-aa3a-4dcc-9183-43c3d273f627","Type":"ContainerDied","Data":"acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa"}
Aug 04 16:06:10.589141 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:10.588822    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67bd5c5b4b-28zz4" event={"ID":"7124c698-aa3a-4dcc-9183-43c3d273f627","Type":"ContainerDied","Data":"dbf68385aa4c145fc6f52422528ac7d80b3310a18f65beafdf007039430bf04d"}
Aug 04 16:06:10.589141 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:10.588844    2558 scope.go:117] "RemoveContainer" containerID="acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa"
Aug 04 16:06:10.596876 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:10.596859    2558 scope.go:117] "RemoveContainer" containerID="acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa"
Aug 04 16:06:10.597146 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:06:10.597125    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa\": container with ID starting with acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa not found: ID does not exist" containerID="acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa"
Aug 04 16:06:10.597206 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:10.597154    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa"} err="failed to get container status \"acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa\": rpc error: code = NotFound desc = could not find container \"acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa\": container with ID starting with acdef32f8e05a48eb1e2927531ac9a9132e74a74cd61049020102f978686c3fa not found: ID does not exist"
Aug 04 16:06:10.610004 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:10.609977    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67bd5c5b4b-28zz4"]
Aug 04 16:06:10.614335 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:10.614316    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67bd5c5b4b-28zz4"]
Aug 04 16:06:10.695619 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:10.695589    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7124c698-aa3a-4dcc-9183-43c3d273f627" path="/var/lib/kubelet/pods/7124c698-aa3a-4dcc-9183-43c3d273f627/volumes"
Aug 04 16:06:31.810213 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:31.810128    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:06:31.824548 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:31.824523    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:06:32.679366 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:32.679338    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 16:06:44.660879 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.660850    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5987488f45-rg5x9"]
Aug 04 16:06:44.661361 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.661090    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7124c698-aa3a-4dcc-9183-43c3d273f627" containerName="console"
Aug 04 16:06:44.661361 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.661100    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7124c698-aa3a-4dcc-9183-43c3d273f627" containerName="console"
Aug 04 16:06:44.661361 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.661149    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7124c698-aa3a-4dcc-9183-43c3d273f627" containerName="console"
Aug 04 16:06:44.663572 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.663557    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.677741 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.677720    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5987488f45-rg5x9"]
Aug 04 16:06:44.709949 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.709924    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-serving-cert\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.710070 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.709957    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbf7z\" (UniqueName: \"kubernetes.io/projected/a3678aee-85cd-4145-a53b-8a7f497edd10-kube-api-access-gbf7z\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.710070 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.709979    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-oauth-serving-cert\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.710070 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.710033    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-console-config\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.710174 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.710093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-service-ca\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.710174 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.710128    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-oauth-config\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.710174 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.710153    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-trusted-ca-bundle\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.811379 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.811354    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-trusted-ca-bundle\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.811500 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.811383    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-serving-cert\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.811500 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.811405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbf7z\" (UniqueName: \"kubernetes.io/projected/a3678aee-85cd-4145-a53b-8a7f497edd10-kube-api-access-gbf7z\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.811600 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.811515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-oauth-serving-cert\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.811600 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.811559    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-console-config\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.811701 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.811605    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-service-ca\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.811781 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.811739    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-oauth-config\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.812286 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.812264    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-console-config\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.812389 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.812297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-oauth-serving-cert\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.812389 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.812326    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-service-ca\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.812389 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.812361    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-trusted-ca-bundle\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.813832 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.813811    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-serving-cert\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.814039 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.814022    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-oauth-config\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.824012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.823990    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbf7z\" (UniqueName: \"kubernetes.io/projected/a3678aee-85cd-4145-a53b-8a7f497edd10-kube-api-access-gbf7z\") pod \"console-5987488f45-rg5x9\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") " pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:44.973034 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:44.972948    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:45.100668 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:45.100645    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5987488f45-rg5x9"]
Aug 04 16:06:45.103048 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:06:45.103021    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3678aee_85cd_4145_a53b_8a7f497edd10.slice/crio-b1f0f3ff837717bdd4e70832ed6e688823dfe5aad436ad61c75f3928ae8ee91f WatchSource:0}: Error finding container b1f0f3ff837717bdd4e70832ed6e688823dfe5aad436ad61c75f3928ae8ee91f: Status 404 returned error can't find the container with id b1f0f3ff837717bdd4e70832ed6e688823dfe5aad436ad61c75f3928ae8ee91f
Aug 04 16:06:45.709488 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:45.709449    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5987488f45-rg5x9" event={"ID":"a3678aee-85cd-4145-a53b-8a7f497edd10","Type":"ContainerStarted","Data":"f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01"}
Aug 04 16:06:45.709884 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:45.709532    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5987488f45-rg5x9" event={"ID":"a3678aee-85cd-4145-a53b-8a7f497edd10","Type":"ContainerStarted","Data":"b1f0f3ff837717bdd4e70832ed6e688823dfe5aad436ad61c75f3928ae8ee91f"}
Aug 04 16:06:45.731995 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:45.731943    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5987488f45-rg5x9" podStartSLOduration=1.731907477 podStartE2EDuration="1.731907477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:06:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:06:45.730573292 +0000 UTC m=+291.587046134" watchObservedRunningTime="2026-08-04 16:06:45.731907477 +0000 UTC m=+291.588380320"
Aug 04 16:06:54.519478 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:54.519450    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:06:54.520873 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:54.520851    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:06:54.526999 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:54.526979    2558 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 16:06:54.973384 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:54.973351    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:54.975509 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:54.973428    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:54.978133 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:54.978118    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:55.749155 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:55.749129    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:06:55.799091 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:06:55.799061    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-845b79cfd8-hzhtz"]
Aug 04 16:07:20.817781 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:20.817711    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-845b79cfd8-hzhtz" podUID="3a57b6f2-5410-4971-b0f9-fb9828b88303" containerName="console" containerID="cri-o://fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf" gracePeriod=15
Aug 04 16:07:21.049447 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.049425    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:07:21.201476 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.201444    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-service-ca\") pod \"3a57b6f2-5410-4971-b0f9-fb9828b88303\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") "
Aug 04 16:07:21.201633 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.201491    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-oauth-serving-cert\") pod \"3a57b6f2-5410-4971-b0f9-fb9828b88303\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") "
Aug 04 16:07:21.201633 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.201523    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd9zc\" (UniqueName: \"kubernetes.io/projected/3a57b6f2-5410-4971-b0f9-fb9828b88303-kube-api-access-wd9zc\") pod \"3a57b6f2-5410-4971-b0f9-fb9828b88303\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") "
Aug 04 16:07:21.201724 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.201624    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-oauth-config\") pod \"3a57b6f2-5410-4971-b0f9-fb9828b88303\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") "
Aug 04 16:07:21.201724 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.201671    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-config\") pod \"3a57b6f2-5410-4971-b0f9-fb9828b88303\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") "
Aug 04 16:07:21.201853 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.201817    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-trusted-ca-bundle\") pod \"3a57b6f2-5410-4971-b0f9-fb9828b88303\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") "
Aug 04 16:07:21.201911 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.201896    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-serving-cert\") pod \"3a57b6f2-5410-4971-b0f9-fb9828b88303\" (UID: \"3a57b6f2-5410-4971-b0f9-fb9828b88303\") "
Aug 04 16:07:21.202037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.201981    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-service-ca" (OuterVolumeSpecName: "service-ca") pod "3a57b6f2-5410-4971-b0f9-fb9828b88303" (UID: "3a57b6f2-5410-4971-b0f9-fb9828b88303"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:07:21.202037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.201992    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3a57b6f2-5410-4971-b0f9-fb9828b88303" (UID: "3a57b6f2-5410-4971-b0f9-fb9828b88303"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:07:21.202216 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.202123    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-service-ca\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:07:21.202216 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.202137    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-oauth-serving-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:07:21.202216 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.202117    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-config" (OuterVolumeSpecName: "console-config") pod "3a57b6f2-5410-4971-b0f9-fb9828b88303" (UID: "3a57b6f2-5410-4971-b0f9-fb9828b88303"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:07:21.202216 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.202177    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3a57b6f2-5410-4971-b0f9-fb9828b88303" (UID: "3a57b6f2-5410-4971-b0f9-fb9828b88303"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:07:21.203613 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.203590    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3a57b6f2-5410-4971-b0f9-fb9828b88303" (UID: "3a57b6f2-5410-4971-b0f9-fb9828b88303"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:07:21.203697 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.203666    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a57b6f2-5410-4971-b0f9-fb9828b88303-kube-api-access-wd9zc" (OuterVolumeSpecName: "kube-api-access-wd9zc") pod "3a57b6f2-5410-4971-b0f9-fb9828b88303" (UID: "3a57b6f2-5410-4971-b0f9-fb9828b88303"). InnerVolumeSpecName "kube-api-access-wd9zc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:07:21.204208 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.204182    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3a57b6f2-5410-4971-b0f9-fb9828b88303" (UID: "3a57b6f2-5410-4971-b0f9-fb9828b88303"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:07:21.302540 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.302516    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-config\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:07:21.302540 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.302538    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a57b6f2-5410-4971-b0f9-fb9828b88303-trusted-ca-bundle\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:07:21.302673 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.302548    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-serving-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:07:21.302673 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.302557    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd9zc\" (UniqueName: \"kubernetes.io/projected/3a57b6f2-5410-4971-b0f9-fb9828b88303-kube-api-access-wd9zc\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:07:21.302673 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.302567    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a57b6f2-5410-4971-b0f9-fb9828b88303-console-oauth-config\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:07:21.835650 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.835617    2558 generic.go:356] "Generic (PLEG): container finished" podID="3a57b6f2-5410-4971-b0f9-fb9828b88303" containerID="fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf" exitCode=0
Aug 04 16:07:21.836013 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.835666    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-845b79cfd8-hzhtz"
Aug 04 16:07:21.836013 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.835665    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b79cfd8-hzhtz" event={"ID":"3a57b6f2-5410-4971-b0f9-fb9828b88303","Type":"ContainerDied","Data":"fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf"}
Aug 04 16:07:21.836013 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.835800    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-845b79cfd8-hzhtz" event={"ID":"3a57b6f2-5410-4971-b0f9-fb9828b88303","Type":"ContainerDied","Data":"e89561bcb386dcf9e55202bbe1ff5200bf9a163b539d0ba5e0f8c8e14a6e786b"}
Aug 04 16:07:21.836013 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.835832    2558 scope.go:117] "RemoveContainer" containerID="fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf"
Aug 04 16:07:21.844591 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.844544    2558 scope.go:117] "RemoveContainer" containerID="fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf"
Aug 04 16:07:21.844940 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:07:21.844919    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf\": container with ID starting with fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf not found: ID does not exist" containerID="fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf"
Aug 04 16:07:21.845031 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.844945    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf"} err="failed to get container status \"fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf\": rpc error: code = NotFound desc = could not find container \"fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf\": container with ID starting with fa69c9dc492c5cc58e00d9522aeb5024bfd96f098cad5d4ffd5228bc28ef61cf not found: ID does not exist"
Aug 04 16:07:21.858586 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.858566    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-845b79cfd8-hzhtz"]
Aug 04 16:07:21.862855 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:21.862833    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-845b79cfd8-hzhtz"]
Aug 04 16:07:22.691567 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:07:22.691537    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a57b6f2-5410-4971-b0f9-fb9828b88303" path="/var/lib/kubelet/pods/3a57b6f2-5410-4971-b0f9-fb9828b88303/volumes"
Aug 04 16:08:08.180313 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.180282    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-849df987-54qf5"]
Aug 04 16:08:08.180713 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.180547    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a57b6f2-5410-4971-b0f9-fb9828b88303" containerName="console"
Aug 04 16:08:08.180713 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.180582    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a57b6f2-5410-4971-b0f9-fb9828b88303" containerName="console"
Aug 04 16:08:08.180713 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.180632    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a57b6f2-5410-4971-b0f9-fb9828b88303" containerName="console"
Aug 04 16:08:08.184515 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.184500    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.223059 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.223034    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849df987-54qf5"]
Aug 04 16:08:08.234215 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.234189    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-oauth-serving-cert\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.234330 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.234229    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-service-ca\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.234330 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.234293    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl6cf\" (UniqueName: \"kubernetes.io/projected/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-kube-api-access-dl6cf\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.234413 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.234338    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-console-oauth-config\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.234413 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.234361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-console-serving-cert\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.234413 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.234404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-trusted-ca-bundle\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.234511 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.234437    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-console-config\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.335782 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.335741    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-oauth-serving-cert\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.335905 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.335785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-service-ca\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.335905 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.335807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl6cf\" (UniqueName: \"kubernetes.io/projected/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-kube-api-access-dl6cf\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.335905 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.335846    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-console-oauth-config\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.335905 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.335873    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-console-serving-cert\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.336100 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.335915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-trusted-ca-bundle\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.336100 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.336012    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-console-config\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.336547 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.336523    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-service-ca\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.336651 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.336571    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-oauth-serving-cert\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.336651 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.336647    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-console-config\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.336983 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.336956    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-trusted-ca-bundle\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.338291 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.338262    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-console-serving-cert\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.338375 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.338364    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-console-oauth-config\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.346623 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.346605    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl6cf\" (UniqueName: \"kubernetes.io/projected/1ae48a28-2eaa-4e01-9eb7-3360bea2688a-kube-api-access-dl6cf\") pod \"console-849df987-54qf5\" (UID: \"1ae48a28-2eaa-4e01-9eb7-3360bea2688a\") " pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.493045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.492997    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:08.648771 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.648729    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-849df987-54qf5"]
Aug 04 16:08:08.651647 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:08:08.651624    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae48a28_2eaa_4e01_9eb7_3360bea2688a.slice/crio-3d32b92dd2ed2fa3ebae0757af57edebccdae46953cc9e8275052654d027ec96 WatchSource:0}: Error finding container 3d32b92dd2ed2fa3ebae0757af57edebccdae46953cc9e8275052654d027ec96: Status 404 returned error can't find the container with id 3d32b92dd2ed2fa3ebae0757af57edebccdae46953cc9e8275052654d027ec96
Aug 04 16:08:08.996617 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.996581    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849df987-54qf5" event={"ID":"1ae48a28-2eaa-4e01-9eb7-3360bea2688a","Type":"ContainerStarted","Data":"54c4167b01621cc3c4fba228f1962ff24e21d2d4bd1b0b41f3b988bc8f3a5514"}
Aug 04 16:08:08.996800 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:08.996638    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-849df987-54qf5" event={"ID":"1ae48a28-2eaa-4e01-9eb7-3360bea2688a","Type":"ContainerStarted","Data":"3d32b92dd2ed2fa3ebae0757af57edebccdae46953cc9e8275052654d027ec96"}
Aug 04 16:08:09.060215 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:09.060158    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-849df987-54qf5" podStartSLOduration=1.060137723 podStartE2EDuration="1.060137723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:09.057739181 +0000 UTC m=+374.914212025" watchObservedRunningTime="2026-08-04 16:08:09.060137723 +0000 UTC m=+374.916610567"
Aug 04 16:08:18.493096 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:18.493065    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:18.493529 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:18.493116    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:18.497778 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:18.497730    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:19.035150 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:19.035119    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-849df987-54qf5"
Aug 04 16:08:19.098324 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:19.098296    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5987488f45-rg5x9"]
Aug 04 16:08:43.307569 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.307537    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"]
Aug 04 16:08:43.310930 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.310914    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.314498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.314474    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 16:08:43.314498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.314497    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 16:08:43.314900 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.314883    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 16:08:43.314989 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.314970    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m5dcn\""
Aug 04 16:08:43.315220 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.315204    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 16:08:43.329254 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.329234    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"]
Aug 04 16:08:43.492421 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.492383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsw2d\" (UniqueName: \"kubernetes.io/projected/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-kube-api-access-wsw2d\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.492589 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.492437    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.492589 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.492465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.492589 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.492484    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-manifests\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.492589 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.492516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-tmp\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.592940 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.592865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsw2d\" (UniqueName: \"kubernetes.io/projected/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-kube-api-access-wsw2d\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.592940 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.592917    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.593133 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.592960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.593133 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.592988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-manifests\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.593133 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.593034    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-tmp\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.593547 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.593519    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-manifests\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.595422 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.595387    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-tmp\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.595529 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.595476    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.595529 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.595504    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.606686 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.606664    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsw2d\" (UniqueName: \"kubernetes.io/projected/6a3f1220-56b0-4e77-b9a5-8f15c8b562ef-kube-api-access-wsw2d\") pod \"opendatahub-operator-controller-manager-7dd47f799b-m2kgm\" (UID: \"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef\") " pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.621518 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.621289    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:43.751498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.751473    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"]
Aug 04 16:08:43.753494 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:08:43.753465    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3f1220_56b0_4e77_b9a5_8f15c8b562ef.slice/crio-a7640c8ec748debc0ac02d6c3877e87993332a2e96a1776d8d24e0ecf8e96cb1 WatchSource:0}: Error finding container a7640c8ec748debc0ac02d6c3877e87993332a2e96a1776d8d24e0ecf8e96cb1: Status 404 returned error can't find the container with id a7640c8ec748debc0ac02d6c3877e87993332a2e96a1776d8d24e0ecf8e96cb1
Aug 04 16:08:43.755281 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:43.755264    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:08:44.119628 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.119592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm" event={"ID":"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef","Type":"ContainerStarted","Data":"a7640c8ec748debc0ac02d6c3877e87993332a2e96a1776d8d24e0ecf8e96cb1"}
Aug 04 16:08:44.122796 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.122762    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5987488f45-rg5x9" podUID="a3678aee-85cd-4145-a53b-8a7f497edd10" containerName="console" containerID="cri-o://f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01" gracePeriod=15
Aug 04 16:08:44.387766 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.387719    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:08:44.501373 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.501321    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-serving-cert\") pod \"a3678aee-85cd-4145-a53b-8a7f497edd10\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") "
Aug 04 16:08:44.501554 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.501420    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-service-ca\") pod \"a3678aee-85cd-4145-a53b-8a7f497edd10\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") "
Aug 04 16:08:44.501554 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.501447    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-oauth-config\") pod \"a3678aee-85cd-4145-a53b-8a7f497edd10\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") "
Aug 04 16:08:44.501554 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.501478    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbf7z\" (UniqueName: \"kubernetes.io/projected/a3678aee-85cd-4145-a53b-8a7f497edd10-kube-api-access-gbf7z\") pod \"a3678aee-85cd-4145-a53b-8a7f497edd10\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") "
Aug 04 16:08:44.501554 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.501502    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-console-config\") pod \"a3678aee-85cd-4145-a53b-8a7f497edd10\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") "
Aug 04 16:08:44.501554 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.501542    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-trusted-ca-bundle\") pod \"a3678aee-85cd-4145-a53b-8a7f497edd10\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") "
Aug 04 16:08:44.501842 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.501590    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-oauth-serving-cert\") pod \"a3678aee-85cd-4145-a53b-8a7f497edd10\" (UID: \"a3678aee-85cd-4145-a53b-8a7f497edd10\") "
Aug 04 16:08:44.502457 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.502413    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-console-config" (OuterVolumeSpecName: "console-config") pod "a3678aee-85cd-4145-a53b-8a7f497edd10" (UID: "a3678aee-85cd-4145-a53b-8a7f497edd10"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:44.502565 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.502493    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a3678aee-85cd-4145-a53b-8a7f497edd10" (UID: "a3678aee-85cd-4145-a53b-8a7f497edd10"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:44.502565 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.502552    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a3678aee-85cd-4145-a53b-8a7f497edd10" (UID: "a3678aee-85cd-4145-a53b-8a7f497edd10"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:44.502676 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.502651    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-service-ca" (OuterVolumeSpecName: "service-ca") pod "a3678aee-85cd-4145-a53b-8a7f497edd10" (UID: "a3678aee-85cd-4145-a53b-8a7f497edd10"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:44.504927 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.504878    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a3678aee-85cd-4145-a53b-8a7f497edd10" (UID: "a3678aee-85cd-4145-a53b-8a7f497edd10"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:08:44.504927 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.504890    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a3678aee-85cd-4145-a53b-8a7f497edd10" (UID: "a3678aee-85cd-4145-a53b-8a7f497edd10"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:08:44.505091 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.505053    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3678aee-85cd-4145-a53b-8a7f497edd10-kube-api-access-gbf7z" (OuterVolumeSpecName: "kube-api-access-gbf7z") pod "a3678aee-85cd-4145-a53b-8a7f497edd10" (UID: "a3678aee-85cd-4145-a53b-8a7f497edd10"). InnerVolumeSpecName "kube-api-access-gbf7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:44.602839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.602672    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-serving-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:08:44.602839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.602704    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-service-ca\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:08:44.602839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.602718    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a3678aee-85cd-4145-a53b-8a7f497edd10-console-oauth-config\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:08:44.602839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.602733    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbf7z\" (UniqueName: \"kubernetes.io/projected/a3678aee-85cd-4145-a53b-8a7f497edd10-kube-api-access-gbf7z\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:08:44.602839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.602764    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-console-config\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:08:44.602839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.602784    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-trusted-ca-bundle\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:08:44.602839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:44.602797    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a3678aee-85cd-4145-a53b-8a7f497edd10-oauth-serving-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:08:45.125435 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:45.125394    2558 generic.go:356] "Generic (PLEG): container finished" podID="a3678aee-85cd-4145-a53b-8a7f497edd10" containerID="f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01" exitCode=0
Aug 04 16:08:45.125607 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:45.125443    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5987488f45-rg5x9"
Aug 04 16:08:45.125607 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:45.125455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5987488f45-rg5x9" event={"ID":"a3678aee-85cd-4145-a53b-8a7f497edd10","Type":"ContainerDied","Data":"f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01"}
Aug 04 16:08:45.125607 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:45.125506    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5987488f45-rg5x9" event={"ID":"a3678aee-85cd-4145-a53b-8a7f497edd10","Type":"ContainerDied","Data":"b1f0f3ff837717bdd4e70832ed6e688823dfe5aad436ad61c75f3928ae8ee91f"}
Aug 04 16:08:45.125607 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:45.125530    2558 scope.go:117] "RemoveContainer" containerID="f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01"
Aug 04 16:08:45.145248 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:45.145215    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5987488f45-rg5x9"]
Aug 04 16:08:45.149148 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:45.149118    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5987488f45-rg5x9"]
Aug 04 16:08:46.500208 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:46.499988    2558 scope.go:117] "RemoveContainer" containerID="f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01"
Aug 04 16:08:46.500436 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:08:46.500321    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01\": container with ID starting with f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01 not found: ID does not exist" containerID="f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01"
Aug 04 16:08:46.500436 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:46.500347    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01"} err="failed to get container status \"f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01\": rpc error: code = NotFound desc = could not find container \"f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01\": container with ID starting with f414d11962d54441bb4d81626e17d752e5423e6c92c840e8b8768a5b10621f01 not found: ID does not exist"
Aug 04 16:08:46.692082 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:46.692050    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3678aee-85cd-4145-a53b-8a7f497edd10" path="/var/lib/kubelet/pods/a3678aee-85cd-4145-a53b-8a7f497edd10/volumes"
Aug 04 16:08:47.135646 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:47.135605    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm" event={"ID":"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef","Type":"ContainerStarted","Data":"31777e276f062a3d69c7374d91bed0dcf3ce4156b88a74ae829a988421e76333"}
Aug 04 16:08:48.140225 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:48.140193    2558 generic.go:356] "Generic (PLEG): container finished" podID="6a3f1220-56b0-4e77-b9a5-8f15c8b562ef" containerID="31777e276f062a3d69c7374d91bed0dcf3ce4156b88a74ae829a988421e76333" exitCode=0
Aug 04 16:08:48.140591 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:48.140273    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm" event={"ID":"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef","Type":"ContainerDied","Data":"31777e276f062a3d69c7374d91bed0dcf3ce4156b88a74ae829a988421e76333"}
Aug 04 16:08:49.146015 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:49.145983    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm" event={"ID":"6a3f1220-56b0-4e77-b9a5-8f15c8b562ef","Type":"ContainerStarted","Data":"48569d7ec9ea9cbd48ddcb0b5201e27f96b8531e40ec0bff325194813957537d"}
Aug 04 16:08:49.146390 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:49.146120    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:08:49.211716 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:08:49.211671    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm" podStartSLOduration=1.6662849199999998 podStartE2EDuration="6.211653171s" totalImagesPullingTime="3.511866897s" totalInitContainerRuntime="1.033501354s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:49.208003919 +0000 UTC m=+415.064476764" watchObservedRunningTime="2026-08-04 16:08:49.211653171 +0000 UTC m=+415.068126014"
Aug 04 16:09:00.152119 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:00.152089    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dd47f799b-m2kgm"
Aug 04 16:09:02.691287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.691256    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"]
Aug 04 16:09:02.691627 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.691531    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3678aee-85cd-4145-a53b-8a7f497edd10" containerName="console"
Aug 04 16:09:02.691627 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.691543    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3678aee-85cd-4145-a53b-8a7f497edd10" containerName="console"
Aug 04 16:09:02.691627 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.691597    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3678aee-85cd-4145-a53b-8a7f497edd10" containerName="console"
Aug 04 16:09:02.700660 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.700639    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:02.704161 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.704123    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 16:09:02.704514 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.704495    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 16:09:02.707430 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.707412    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 16:09:02.707738 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.707723    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 16:09:02.727634 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.727608    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"]
Aug 04 16:09:02.739922 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.739902    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2debd93-f80e-41bd-8760-c636431fc4f5-tls-certs\") pod \"kube-auth-proxy-5cb97f6d89-qpjnm\" (UID: \"e2debd93-f80e-41bd-8760-c636431fc4f5\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:02.740020 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.739936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2debd93-f80e-41bd-8760-c636431fc4f5-tmp\") pod \"kube-auth-proxy-5cb97f6d89-qpjnm\" (UID: \"e2debd93-f80e-41bd-8760-c636431fc4f5\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:02.740020 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.739973    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txg9f\" (UniqueName: \"kubernetes.io/projected/e2debd93-f80e-41bd-8760-c636431fc4f5-kube-api-access-txg9f\") pod \"kube-auth-proxy-5cb97f6d89-qpjnm\" (UID: \"e2debd93-f80e-41bd-8760-c636431fc4f5\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:02.743845 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.743824    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ccgtc\""
Aug 04 16:09:02.841135 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.841104    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2debd93-f80e-41bd-8760-c636431fc4f5-tls-certs\") pod \"kube-auth-proxy-5cb97f6d89-qpjnm\" (UID: \"e2debd93-f80e-41bd-8760-c636431fc4f5\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:02.841135 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.841136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2debd93-f80e-41bd-8760-c636431fc4f5-tmp\") pod \"kube-auth-proxy-5cb97f6d89-qpjnm\" (UID: \"e2debd93-f80e-41bd-8760-c636431fc4f5\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:02.841326 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.841161    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txg9f\" (UniqueName: \"kubernetes.io/projected/e2debd93-f80e-41bd-8760-c636431fc4f5-kube-api-access-txg9f\") pod \"kube-auth-proxy-5cb97f6d89-qpjnm\" (UID: \"e2debd93-f80e-41bd-8760-c636431fc4f5\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:02.843396 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.843365    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e2debd93-f80e-41bd-8760-c636431fc4f5-tmp\") pod \"kube-auth-proxy-5cb97f6d89-qpjnm\" (UID: \"e2debd93-f80e-41bd-8760-c636431fc4f5\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:02.843513 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.843501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2debd93-f80e-41bd-8760-c636431fc4f5-tls-certs\") pod \"kube-auth-proxy-5cb97f6d89-qpjnm\" (UID: \"e2debd93-f80e-41bd-8760-c636431fc4f5\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:02.860568 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:02.860540    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txg9f\" (UniqueName: \"kubernetes.io/projected/e2debd93-f80e-41bd-8760-c636431fc4f5-kube-api-access-txg9f\") pod \"kube-auth-proxy-5cb97f6d89-qpjnm\" (UID: \"e2debd93-f80e-41bd-8760-c636431fc4f5\") " pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:03.010631 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.010556    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"
Aug 04 16:09:03.015370 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.015342    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sjxjf"]
Aug 04 16:09:03.017773 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.017757    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:03.022210 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.022186    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Aug 04 16:09:03.022354 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.022258    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-72dmw\""
Aug 04 16:09:03.041270 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.041239    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sjxjf"]
Aug 04 16:09:03.043476 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.043451    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj5q2\" (UniqueName: \"kubernetes.io/projected/bb40d4b9-5cc6-4985-ac80-d9330f627340-kube-api-access-mj5q2\") pod \"odh-model-controller-7998c67dc4-sjxjf\" (UID: \"bb40d4b9-5cc6-4985-ac80-d9330f627340\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:03.043586 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.043503    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb40d4b9-5cc6-4985-ac80-d9330f627340-cert\") pod \"odh-model-controller-7998c67dc4-sjxjf\" (UID: \"bb40d4b9-5cc6-4985-ac80-d9330f627340\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:03.144591 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.144558    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb40d4b9-5cc6-4985-ac80-d9330f627340-cert\") pod \"odh-model-controller-7998c67dc4-sjxjf\" (UID: \"bb40d4b9-5cc6-4985-ac80-d9330f627340\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:03.144789 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.144617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj5q2\" (UniqueName: \"kubernetes.io/projected/bb40d4b9-5cc6-4985-ac80-d9330f627340-kube-api-access-mj5q2\") pod \"odh-model-controller-7998c67dc4-sjxjf\" (UID: \"bb40d4b9-5cc6-4985-ac80-d9330f627340\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:03.144789 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:09:03.144722    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Aug 04 16:09:03.144930 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:09:03.144825    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb40d4b9-5cc6-4985-ac80-d9330f627340-cert podName:bb40d4b9-5cc6-4985-ac80-d9330f627340 nodeName:}" failed. No retries permitted until 2026-08-04 16:09:03.644803971 +0000 UTC m=+429.501276803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bb40d4b9-5cc6-4985-ac80-d9330f627340-cert") pod "odh-model-controller-7998c67dc4-sjxjf" (UID: "bb40d4b9-5cc6-4985-ac80-d9330f627340") : secret "odh-model-controller-webhook-cert" not found
Aug 04 16:09:03.169535 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.169511    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj5q2\" (UniqueName: \"kubernetes.io/projected/bb40d4b9-5cc6-4985-ac80-d9330f627340-kube-api-access-mj5q2\") pod \"odh-model-controller-7998c67dc4-sjxjf\" (UID: \"bb40d4b9-5cc6-4985-ac80-d9330f627340\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:03.190353 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.190323    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm"]
Aug 04 16:09:03.195479 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:09:03.195459    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2debd93_f80e_41bd_8760_c636431fc4f5.slice/crio-573740254f8e2c62f2c0a6f210507056539894094ccfe3b3d8b137d79aaf67b7 WatchSource:0}: Error finding container 573740254f8e2c62f2c0a6f210507056539894094ccfe3b3d8b137d79aaf67b7: Status 404 returned error can't find the container with id 573740254f8e2c62f2c0a6f210507056539894094ccfe3b3d8b137d79aaf67b7
Aug 04 16:09:03.649054 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.649017    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb40d4b9-5cc6-4985-ac80-d9330f627340-cert\") pod \"odh-model-controller-7998c67dc4-sjxjf\" (UID: \"bb40d4b9-5cc6-4985-ac80-d9330f627340\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:03.651373 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.651354    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bb40d4b9-5cc6-4985-ac80-d9330f627340-cert\") pod \"odh-model-controller-7998c67dc4-sjxjf\" (UID: \"bb40d4b9-5cc6-4985-ac80-d9330f627340\") " pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:03.939186 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:03.939099    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:04.098609 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.098578    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sjxjf"]
Aug 04 16:09:04.101953 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:09:04.101912    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb40d4b9_5cc6_4985_ac80_d9330f627340.slice/crio-604096d9957a1923f6fc0bd2b3246e9e3bcfa7282c09031a5360d6678b10bbdd WatchSource:0}: Error finding container 604096d9957a1923f6fc0bd2b3246e9e3bcfa7282c09031a5360d6678b10bbdd: Status 404 returned error can't find the container with id 604096d9957a1923f6fc0bd2b3246e9e3bcfa7282c09031a5360d6678b10bbdd
Aug 04 16:09:04.202680 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.202557    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf" event={"ID":"bb40d4b9-5cc6-4985-ac80-d9330f627340","Type":"ContainerStarted","Data":"604096d9957a1923f6fc0bd2b3246e9e3bcfa7282c09031a5360d6678b10bbdd"}
Aug 04 16:09:04.204032 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.203998    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm" event={"ID":"e2debd93-f80e-41bd-8760-c636431fc4f5","Type":"ContainerStarted","Data":"573740254f8e2c62f2c0a6f210507056539894094ccfe3b3d8b137d79aaf67b7"}
Aug 04 16:09:04.402527 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.402486    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"]
Aug 04 16:09:04.407359 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.407321    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.411887 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.411839    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 16:09:04.412023 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.411979    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dd8bn\""
Aug 04 16:09:04.412384 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.412362    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 16:09:04.412475 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.412362    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 16:09:04.412898 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.412878    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 16:09:04.426477 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.426449    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"]
Aug 04 16:09:04.457221 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.457141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.457221 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.457192    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g97rj\" (UniqueName: \"kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-kube-api-access-g97rj\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.457418 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.457287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.457418 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.457329    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.457418 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.457389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a778fe29-770f-44a5-9f31-9b64c7413285-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.457571 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.457428    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.457571 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.457463    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.557977 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.557928    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.558146 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.557983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.558146 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.558030    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a778fe29-770f-44a5-9f31-9b64c7413285-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.558146 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.558071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.558146 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.558106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.558367 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.558172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.558367 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.558205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g97rj\" (UniqueName: \"kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-kube-api-access-g97rj\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.558621 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.558594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.560727 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.560699    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.561049 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.560942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a778fe29-770f-44a5-9f31-9b64c7413285-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.561049 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.561005    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.561331 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.561312    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.587317 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.587272    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g97rj\" (UniqueName: \"kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-kube-api-access-g97rj\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.597342 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.597313    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jjbbn\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:04.720358 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:04.720272    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:06.003500 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:06.003476    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"]
Aug 04 16:09:06.005396 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:09:06.005369    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda778fe29_770f_44a5_9f31_9b64c7413285.slice/crio-b03bf22867addcba28162b4f21f662c3bc7af012201ed5cc7424e92c29429de5 WatchSource:0}: Error finding container b03bf22867addcba28162b4f21f662c3bc7af012201ed5cc7424e92c29429de5: Status 404 returned error can't find the container with id b03bf22867addcba28162b4f21f662c3bc7af012201ed5cc7424e92c29429de5
Aug 04 16:09:06.214883 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:06.214799    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm" event={"ID":"e2debd93-f80e-41bd-8760-c636431fc4f5","Type":"ContainerStarted","Data":"887dc9644b4849529a702003611e834b5715c304bfccf45e5d208c1ebc177203"}
Aug 04 16:09:06.216468 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:06.216430    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn" event={"ID":"a778fe29-770f-44a5-9f31-9b64c7413285","Type":"ContainerStarted","Data":"b03bf22867addcba28162b4f21f662c3bc7af012201ed5cc7424e92c29429de5"}
Aug 04 16:09:06.235489 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:06.235435    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5cb97f6d89-qpjnm" podStartSLOduration=1.497146093 podStartE2EDuration="4.235417574s" totalImagesPullingTime="2.738271481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:06.234929574 +0000 UTC m=+432.091402420" watchObservedRunningTime="2026-08-04 16:09:06.235417574 +0000 UTC m=+432.091890420"
Aug 04 16:09:09.514067 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:09.514027    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:09:09.514376 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:09.514095    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:09:10.235999 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:10.235960    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn" event={"ID":"a778fe29-770f-44a5-9f31-9b64c7413285","Type":"ContainerStarted","Data":"2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c"}
Aug 04 16:09:10.236178 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:10.236160    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:10.237605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:10.237579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf" event={"ID":"bb40d4b9-5cc6-4985-ac80-d9330f627340","Type":"ContainerStarted","Data":"2a5847bee27403f4e24fd715d89d421d7ea7cd75a97aa032f1285354af886775"}
Aug 04 16:09:10.237765 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:10.237722    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:10.238000 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:10.237980    2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-jjbbn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 16:09:10.238055 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:10.238019    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn" podUID="a778fe29-770f-44a5-9f31-9b64c7413285" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 16:09:10.289822 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:10.289767    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn" podStartSLOduration=2.783785464 podStartE2EDuration="6.289735205s" totalImagesPullingTime="3.505949741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:10.288218864 +0000 UTC m=+436.144691709" watchObservedRunningTime="2026-08-04 16:09:10.289735205 +0000 UTC m=+436.146208049"
Aug 04 16:09:10.325129 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:10.325045    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf" podStartSLOduration=2.914788782 podStartE2EDuration="8.325024446s" totalImagesPullingTime="5.410235664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:10.32392949 +0000 UTC m=+436.180402336" watchObservedRunningTime="2026-08-04 16:09:10.325024446 +0000 UTC m=+436.181497291"
Aug 04 16:09:11.242332 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:11.242306    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:13.736577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.736541    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c58867685-7294c"]
Aug 04 16:09:13.739951 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.739932    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.745957 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.745932    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 16:09:13.747365 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.747336    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 16:09:13.747515 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.747495    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 16:09:13.747607 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.747569    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 16:09:13.747666 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.747607    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8n2cc\""
Aug 04 16:09:13.747666 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.747623    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 16:09:13.758051 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.758030    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c58867685-7294c"]
Aug 04 16:09:13.838178 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.838144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-manager-config\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.838323 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.838209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-metrics-cert\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.838323 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.838244    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-cert\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.838323 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.838307    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddwxm\" (UniqueName: \"kubernetes.io/projected/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-kube-api-access-ddwxm\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.939730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.939692    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-metrics-cert\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.939730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.939731    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-cert\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.940006 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.939790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddwxm\" (UniqueName: \"kubernetes.io/projected/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-kube-api-access-ddwxm\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.940006 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.939819    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-manager-config\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.940508 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.940481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-manager-config\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.942347 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.942323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-cert\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.942458 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.942323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-metrics-cert\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:13.951597 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:13.951568    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddwxm\" (UniqueName: \"kubernetes.io/projected/6a029e0d-b22e-4d22-baf1-1daafef4f2fe-kube-api-access-ddwxm\") pod \"lws-controller-manager-7c58867685-7294c\" (UID: \"6a029e0d-b22e-4d22-baf1-1daafef4f2fe\") " pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:14.049084 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:14.049004    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:14.215964 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:14.215935    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c58867685-7294c"]
Aug 04 16:09:14.224841 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:09:14.224808    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a029e0d_b22e_4d22_baf1_1daafef4f2fe.slice/crio-408c96fc743e73bd5dbe7510cd3006b8b24e974641db7881dfeffb1b9802d600 WatchSource:0}: Error finding container 408c96fc743e73bd5dbe7510cd3006b8b24e974641db7881dfeffb1b9802d600: Status 404 returned error can't find the container with id 408c96fc743e73bd5dbe7510cd3006b8b24e974641db7881dfeffb1b9802d600
Aug 04 16:09:14.260060 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:14.260021    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c" event={"ID":"6a029e0d-b22e-4d22-baf1-1daafef4f2fe","Type":"ContainerStarted","Data":"408c96fc743e73bd5dbe7510cd3006b8b24e974641db7881dfeffb1b9802d600"}
Aug 04 16:09:15.559352 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.559320    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"]
Aug 04 16:09:15.559930 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.559585    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn" podUID="a778fe29-770f-44a5-9f31-9b64c7413285" containerName="discovery" containerID="cri-o://2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c" gracePeriod=30
Aug 04 16:09:15.815533 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.815481    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:15.857444 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.857411    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-istio-token\") pod \"a778fe29-770f-44a5-9f31-9b64c7413285\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") "
Aug 04 16:09:15.857623 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.857480    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-ca-configmap\") pod \"a778fe29-770f-44a5-9f31-9b64c7413285\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") "
Aug 04 16:09:15.857722 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.857691    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-cacerts\") pod \"a778fe29-770f-44a5-9f31-9b64c7413285\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") "
Aug 04 16:09:15.857807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.857780    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-dns-cert\") pod \"a778fe29-770f-44a5-9f31-9b64c7413285\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") "
Aug 04 16:09:15.857864 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.857828    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g97rj\" (UniqueName: \"kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-kube-api-access-g97rj\") pod \"a778fe29-770f-44a5-9f31-9b64c7413285\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") "
Aug 04 16:09:15.857917 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.857869    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-kubeconfig\") pod \"a778fe29-770f-44a5-9f31-9b64c7413285\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") "
Aug 04 16:09:15.857917 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.857908    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a778fe29-770f-44a5-9f31-9b64c7413285-local-certs\") pod \"a778fe29-770f-44a5-9f31-9b64c7413285\" (UID: \"a778fe29-770f-44a5-9f31-9b64c7413285\") "
Aug 04 16:09:15.858523 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.858492    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a778fe29-770f-44a5-9f31-9b64c7413285" (UID: "a778fe29-770f-44a5-9f31-9b64c7413285"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:09:15.861002 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.860969    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a778fe29-770f-44a5-9f31-9b64c7413285-local-certs" (OuterVolumeSpecName: "local-certs") pod "a778fe29-770f-44a5-9f31-9b64c7413285" (UID: "a778fe29-770f-44a5-9f31-9b64c7413285"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:09:15.861166 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.861130    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-istio-token" (OuterVolumeSpecName: "istio-token") pod "a778fe29-770f-44a5-9f31-9b64c7413285" (UID: "a778fe29-770f-44a5-9f31-9b64c7413285"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:09:15.861673 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.861644    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-cacerts" (OuterVolumeSpecName: "cacerts") pod "a778fe29-770f-44a5-9f31-9b64c7413285" (UID: "a778fe29-770f-44a5-9f31-9b64c7413285"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:09:15.862642 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.862613    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a778fe29-770f-44a5-9f31-9b64c7413285" (UID: "a778fe29-770f-44a5-9f31-9b64c7413285"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:09:15.863265 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.863222    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a778fe29-770f-44a5-9f31-9b64c7413285" (UID: "a778fe29-770f-44a5-9f31-9b64c7413285"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:09:15.863736 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.863697    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-kube-api-access-g97rj" (OuterVolumeSpecName: "kube-api-access-g97rj") pod "a778fe29-770f-44a5-9f31-9b64c7413285" (UID: "a778fe29-770f-44a5-9f31-9b64c7413285"). InnerVolumeSpecName "kube-api-access-g97rj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:09:15.959470 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.959439    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-dns-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:09:15.959470 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.959470    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g97rj\" (UniqueName: \"kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-kube-api-access-g97rj\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:09:15.959672 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.959482    2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-istio-kubeconfig\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:09:15.959672 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.959496    2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a778fe29-770f-44a5-9f31-9b64c7413285-local-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:09:15.959672 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.959507    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a778fe29-770f-44a5-9f31-9b64c7413285-istio-token\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:09:15.959672 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.959515    2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a778fe29-770f-44a5-9f31-9b64c7413285-istio-csr-ca-configmap\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:09:15.959672 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:15.959522    2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a778fe29-770f-44a5-9f31-9b64c7413285-cacerts\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:09:16.271090 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:16.271053    2558 generic.go:356] "Generic (PLEG): container finished" podID="a778fe29-770f-44a5-9f31-9b64c7413285" containerID="2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c" exitCode=0
Aug 04 16:09:16.271279 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:16.271103    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn" event={"ID":"a778fe29-770f-44a5-9f31-9b64c7413285","Type":"ContainerDied","Data":"2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c"}
Aug 04 16:09:16.271279 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:16.271114    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"
Aug 04 16:09:16.271279 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:16.271153    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn" event={"ID":"a778fe29-770f-44a5-9f31-9b64c7413285","Type":"ContainerDied","Data":"b03bf22867addcba28162b4f21f662c3bc7af012201ed5cc7424e92c29429de5"}
Aug 04 16:09:16.271279 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:16.271177    2558 scope.go:117] "RemoveContainer" containerID="2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c"
Aug 04 16:09:16.305037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:16.304979    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"]
Aug 04 16:09:16.312996 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:16.312971    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jjbbn"]
Aug 04 16:09:16.692159 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:16.692122    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a778fe29-770f-44a5-9f31-9b64c7413285" path="/var/lib/kubelet/pods/a778fe29-770f-44a5-9f31-9b64c7413285/volumes"
Aug 04 16:09:16.862649 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:16.862473    2558 scope.go:117] "RemoveContainer" containerID="2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c"
Aug 04 16:09:16.862845 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:09:16.862819    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c\": container with ID starting with 2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c not found: ID does not exist" containerID="2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c"
Aug 04 16:09:16.862965 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:16.862849    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c"} err="failed to get container status \"2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c\": rpc error: code = NotFound desc = could not find container \"2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c\": container with ID starting with 2ca07d876f8d30f429de9ec2945dbb8246452f24b48547d6802242d839e4f77c not found: ID does not exist"
Aug 04 16:09:17.277473 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:17.277383    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c" event={"ID":"6a029e0d-b22e-4d22-baf1-1daafef4f2fe","Type":"ContainerStarted","Data":"79475b94c2ca3de1985293bde9bc7bb5893a38b1be8c03566c7543dd3d406a8d"}
Aug 04 16:09:17.277636 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:17.277511    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:09:17.313213 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:17.313168    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c" podStartSLOduration=1.6328525539999998 podStartE2EDuration="4.31315227s" totalImagesPullingTime="2.680299716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:09:17.310712186 +0000 UTC m=+443.167185030" watchObservedRunningTime="2026-08-04 16:09:17.31315227 +0000 UTC m=+443.169625114"
Aug 04 16:09:21.243859 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:21.243827    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-sjxjf"
Aug 04 16:09:28.283678 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:09:28.283640    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c58867685-7294c"
Aug 04 16:10:29.217236 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.217203    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"]
Aug 04 16:10:29.217680 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.217476    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a778fe29-770f-44a5-9f31-9b64c7413285" containerName="discovery"
Aug 04 16:10:29.217680 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.217486    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a778fe29-770f-44a5-9f31-9b64c7413285" containerName="discovery"
Aug 04 16:10:29.217680 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.217533    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a778fe29-770f-44a5-9f31-9b64c7413285" containerName="discovery"
Aug 04 16:10:29.220327 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.220311    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:29.223233 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.223211    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jzpbj\""
Aug 04 16:10:29.223328 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.223214    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 16:10:29.224337 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.224318    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 16:10:29.244958 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.244931    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"]
Aug 04 16:10:29.337184 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.337163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b1de098-372e-4a6b-8354-6728bec00ba7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7hxcz\" (UID: \"3b1de098-372e-4a6b-8354-6728bec00ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:29.337285 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.337210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vvp9\" (UniqueName: \"kubernetes.io/projected/3b1de098-372e-4a6b-8354-6728bec00ba7-kube-api-access-5vvp9\") pod \"kuadrant-operator-controller-manager-58fc56757c-7hxcz\" (UID: \"3b1de098-372e-4a6b-8354-6728bec00ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:29.438010 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.437981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vvp9\" (UniqueName: \"kubernetes.io/projected/3b1de098-372e-4a6b-8354-6728bec00ba7-kube-api-access-5vvp9\") pod \"kuadrant-operator-controller-manager-58fc56757c-7hxcz\" (UID: \"3b1de098-372e-4a6b-8354-6728bec00ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:29.438128 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.438053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b1de098-372e-4a6b-8354-6728bec00ba7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7hxcz\" (UID: \"3b1de098-372e-4a6b-8354-6728bec00ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:29.438387 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.438368    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b1de098-372e-4a6b-8354-6728bec00ba7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7hxcz\" (UID: \"3b1de098-372e-4a6b-8354-6728bec00ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:29.450375 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.450353    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vvp9\" (UniqueName: \"kubernetes.io/projected/3b1de098-372e-4a6b-8354-6728bec00ba7-kube-api-access-5vvp9\") pod \"kuadrant-operator-controller-manager-58fc56757c-7hxcz\" (UID: \"3b1de098-372e-4a6b-8354-6728bec00ba7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:29.530388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.530331    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:29.658416 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:29.658380    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"]
Aug 04 16:10:29.660949 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:10:29.660922    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b1de098_372e_4a6b_8354_6728bec00ba7.slice/crio-8e387f5541b8c486e1dadb0017135d9b682c0fd19d1a4c7fad20202b55a95efa WatchSource:0}: Error finding container 8e387f5541b8c486e1dadb0017135d9b682c0fd19d1a4c7fad20202b55a95efa: Status 404 returned error can't find the container with id 8e387f5541b8c486e1dadb0017135d9b682c0fd19d1a4c7fad20202b55a95efa
Aug 04 16:10:30.552821 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:30.552784    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz" event={"ID":"3b1de098-372e-4a6b-8354-6728bec00ba7","Type":"ContainerStarted","Data":"8e387f5541b8c486e1dadb0017135d9b682c0fd19d1a4c7fad20202b55a95efa"}
Aug 04 16:10:34.573638 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:34.573602    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz" event={"ID":"3b1de098-372e-4a6b-8354-6728bec00ba7","Type":"ContainerStarted","Data":"5d92d82b5bbad42a854fd446d6d4c0c2284759952336af38bb6009341aca8c16"}
Aug 04 16:10:34.574015 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:34.573719    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:34.598351 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:34.598303    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz" podStartSLOduration=1.67288331 podStartE2EDuration="5.598290032s" totalImagesPullingTime="3.925406722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:10:34.597701078 +0000 UTC m=+520.454173924" watchObservedRunningTime="2026-08-04 16:10:34.598290032 +0000 UTC m=+520.454762876"
Aug 04 16:10:36.162892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.162863    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"]
Aug 04 16:10:36.166728 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.166700    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.170246 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.170221    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hhpjv\""
Aug 04 16:10:36.170423 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.170391    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Aug 04 16:10:36.170423 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.170414    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Aug 04 16:10:36.174196 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.174177    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"]
Aug 04 16:10:36.294137 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.294111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8342179f-3e2b-4395-a0a6-1593b6fa0903-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-597v4\" (UID: \"8342179f-3e2b-4395-a0a6-1593b6fa0903\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.294295 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.294150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8342179f-3e2b-4395-a0a6-1593b6fa0903-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-597v4\" (UID: \"8342179f-3e2b-4395-a0a6-1593b6fa0903\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.294295 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.294176    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j779r\" (UniqueName: \"kubernetes.io/projected/8342179f-3e2b-4395-a0a6-1593b6fa0903-kube-api-access-j779r\") pod \"kuadrant-console-plugin-598f86468b-597v4\" (UID: \"8342179f-3e2b-4395-a0a6-1593b6fa0903\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.395384 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.395356    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8342179f-3e2b-4395-a0a6-1593b6fa0903-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-597v4\" (UID: \"8342179f-3e2b-4395-a0a6-1593b6fa0903\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.395534 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.395395    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8342179f-3e2b-4395-a0a6-1593b6fa0903-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-597v4\" (UID: \"8342179f-3e2b-4395-a0a6-1593b6fa0903\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.395534 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.395419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j779r\" (UniqueName: \"kubernetes.io/projected/8342179f-3e2b-4395-a0a6-1593b6fa0903-kube-api-access-j779r\") pod \"kuadrant-console-plugin-598f86468b-597v4\" (UID: \"8342179f-3e2b-4395-a0a6-1593b6fa0903\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.396120 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.396095    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8342179f-3e2b-4395-a0a6-1593b6fa0903-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-597v4\" (UID: \"8342179f-3e2b-4395-a0a6-1593b6fa0903\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.397856 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.397833    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8342179f-3e2b-4395-a0a6-1593b6fa0903-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-597v4\" (UID: \"8342179f-3e2b-4395-a0a6-1593b6fa0903\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.403742 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.403721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j779r\" (UniqueName: \"kubernetes.io/projected/8342179f-3e2b-4395-a0a6-1593b6fa0903-kube-api-access-j779r\") pod \"kuadrant-console-plugin-598f86468b-597v4\" (UID: \"8342179f-3e2b-4395-a0a6-1593b6fa0903\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.485056 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.484983    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"
Aug 04 16:10:36.608601 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:36.608575    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-597v4"]
Aug 04 16:10:36.611537 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:10:36.611513    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8342179f_3e2b_4395_a0a6_1593b6fa0903.slice/crio-60792af2aed89e8577b5be46d6b3346d907f8575ac49056492ee0fde750f2e97 WatchSource:0}: Error finding container 60792af2aed89e8577b5be46d6b3346d907f8575ac49056492ee0fde750f2e97: Status 404 returned error can't find the container with id 60792af2aed89e8577b5be46d6b3346d907f8575ac49056492ee0fde750f2e97
Aug 04 16:10:37.590653 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:37.590616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4" event={"ID":"8342179f-3e2b-4395-a0a6-1593b6fa0903","Type":"ContainerStarted","Data":"60792af2aed89e8577b5be46d6b3346d907f8575ac49056492ee0fde750f2e97"}
Aug 04 16:10:41.612011 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:41.611925    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4" event={"ID":"8342179f-3e2b-4395-a0a6-1593b6fa0903","Type":"ContainerStarted","Data":"56381a19895e8ee04e7afa4ac9d686846c6232458276083bd84a1642299b741c"}
Aug 04 16:10:41.634331 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:41.634285    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-597v4" podStartSLOduration=0.957788351 podStartE2EDuration="5.634269616s" totalImagesPullingTime="4.676481265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:10:41.633779157 +0000 UTC m=+527.490252002" watchObservedRunningTime="2026-08-04 16:10:41.634269616 +0000 UTC m=+527.490742460"
Aug 04 16:10:45.580439 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:45.580408    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:47.428376 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.428295    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"]
Aug 04 16:10:47.428815 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.428490    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz" podUID="3b1de098-372e-4a6b-8354-6728bec00ba7" containerName="manager" containerID="cri-o://5d92d82b5bbad42a854fd446d6d4c0c2284759952336af38bb6009341aca8c16" gracePeriod=2
Aug 04 16:10:47.433025 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.432994    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"]
Aug 04 16:10:47.469949 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.468334    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"]
Aug 04 16:10:47.469949 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.469054    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b1de098-372e-4a6b-8354-6728bec00ba7" containerName="manager"
Aug 04 16:10:47.469949 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.469075    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b1de098-372e-4a6b-8354-6728bec00ba7" containerName="manager"
Aug 04 16:10:47.469949 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.469232    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b1de098-372e-4a6b-8354-6728bec00ba7" containerName="manager"
Aug 04 16:10:47.475455 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.475413    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:10:47.490229 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.490147    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"]
Aug 04 16:10:47.514037 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:10:47.514003    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7hxcz\" is forbidden: User \"system:node:ip-10-0-141-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-219.ec2.internal' and this object" podUID="3b1de098-372e-4a6b-8354-6728bec00ba7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:47.596355 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.596318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjk52\" (UniqueName: \"kubernetes.io/projected/945c2b7d-e257-4f47-bc1a-cea86a999a45-kube-api-access-tjk52\") pod \"kuadrant-operator-controller-manager-58fc56757c-kvvwg\" (UID: \"945c2b7d-e257-4f47-bc1a-cea86a999a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:10:47.596519 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.596491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/945c2b7d-e257-4f47-bc1a-cea86a999a45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-kvvwg\" (UID: \"945c2b7d-e257-4f47-bc1a-cea86a999a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:10:47.639232 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.639199    2558 generic.go:356] "Generic (PLEG): container finished" podID="3b1de098-372e-4a6b-8354-6728bec00ba7" containerID="5d92d82b5bbad42a854fd446d6d4c0c2284759952336af38bb6009341aca8c16" exitCode=0
Aug 04 16:10:47.665083 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.665054    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:47.667852 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:10:47.667824    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7hxcz\" is forbidden: User \"system:node:ip-10-0-141-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-219.ec2.internal' and this object" podUID="3b1de098-372e-4a6b-8354-6728bec00ba7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:47.697839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.697785    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/945c2b7d-e257-4f47-bc1a-cea86a999a45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-kvvwg\" (UID: \"945c2b7d-e257-4f47-bc1a-cea86a999a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:10:47.697939 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.697838    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjk52\" (UniqueName: \"kubernetes.io/projected/945c2b7d-e257-4f47-bc1a-cea86a999a45-kube-api-access-tjk52\") pod \"kuadrant-operator-controller-manager-58fc56757c-kvvwg\" (UID: \"945c2b7d-e257-4f47-bc1a-cea86a999a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:10:47.698141 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.698109    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/945c2b7d-e257-4f47-bc1a-cea86a999a45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-kvvwg\" (UID: \"945c2b7d-e257-4f47-bc1a-cea86a999a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:10:47.709297 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.709278    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjk52\" (UniqueName: \"kubernetes.io/projected/945c2b7d-e257-4f47-bc1a-cea86a999a45-kube-api-access-tjk52\") pod \"kuadrant-operator-controller-manager-58fc56757c-kvvwg\" (UID: \"945c2b7d-e257-4f47-bc1a-cea86a999a45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:10:47.798192 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.798166    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vvp9\" (UniqueName: \"kubernetes.io/projected/3b1de098-372e-4a6b-8354-6728bec00ba7-kube-api-access-5vvp9\") pod \"3b1de098-372e-4a6b-8354-6728bec00ba7\" (UID: \"3b1de098-372e-4a6b-8354-6728bec00ba7\") "
Aug 04 16:10:47.798317 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.798239    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b1de098-372e-4a6b-8354-6728bec00ba7-extensions-socket-volume\") pod \"3b1de098-372e-4a6b-8354-6728bec00ba7\" (UID: \"3b1de098-372e-4a6b-8354-6728bec00ba7\") "
Aug 04 16:10:47.798819 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.798796    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b1de098-372e-4a6b-8354-6728bec00ba7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3b1de098-372e-4a6b-8354-6728bec00ba7" (UID: "3b1de098-372e-4a6b-8354-6728bec00ba7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:47.800096 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.800075    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b1de098-372e-4a6b-8354-6728bec00ba7-kube-api-access-5vvp9" (OuterVolumeSpecName: "kube-api-access-5vvp9") pod "3b1de098-372e-4a6b-8354-6728bec00ba7" (UID: "3b1de098-372e-4a6b-8354-6728bec00ba7"). InnerVolumeSpecName "kube-api-access-5vvp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:47.815251 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.815233    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:10:47.899339 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.899308    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vvp9\" (UniqueName: \"kubernetes.io/projected/3b1de098-372e-4a6b-8354-6728bec00ba7-kube-api-access-5vvp9\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:10:47.899339 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.899339    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b1de098-372e-4a6b-8354-6728bec00ba7-extensions-socket-volume\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:10:47.952044 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:47.951996    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"]
Aug 04 16:10:47.954372 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:10:47.954350    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod945c2b7d_e257_4f47_bc1a_cea86a999a45.slice/crio-9666f3cad3d351f6964c161e8a2c925797f3ee5c1897344b7a5833c454f07186 WatchSource:0}: Error finding container 9666f3cad3d351f6964c161e8a2c925797f3ee5c1897344b7a5833c454f07186: Status 404 returned error can't find the container with id 9666f3cad3d351f6964c161e8a2c925797f3ee5c1897344b7a5833c454f07186
Aug 04 16:10:48.646626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:48.646591    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg" event={"ID":"945c2b7d-e257-4f47-bc1a-cea86a999a45","Type":"ContainerStarted","Data":"392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d"}
Aug 04 16:10:48.647045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:48.646650    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg" event={"ID":"945c2b7d-e257-4f47-bc1a-cea86a999a45","Type":"ContainerStarted","Data":"9666f3cad3d351f6964c161e8a2c925797f3ee5c1897344b7a5833c454f07186"}
Aug 04 16:10:48.647045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:48.646786    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:10:48.648077 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:48.648061    2558 scope.go:117] "RemoveContainer" containerID="5d92d82b5bbad42a854fd446d6d4c0c2284759952336af38bb6009341aca8c16"
Aug 04 16:10:48.648179 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:48.648087    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:48.673272 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:48.673234    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg" podStartSLOduration=1.673220913 podStartE2EDuration="1.673220913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:10:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:10:48.67298208 +0000 UTC m=+534.529454924" watchObservedRunningTime="2026-08-04 16:10:48.673220913 +0000 UTC m=+534.529693759"
Aug 04 16:10:48.675640 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:10:48.675611    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7hxcz\" is forbidden: User \"system:node:ip-10-0-141-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-219.ec2.internal' and this object" podUID="3b1de098-372e-4a6b-8354-6728bec00ba7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:48.677989 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:10:48.677969    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-7hxcz\" is forbidden: User \"system:node:ip-10-0-141-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-219.ec2.internal' and this object" podUID="3b1de098-372e-4a6b-8354-6728bec00ba7" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7hxcz"
Aug 04 16:10:48.691984 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:48.691961    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b1de098-372e-4a6b-8354-6728bec00ba7" path="/var/lib/kubelet/pods/3b1de098-372e-4a6b-8354-6728bec00ba7/volumes"
Aug 04 16:10:59.655923 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:10:59.655892    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:11:03.024829 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.024794    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"]
Aug 04 16:11:03.025229 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.024988    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg" podUID="945c2b7d-e257-4f47-bc1a-cea86a999a45" containerName="manager" containerID="cri-o://392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d" gracePeriod=10
Aug 04 16:11:03.264904 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.264881    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:11:03.321361 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.321276    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/945c2b7d-e257-4f47-bc1a-cea86a999a45-extensions-socket-volume\") pod \"945c2b7d-e257-4f47-bc1a-cea86a999a45\" (UID: \"945c2b7d-e257-4f47-bc1a-cea86a999a45\") "
Aug 04 16:11:03.321361 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.321320    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjk52\" (UniqueName: \"kubernetes.io/projected/945c2b7d-e257-4f47-bc1a-cea86a999a45-kube-api-access-tjk52\") pod \"945c2b7d-e257-4f47-bc1a-cea86a999a45\" (UID: \"945c2b7d-e257-4f47-bc1a-cea86a999a45\") "
Aug 04 16:11:03.321723 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.321694    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/945c2b7d-e257-4f47-bc1a-cea86a999a45-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "945c2b7d-e257-4f47-bc1a-cea86a999a45" (UID: "945c2b7d-e257-4f47-bc1a-cea86a999a45"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:11:03.323332 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.323312    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/945c2b7d-e257-4f47-bc1a-cea86a999a45-kube-api-access-tjk52" (OuterVolumeSpecName: "kube-api-access-tjk52") pod "945c2b7d-e257-4f47-bc1a-cea86a999a45" (UID: "945c2b7d-e257-4f47-bc1a-cea86a999a45"). InnerVolumeSpecName "kube-api-access-tjk52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:11:03.422701 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.422669    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/945c2b7d-e257-4f47-bc1a-cea86a999a45-extensions-socket-volume\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:11:03.422701 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.422696    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjk52\" (UniqueName: \"kubernetes.io/projected/945c2b7d-e257-4f47-bc1a-cea86a999a45-kube-api-access-tjk52\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:11:03.711090 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.711056    2558 generic.go:356] "Generic (PLEG): container finished" podID="945c2b7d-e257-4f47-bc1a-cea86a999a45" containerID="392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d" exitCode=0
Aug 04 16:11:03.711289 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.711100    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"
Aug 04 16:11:03.711289 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.711144    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg" event={"ID":"945c2b7d-e257-4f47-bc1a-cea86a999a45","Type":"ContainerDied","Data":"392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d"}
Aug 04 16:11:03.711289 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.711198    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg" event={"ID":"945c2b7d-e257-4f47-bc1a-cea86a999a45","Type":"ContainerDied","Data":"9666f3cad3d351f6964c161e8a2c925797f3ee5c1897344b7a5833c454f07186"}
Aug 04 16:11:03.711289 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.711232    2558 scope.go:117] "RemoveContainer" containerID="392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d"
Aug 04 16:11:03.719292 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.719272    2558 scope.go:117] "RemoveContainer" containerID="392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d"
Aug 04 16:11:03.719517 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:11:03.719500    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d\": container with ID starting with 392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d not found: ID does not exist" containerID="392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d"
Aug 04 16:11:03.719568 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.719524    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d"} err="failed to get container status \"392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d\": rpc error: code = NotFound desc = could not find container \"392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d\": container with ID starting with 392a3d2aeb7066bc0849f62d8a13ae8ba8e33c55598390e4a706b253c8e2252d not found: ID does not exist"
Aug 04 16:11:03.756056 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.756026    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"]
Aug 04 16:11:03.775962 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:03.775932    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-kvvwg"]
Aug 04 16:11:04.691316 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:04.691285    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="945c2b7d-e257-4f47-bc1a-cea86a999a45" path="/var/lib/kubelet/pods/945c2b7d-e257-4f47-bc1a-cea86a999a45/volumes"
Aug 04 16:11:19.407341 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.407306    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"]
Aug 04 16:11:19.407802 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.407593    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="945c2b7d-e257-4f47-bc1a-cea86a999a45" containerName="manager"
Aug 04 16:11:19.407802 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.407603    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="945c2b7d-e257-4f47-bc1a-cea86a999a45" containerName="manager"
Aug 04 16:11:19.407802 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.407646    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="945c2b7d-e257-4f47-bc1a-cea86a999a45" containerName="manager"
Aug 04 16:11:19.409449 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.409433    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.412298 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.412275    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 16:11:19.412428 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.412301    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kkzk2\""
Aug 04 16:11:19.425762 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.425726    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"]
Aug 04 16:11:19.449602 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.449579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.449717 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.449612    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.449717 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.449643    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.449818 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.449771    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.449818 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.449797    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.449899 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.449821    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.449899 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.449841    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgxkn\" (UniqueName: \"kubernetes.io/projected/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-kube-api-access-bgxkn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.449899 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.449878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.450014 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.449913    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.550570 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.550542    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.550689 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.550577    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.550689 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.550618    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.550689 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.550665    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.550893 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.550688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.550893 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.550712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.550893 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.550760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgxkn\" (UniqueName: \"kubernetes.io/projected/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-kube-api-access-bgxkn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.550893 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.550796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.550893 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.550843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.551140 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.551025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.551140 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.551059    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.551295 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.551173    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.551364 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.551346    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.551558 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.551536    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.553337 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.553317    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.553649 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.553628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.561089 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.561064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgxkn\" (UniqueName: \"kubernetes.io/projected/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-kube-api-access-bgxkn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.564023 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.564003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/71e62d3a-85ac-4e7a-ae12-acc423d3ff3b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-tjljz\" (UID: \"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.720015 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.719953    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:19.846657 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:19.846584    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"]
Aug 04 16:11:19.848812 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:11:19.848785    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e62d3a_85ac_4e7a_ae12_acc423d3ff3b.slice/crio-6e11ed688a790dc4b6bc410f81963c439d3df48f20f819a3833572a8b5d30f54 WatchSource:0}: Error finding container 6e11ed688a790dc4b6bc410f81963c439d3df48f20f819a3833572a8b5d30f54: Status 404 returned error can't find the container with id 6e11ed688a790dc4b6bc410f81963c439d3df48f20f819a3833572a8b5d30f54
Aug 04 16:11:20.779062 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:20.779018    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz" event={"ID":"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b","Type":"ContainerStarted","Data":"6e11ed688a790dc4b6bc410f81963c439d3df48f20f819a3833572a8b5d30f54"}
Aug 04 16:11:24.656027 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:24.655992    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:11:24.656287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:24.656066    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:11:24.656287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:24.656095    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:11:24.799067 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:24.799034    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz" event={"ID":"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b","Type":"ContainerStarted","Data":"032d352f6a3996155573e905d51cab626143bd5594b2917724dba5d7295e1edd"}
Aug 04 16:11:24.823038 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:24.822984    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz" podStartSLOduration=1.017943629 podStartE2EDuration="5.82296338s" totalImagesPullingTime="4.805019751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:11:24.822946063 +0000 UTC m=+570.679418908" watchObservedRunningTime="2026-08-04 16:11:24.82296338 +0000 UTC m=+570.679436225"
Aug 04 16:11:25.720569 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:25.720533    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:25.725345 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:25.725321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:25.802843 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:25.802821    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:25.803811 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:25.803793    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:11:34.642758 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.642707    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"]
Aug 04 16:11:34.644879 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.644863    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:34.647801 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.647780    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 04 16:11:34.655633 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.655611    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"]
Aug 04 16:11:34.741229 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.741199    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"]
Aug 04 16:11:34.773446 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.773414    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97c4077b-25de-427e-802f-50d927e80710-config-file\") pod \"limitador-limitador-859c4d96d6-qs6sm\" (UID: \"97c4077b-25de-427e-802f-50d927e80710\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:34.773574 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.773450    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmfcr\" (UniqueName: \"kubernetes.io/projected/97c4077b-25de-427e-802f-50d927e80710-kube-api-access-jmfcr\") pod \"limitador-limitador-859c4d96d6-qs6sm\" (UID: \"97c4077b-25de-427e-802f-50d927e80710\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:34.873996 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.873968    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97c4077b-25de-427e-802f-50d927e80710-config-file\") pod \"limitador-limitador-859c4d96d6-qs6sm\" (UID: \"97c4077b-25de-427e-802f-50d927e80710\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:34.874153 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.874002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmfcr\" (UniqueName: \"kubernetes.io/projected/97c4077b-25de-427e-802f-50d927e80710-kube-api-access-jmfcr\") pod \"limitador-limitador-859c4d96d6-qs6sm\" (UID: \"97c4077b-25de-427e-802f-50d927e80710\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:34.874566 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.874547    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97c4077b-25de-427e-802f-50d927e80710-config-file\") pod \"limitador-limitador-859c4d96d6-qs6sm\" (UID: \"97c4077b-25de-427e-802f-50d927e80710\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:34.883286 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.883263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmfcr\" (UniqueName: \"kubernetes.io/projected/97c4077b-25de-427e-802f-50d927e80710-kube-api-access-jmfcr\") pod \"limitador-limitador-859c4d96d6-qs6sm\" (UID: \"97c4077b-25de-427e-802f-50d927e80710\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:34.955175 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:34.955111    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:35.082029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.082006    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"]
Aug 04 16:11:35.084372 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:11:35.084343    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c4077b_25de_427e_802f_50d927e80710.slice/crio-9708daebf82ec4cd1e9aa45f1dcdacef218fc30991f80bf0682a6921f54d5b48 WatchSource:0}: Error finding container 9708daebf82ec4cd1e9aa45f1dcdacef218fc30991f80bf0682a6921f54d5b48: Status 404 returned error can't find the container with id 9708daebf82ec4cd1e9aa45f1dcdacef218fc30991f80bf0682a6921f54d5b48
Aug 04 16:11:35.471502 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.471468    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-gtq6d"]
Aug 04 16:11:35.474498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.474477    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-gtq6d"
Aug 04 16:11:35.477191 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.477173    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cpjzn\""
Aug 04 16:11:35.484383 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.484363    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-gtq6d"]
Aug 04 16:11:35.580879 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.580842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmf7m\" (UniqueName: \"kubernetes.io/projected/c009982a-27e0-4a47-a987-6ebbcd3e1fe5-kube-api-access-lmf7m\") pod \"authorino-b54df94b4-gtq6d\" (UID: \"c009982a-27e0-4a47-a987-6ebbcd3e1fe5\") " pod="kuadrant-system/authorino-b54df94b4-gtq6d"
Aug 04 16:11:35.600462 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.600426    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-m296q"]
Aug 04 16:11:35.602641 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.602626    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-m296q"
Aug 04 16:11:35.611138 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.611116    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-m296q"]
Aug 04 16:11:35.682340 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.682314    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmf7m\" (UniqueName: \"kubernetes.io/projected/c009982a-27e0-4a47-a987-6ebbcd3e1fe5-kube-api-access-lmf7m\") pod \"authorino-b54df94b4-gtq6d\" (UID: \"c009982a-27e0-4a47-a987-6ebbcd3e1fe5\") " pod="kuadrant-system/authorino-b54df94b4-gtq6d"
Aug 04 16:11:35.682843 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.682368    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpm7s\" (UniqueName: \"kubernetes.io/projected/b6b22101-175f-4551-8e61-d2d22f900b9a-kube-api-access-wpm7s\") pod \"authorino-c548b5d7d-m296q\" (UID: \"b6b22101-175f-4551-8e61-d2d22f900b9a\") " pod="kuadrant-system/authorino-c548b5d7d-m296q"
Aug 04 16:11:35.691616 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.691597    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmf7m\" (UniqueName: \"kubernetes.io/projected/c009982a-27e0-4a47-a987-6ebbcd3e1fe5-kube-api-access-lmf7m\") pod \"authorino-b54df94b4-gtq6d\" (UID: \"c009982a-27e0-4a47-a987-6ebbcd3e1fe5\") " pod="kuadrant-system/authorino-b54df94b4-gtq6d"
Aug 04 16:11:35.783563 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.783493    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpm7s\" (UniqueName: \"kubernetes.io/projected/b6b22101-175f-4551-8e61-d2d22f900b9a-kube-api-access-wpm7s\") pod \"authorino-c548b5d7d-m296q\" (UID: \"b6b22101-175f-4551-8e61-d2d22f900b9a\") " pod="kuadrant-system/authorino-c548b5d7d-m296q"
Aug 04 16:11:35.783698 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.783626    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-gtq6d"
Aug 04 16:11:35.792676 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.792656    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpm7s\" (UniqueName: \"kubernetes.io/projected/b6b22101-175f-4551-8e61-d2d22f900b9a-kube-api-access-wpm7s\") pod \"authorino-c548b5d7d-m296q\" (UID: \"b6b22101-175f-4551-8e61-d2d22f900b9a\") " pod="kuadrant-system/authorino-c548b5d7d-m296q"
Aug 04 16:11:35.862910 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.862876    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm" event={"ID":"97c4077b-25de-427e-802f-50d927e80710","Type":"ContainerStarted","Data":"9708daebf82ec4cd1e9aa45f1dcdacef218fc30991f80bf0682a6921f54d5b48"}
Aug 04 16:11:35.912109 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.912080    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-m296q"
Aug 04 16:11:35.930984 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:35.930960    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-gtq6d"]
Aug 04 16:11:35.933241 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:11:35.933211    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc009982a_27e0_4a47_a987_6ebbcd3e1fe5.slice/crio-2846a0891d6f740defa747d6c5d86f6f2bc1edfccde495cacdb1a4a980b15522 WatchSource:0}: Error finding container 2846a0891d6f740defa747d6c5d86f6f2bc1edfccde495cacdb1a4a980b15522: Status 404 returned error can't find the container with id 2846a0891d6f740defa747d6c5d86f6f2bc1edfccde495cacdb1a4a980b15522
Aug 04 16:11:36.038958 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:36.038895    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-m296q"]
Aug 04 16:11:36.041266 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:11:36.041226    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6b22101_175f_4551_8e61_d2d22f900b9a.slice/crio-da88d039577f0a73f97bd4cb0486421224d6a58e33b1b086120bd9edc7b8955e WatchSource:0}: Error finding container da88d039577f0a73f97bd4cb0486421224d6a58e33b1b086120bd9edc7b8955e: Status 404 returned error can't find the container with id da88d039577f0a73f97bd4cb0486421224d6a58e33b1b086120bd9edc7b8955e
Aug 04 16:11:36.871162 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:36.871124    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-gtq6d" event={"ID":"c009982a-27e0-4a47-a987-6ebbcd3e1fe5","Type":"ContainerStarted","Data":"2846a0891d6f740defa747d6c5d86f6f2bc1edfccde495cacdb1a4a980b15522"}
Aug 04 16:11:36.873003 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:36.872973    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-m296q" event={"ID":"b6b22101-175f-4551-8e61-d2d22f900b9a","Type":"ContainerStarted","Data":"da88d039577f0a73f97bd4cb0486421224d6a58e33b1b086120bd9edc7b8955e"}
Aug 04 16:11:36.875500 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:36.875475    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm" event={"ID":"97c4077b-25de-427e-802f-50d927e80710","Type":"ContainerStarted","Data":"5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105"}
Aug 04 16:11:36.876282 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:36.876262    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:36.896416 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:36.896367    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm" podStartSLOduration=1.564187129 podStartE2EDuration="2.896331616s" totalImagesPullingTime="1.332144487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:11:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:11:36.894715778 +0000 UTC m=+582.751188623" watchObservedRunningTime="2026-08-04 16:11:36.896331616 +0000 UTC m=+582.752804459"
Aug 04 16:11:38.888042 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:38.888003    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-m296q" event={"ID":"b6b22101-175f-4551-8e61-d2d22f900b9a","Type":"ContainerStarted","Data":"98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8"}
Aug 04 16:11:38.889382 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:38.889352    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-gtq6d" event={"ID":"c009982a-27e0-4a47-a987-6ebbcd3e1fe5","Type":"ContainerStarted","Data":"c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103"}
Aug 04 16:11:38.906032 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:38.905989    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-m296q" podStartSLOduration=1.838530557 podStartE2EDuration="3.905976843s" totalImagesPullingTime="2.067446286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:11:38.905686166 +0000 UTC m=+584.762159012" watchObservedRunningTime="2026-08-04 16:11:38.905976843 +0000 UTC m=+584.762449687"
Aug 04 16:11:38.924437 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:38.924377    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-gtq6d" podStartSLOduration=1.739572728 podStartE2EDuration="3.924359054s" totalImagesPullingTime="2.184786326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:11:38.92381956 +0000 UTC m=+584.780292405" watchObservedRunningTime="2026-08-04 16:11:38.924359054 +0000 UTC m=+584.780831902"
Aug 04 16:11:38.951572 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:38.951532    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-gtq6d"]
Aug 04 16:11:40.897974 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:40.897937    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-gtq6d" podUID="c009982a-27e0-4a47-a987-6ebbcd3e1fe5" containerName="authorino" containerID="cri-o://c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103" gracePeriod=30
Aug 04 16:11:41.142319 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.142291    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-gtq6d"
Aug 04 16:11:41.227430 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.227359    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmf7m\" (UniqueName: \"kubernetes.io/projected/c009982a-27e0-4a47-a987-6ebbcd3e1fe5-kube-api-access-lmf7m\") pod \"c009982a-27e0-4a47-a987-6ebbcd3e1fe5\" (UID: \"c009982a-27e0-4a47-a987-6ebbcd3e1fe5\") "
Aug 04 16:11:41.229378 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.229350    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c009982a-27e0-4a47-a987-6ebbcd3e1fe5-kube-api-access-lmf7m" (OuterVolumeSpecName: "kube-api-access-lmf7m") pod "c009982a-27e0-4a47-a987-6ebbcd3e1fe5" (UID: "c009982a-27e0-4a47-a987-6ebbcd3e1fe5"). InnerVolumeSpecName "kube-api-access-lmf7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:11:41.328283 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.328261    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmf7m\" (UniqueName: \"kubernetes.io/projected/c009982a-27e0-4a47-a987-6ebbcd3e1fe5-kube-api-access-lmf7m\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:11:41.902730 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.902699    2558 generic.go:356] "Generic (PLEG): container finished" podID="c009982a-27e0-4a47-a987-6ebbcd3e1fe5" containerID="c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103" exitCode=0
Aug 04 16:11:41.903128 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.902742    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-gtq6d"
Aug 04 16:11:41.903128 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.902784    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-gtq6d" event={"ID":"c009982a-27e0-4a47-a987-6ebbcd3e1fe5","Type":"ContainerDied","Data":"c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103"}
Aug 04 16:11:41.903128 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.902828    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-gtq6d" event={"ID":"c009982a-27e0-4a47-a987-6ebbcd3e1fe5","Type":"ContainerDied","Data":"2846a0891d6f740defa747d6c5d86f6f2bc1edfccde495cacdb1a4a980b15522"}
Aug 04 16:11:41.903128 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.902847    2558 scope.go:117] "RemoveContainer" containerID="c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103"
Aug 04 16:11:41.910566 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.910547    2558 scope.go:117] "RemoveContainer" containerID="c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103"
Aug 04 16:11:41.910881 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:11:41.910863    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103\": container with ID starting with c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103 not found: ID does not exist" containerID="c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103"
Aug 04 16:11:41.910959 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.910892    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103"} err="failed to get container status \"c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103\": rpc error: code = NotFound desc = could not find container \"c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103\": container with ID starting with c46dca6bf2b0bd27512d4db686c265b8833c04b2e46f3e0bf0167a7f21a4e103 not found: ID does not exist"
Aug 04 16:11:41.923741 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.923721    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-gtq6d"]
Aug 04 16:11:41.927682 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:41.927665    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-gtq6d"]
Aug 04 16:11:42.692688 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:42.692656    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c009982a-27e0-4a47-a987-6ebbcd3e1fe5" path="/var/lib/kubelet/pods/c009982a-27e0-4a47-a987-6ebbcd3e1fe5/volumes"
Aug 04 16:11:47.984048 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:47.984010    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"]
Aug 04 16:11:47.984489 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:47.984255    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm" podUID="97c4077b-25de-427e-802f-50d927e80710" containerName="limitador" containerID="cri-o://5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105" gracePeriod=30
Aug 04 16:11:47.984949 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:47.984931    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:48.515059 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.515037    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:48.689002 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.688973    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmfcr\" (UniqueName: \"kubernetes.io/projected/97c4077b-25de-427e-802f-50d927e80710-kube-api-access-jmfcr\") pod \"97c4077b-25de-427e-802f-50d927e80710\" (UID: \"97c4077b-25de-427e-802f-50d927e80710\") "
Aug 04 16:11:48.689191 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.689040    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97c4077b-25de-427e-802f-50d927e80710-config-file\") pod \"97c4077b-25de-427e-802f-50d927e80710\" (UID: \"97c4077b-25de-427e-802f-50d927e80710\") "
Aug 04 16:11:48.689378 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.689354    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97c4077b-25de-427e-802f-50d927e80710-config-file" (OuterVolumeSpecName: "config-file") pod "97c4077b-25de-427e-802f-50d927e80710" (UID: "97c4077b-25de-427e-802f-50d927e80710"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:11:48.691199 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.691163    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97c4077b-25de-427e-802f-50d927e80710-kube-api-access-jmfcr" (OuterVolumeSpecName: "kube-api-access-jmfcr") pod "97c4077b-25de-427e-802f-50d927e80710" (UID: "97c4077b-25de-427e-802f-50d927e80710"). InnerVolumeSpecName "kube-api-access-jmfcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:11:48.790257 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.790230    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/97c4077b-25de-427e-802f-50d927e80710-config-file\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:11:48.790257 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.790254    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmfcr\" (UniqueName: \"kubernetes.io/projected/97c4077b-25de-427e-802f-50d927e80710-kube-api-access-jmfcr\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:11:48.933315 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.933273    2558 generic.go:356] "Generic (PLEG): container finished" podID="97c4077b-25de-427e-802f-50d927e80710" containerID="5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105" exitCode=0
Aug 04 16:11:48.933460 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.933337    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"
Aug 04 16:11:48.933460 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.933357    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm" event={"ID":"97c4077b-25de-427e-802f-50d927e80710","Type":"ContainerDied","Data":"5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105"}
Aug 04 16:11:48.933460 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.933411    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-qs6sm" event={"ID":"97c4077b-25de-427e-802f-50d927e80710","Type":"ContainerDied","Data":"9708daebf82ec4cd1e9aa45f1dcdacef218fc30991f80bf0682a6921f54d5b48"}
Aug 04 16:11:48.933460 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.933434    2558 scope.go:117] "RemoveContainer" containerID="5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105"
Aug 04 16:11:48.941372 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.941353    2558 scope.go:117] "RemoveContainer" containerID="5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105"
Aug 04 16:11:48.941640 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:11:48.941616    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105\": container with ID starting with 5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105 not found: ID does not exist" containerID="5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105"
Aug 04 16:11:48.941686 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.941649    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105"} err="failed to get container status \"5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105\": rpc error: code = NotFound desc = could not find container \"5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105\": container with ID starting with 5d09a19fcbaf814e1dd90a5a607f22b5ae2508755ba945ca6248cc135180f105 not found: ID does not exist"
Aug 04 16:11:48.952223 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.952204    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"]
Aug 04 16:11:48.954277 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:48.954259    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-qs6sm"]
Aug 04 16:11:50.692268 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:50.692236    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97c4077b-25de-427e-802f-50d927e80710" path="/var/lib/kubelet/pods/97c4077b-25de-427e-802f-50d927e80710/volumes"
Aug 04 16:11:52.732512 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.732481    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"]
Aug 04 16:11:52.732874 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.732802    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c4077b-25de-427e-802f-50d927e80710" containerName="limitador"
Aug 04 16:11:52.732874 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.732814    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c4077b-25de-427e-802f-50d927e80710" containerName="limitador"
Aug 04 16:11:52.732874 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.732824    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c009982a-27e0-4a47-a987-6ebbcd3e1fe5" containerName="authorino"
Aug 04 16:11:52.732874 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.732829    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c009982a-27e0-4a47-a987-6ebbcd3e1fe5" containerName="authorino"
Aug 04 16:11:52.732874 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.732873    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c4077b-25de-427e-802f-50d927e80710" containerName="limitador"
Aug 04 16:11:52.733036 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.732881    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c009982a-27e0-4a47-a987-6ebbcd3e1fe5" containerName="authorino"
Aug 04 16:11:52.736072 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.736047    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"
Aug 04 16:11:52.739051 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.739017    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 16:11:52.739051 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.739022    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 04 16:11:52.739224 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.739150    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-gwjs4\""
Aug 04 16:11:52.740475 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.740462    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 16:11:52.746854 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.746837    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"]
Aug 04 16:11:52.923295 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.923256    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3d140e1c-6f4b-42cc-adbf-bd22a80a18ec-data\") pod \"postgres-69fb4594cf-kddzk\" (UID: \"3d140e1c-6f4b-42cc-adbf-bd22a80a18ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"
Aug 04 16:11:52.923466 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:52.923315    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4m4s\" (UniqueName: \"kubernetes.io/projected/3d140e1c-6f4b-42cc-adbf-bd22a80a18ec-kube-api-access-n4m4s\") pod \"postgres-69fb4594cf-kddzk\" (UID: \"3d140e1c-6f4b-42cc-adbf-bd22a80a18ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"
Aug 04 16:11:53.024308 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:53.024210    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4m4s\" (UniqueName: \"kubernetes.io/projected/3d140e1c-6f4b-42cc-adbf-bd22a80a18ec-kube-api-access-n4m4s\") pod \"postgres-69fb4594cf-kddzk\" (UID: \"3d140e1c-6f4b-42cc-adbf-bd22a80a18ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"
Aug 04 16:11:53.024308 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:53.024314    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3d140e1c-6f4b-42cc-adbf-bd22a80a18ec-data\") pod \"postgres-69fb4594cf-kddzk\" (UID: \"3d140e1c-6f4b-42cc-adbf-bd22a80a18ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"
Aug 04 16:11:53.024690 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:53.024673    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3d140e1c-6f4b-42cc-adbf-bd22a80a18ec-data\") pod \"postgres-69fb4594cf-kddzk\" (UID: \"3d140e1c-6f4b-42cc-adbf-bd22a80a18ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"
Aug 04 16:11:53.033517 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:53.033493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4m4s\" (UniqueName: \"kubernetes.io/projected/3d140e1c-6f4b-42cc-adbf-bd22a80a18ec-kube-api-access-n4m4s\") pod \"postgres-69fb4594cf-kddzk\" (UID: \"3d140e1c-6f4b-42cc-adbf-bd22a80a18ec\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"
Aug 04 16:11:53.047417 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:53.047395    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"
Aug 04 16:11:53.176850 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:53.176823    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"]
Aug 04 16:11:53.179013 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:11:53.178988    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d140e1c_6f4b_42cc_adbf_bd22a80a18ec.slice/crio-4b6233314d6c7d8c4e245942e257f4a994c5721c72526bfb7e216c7f985e238d WatchSource:0}: Error finding container 4b6233314d6c7d8c4e245942e257f4a994c5721c72526bfb7e216c7f985e238d: Status 404 returned error can't find the container with id 4b6233314d6c7d8c4e245942e257f4a994c5721c72526bfb7e216c7f985e238d
Aug 04 16:11:53.960711 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:53.960677    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk" event={"ID":"3d140e1c-6f4b-42cc-adbf-bd22a80a18ec","Type":"ContainerStarted","Data":"4b6233314d6c7d8c4e245942e257f4a994c5721c72526bfb7e216c7f985e238d"}
Aug 04 16:11:54.550263 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:54.550238    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:11:54.550416 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:54.550317    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:11:58.400355 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:58.400325    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 04 16:11:58.986216 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:58.986183    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk" event={"ID":"3d140e1c-6f4b-42cc-adbf-bd22a80a18ec","Type":"ContainerStarted","Data":"a2ad939c4959ea8e3630c17430d28e365a73aeae84ab20ca3bef71bf0fd011ee"}
Aug 04 16:11:58.986407 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:58.986316    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"
Aug 04 16:11:59.007629 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:11:59.007584    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk" podStartSLOduration=1.7913098280000002 podStartE2EDuration="7.007568852s" totalImagesPullingTime="5.216259024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:11:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:11:59.005727204 +0000 UTC m=+604.862200049" watchObservedRunningTime="2026-08-04 16:11:59.007568852 +0000 UTC m=+604.864041695"
Aug 04 16:12:05.021380 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.021351    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-kddzk"
Aug 04 16:12:05.602799 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.602763    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-qbwmp"]
Aug 04 16:12:05.606120 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.606104    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-qbwmp"
Aug 04 16:12:05.624255 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.624230    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-qbwmp"]
Aug 04 16:12:05.640825 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.640802    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkdfd\" (UniqueName: \"kubernetes.io/projected/73a68f28-1484-427f-8e27-6d17559e1ccb-kube-api-access-pkdfd\") pod \"authorino-5dc7ccb5f-qbwmp\" (UID: \"73a68f28-1484-427f-8e27-6d17559e1ccb\") " pod="kuadrant-system/authorino-5dc7ccb5f-qbwmp"
Aug 04 16:12:05.706711 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.706671    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-qbwmp"]
Aug 04 16:12:05.706977 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:12:05.706953    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pkdfd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-qbwmp" podUID="73a68f28-1484-427f-8e27-6d17559e1ccb"
Aug 04 16:12:05.741672 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.741644    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkdfd\" (UniqueName: \"kubernetes.io/projected/73a68f28-1484-427f-8e27-6d17559e1ccb-kube-api-access-pkdfd\") pod \"authorino-5dc7ccb5f-qbwmp\" (UID: \"73a68f28-1484-427f-8e27-6d17559e1ccb\") " pod="kuadrant-system/authorino-5dc7ccb5f-qbwmp"
Aug 04 16:12:05.751413 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.751393    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-56f69"]
Aug 04 16:12:05.754424 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.754407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-56f69"
Aug 04 16:12:05.757954 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.757926    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 04 16:12:05.759653 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.759631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkdfd\" (UniqueName: \"kubernetes.io/projected/73a68f28-1484-427f-8e27-6d17559e1ccb-kube-api-access-pkdfd\") pod \"authorino-5dc7ccb5f-qbwmp\" (UID: \"73a68f28-1484-427f-8e27-6d17559e1ccb\") " pod="kuadrant-system/authorino-5dc7ccb5f-qbwmp"
Aug 04 16:12:05.770044 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.770022    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-56f69"]
Aug 04 16:12:05.842166 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.842144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-tls-cert\") pod \"authorino-687bd45585-56f69\" (UID: \"0f6834b0-6885-4fc1-a8cb-2e89ea091e30\") " pod="kuadrant-system/authorino-687bd45585-56f69"
Aug 04 16:12:05.842277 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.842222    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfdjn\" (UniqueName: \"kubernetes.io/projected/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-kube-api-access-bfdjn\") pod \"authorino-687bd45585-56f69\" (UID: \"0f6834b0-6885-4fc1-a8cb-2e89ea091e30\") " pod="kuadrant-system/authorino-687bd45585-56f69"
Aug 04 16:12:05.895562 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.895536    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-56f69"]
Aug 04 16:12:05.895767 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:12:05.895733    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bfdjn tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-56f69" podUID="0f6834b0-6885-4fc1-a8cb-2e89ea091e30"
Aug 04 16:12:05.943222 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.943194    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfdjn\" (UniqueName: \"kubernetes.io/projected/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-kube-api-access-bfdjn\") pod \"authorino-687bd45585-56f69\" (UID: \"0f6834b0-6885-4fc1-a8cb-2e89ea091e30\") " pod="kuadrant-system/authorino-687bd45585-56f69"
Aug 04 16:12:05.943313 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.943241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-tls-cert\") pod \"authorino-687bd45585-56f69\" (UID: \"0f6834b0-6885-4fc1-a8cb-2e89ea091e30\") " pod="kuadrant-system/authorino-687bd45585-56f69"
Aug 04 16:12:05.945583 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.945555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-tls-cert\") pod \"authorino-687bd45585-56f69\" (UID: \"0f6834b0-6885-4fc1-a8cb-2e89ea091e30\") " pod="kuadrant-system/authorino-687bd45585-56f69"
Aug 04 16:12:05.957586 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.957564    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-dd7b7b64c-wfzts"]
Aug 04 16:12:05.960524 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.960511    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd7b7b64c-wfzts"
Aug 04 16:12:05.963990 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.963966    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfdjn\" (UniqueName: \"kubernetes.io/projected/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-kube-api-access-bfdjn\") pod \"authorino-687bd45585-56f69\" (UID: \"0f6834b0-6885-4fc1-a8cb-2e89ea091e30\") " pod="kuadrant-system/authorino-687bd45585-56f69"
Aug 04 16:12:05.980810 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:05.980787    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dd7b7b64c-wfzts"]
Aug 04 16:12:06.015167 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.015141    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-qbwmp"
Aug 04 16:12:06.015273 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.015149    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-56f69"
Aug 04 16:12:06.021422 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.021396    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-qbwmp"
Aug 04 16:12:06.024110 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.024090    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-56f69"
Aug 04 16:12:06.044459 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.044434    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7lfr\" (UniqueName: \"kubernetes.io/projected/a0c16309-c931-42cd-b869-5abed1920e03-kube-api-access-m7lfr\") pod \"authorino-dd7b7b64c-wfzts\" (UID: \"a0c16309-c931-42cd-b869-5abed1920e03\") " pod="kuadrant-system/authorino-dd7b7b64c-wfzts"
Aug 04 16:12:06.044682 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.044476    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a0c16309-c931-42cd-b869-5abed1920e03-tls-cert\") pod \"authorino-dd7b7b64c-wfzts\" (UID: \"a0c16309-c931-42cd-b869-5abed1920e03\") " pod="kuadrant-system/authorino-dd7b7b64c-wfzts"
Aug 04 16:12:06.145372 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.145354    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkdfd\" (UniqueName: \"kubernetes.io/projected/73a68f28-1484-427f-8e27-6d17559e1ccb-kube-api-access-pkdfd\") pod \"73a68f28-1484-427f-8e27-6d17559e1ccb\" (UID: \"73a68f28-1484-427f-8e27-6d17559e1ccb\") "
Aug 04 16:12:06.145479 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.145410    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-tls-cert\") pod \"0f6834b0-6885-4fc1-a8cb-2e89ea091e30\" (UID: \"0f6834b0-6885-4fc1-a8cb-2e89ea091e30\") "
Aug 04 16:12:06.145479 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.145431    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfdjn\" (UniqueName: \"kubernetes.io/projected/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-kube-api-access-bfdjn\") pod \"0f6834b0-6885-4fc1-a8cb-2e89ea091e30\" (UID: \"0f6834b0-6885-4fc1-a8cb-2e89ea091e30\") "
Aug 04 16:12:06.145586 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.145543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a0c16309-c931-42cd-b869-5abed1920e03-tls-cert\") pod \"authorino-dd7b7b64c-wfzts\" (UID: \"a0c16309-c931-42cd-b869-5abed1920e03\") " pod="kuadrant-system/authorino-dd7b7b64c-wfzts"
Aug 04 16:12:06.145665 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.145648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7lfr\" (UniqueName: \"kubernetes.io/projected/a0c16309-c931-42cd-b869-5abed1920e03-kube-api-access-m7lfr\") pod \"authorino-dd7b7b64c-wfzts\" (UID: \"a0c16309-c931-42cd-b869-5abed1920e03\") " pod="kuadrant-system/authorino-dd7b7b64c-wfzts"
Aug 04 16:12:06.147500 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.147468    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0f6834b0-6885-4fc1-a8cb-2e89ea091e30" (UID: "0f6834b0-6885-4fc1-a8cb-2e89ea091e30"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:12:06.147500 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.147491    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73a68f28-1484-427f-8e27-6d17559e1ccb-kube-api-access-pkdfd" (OuterVolumeSpecName: "kube-api-access-pkdfd") pod "73a68f28-1484-427f-8e27-6d17559e1ccb" (UID: "73a68f28-1484-427f-8e27-6d17559e1ccb"). InnerVolumeSpecName "kube-api-access-pkdfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:12:06.147654 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.147514    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-kube-api-access-bfdjn" (OuterVolumeSpecName: "kube-api-access-bfdjn") pod "0f6834b0-6885-4fc1-a8cb-2e89ea091e30" (UID: "0f6834b0-6885-4fc1-a8cb-2e89ea091e30"). InnerVolumeSpecName "kube-api-access-bfdjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:12:06.147876 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.147858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a0c16309-c931-42cd-b869-5abed1920e03-tls-cert\") pod \"authorino-dd7b7b64c-wfzts\" (UID: \"a0c16309-c931-42cd-b869-5abed1920e03\") " pod="kuadrant-system/authorino-dd7b7b64c-wfzts"
Aug 04 16:12:06.155459 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.155438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7lfr\" (UniqueName: \"kubernetes.io/projected/a0c16309-c931-42cd-b869-5abed1920e03-kube-api-access-m7lfr\") pod \"authorino-dd7b7b64c-wfzts\" (UID: \"a0c16309-c931-42cd-b869-5abed1920e03\") " pod="kuadrant-system/authorino-dd7b7b64c-wfzts"
Aug 04 16:12:06.246752 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.246728    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-tls-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:12:06.246844 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.246768    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfdjn\" (UniqueName: \"kubernetes.io/projected/0f6834b0-6885-4fc1-a8cb-2e89ea091e30-kube-api-access-bfdjn\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:12:06.246844 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.246779    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkdfd\" (UniqueName: \"kubernetes.io/projected/73a68f28-1484-427f-8e27-6d17559e1ccb-kube-api-access-pkdfd\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:12:06.277688 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.277668    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd7b7b64c-wfzts"
Aug 04 16:12:06.412373 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:06.412346    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-dd7b7b64c-wfzts"]
Aug 04 16:12:06.414386 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:12:06.414358    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0c16309_c931_42cd_b869_5abed1920e03.slice/crio-5e53f9d6ad30af0940f87fa181287b0f51349f32812f0026a9fcf278f6870932 WatchSource:0}: Error finding container 5e53f9d6ad30af0940f87fa181287b0f51349f32812f0026a9fcf278f6870932: Status 404 returned error can't find the container with id 5e53f9d6ad30af0940f87fa181287b0f51349f32812f0026a9fcf278f6870932
Aug 04 16:12:07.020792 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:07.020688    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-56f69"
Aug 04 16:12:07.020792 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:07.020679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dd7b7b64c-wfzts" event={"ID":"a0c16309-c931-42cd-b869-5abed1920e03","Type":"ContainerStarted","Data":"5e53f9d6ad30af0940f87fa181287b0f51349f32812f0026a9fcf278f6870932"}
Aug 04 16:12:07.021022 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:07.020697    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-qbwmp"
Aug 04 16:12:07.061633 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:07.061608    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-56f69"]
Aug 04 16:12:07.065998 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:07.065977    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-56f69"]
Aug 04 16:12:07.092789 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:07.092763    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-qbwmp"]
Aug 04 16:12:07.097026 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:07.097008    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-qbwmp"]
Aug 04 16:12:08.025866 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:08.025832    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dd7b7b64c-wfzts" event={"ID":"a0c16309-c931-42cd-b869-5abed1920e03","Type":"ContainerStarted","Data":"158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe"}
Aug 04 16:12:08.051028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:08.047590    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-dd7b7b64c-wfzts" podStartSLOduration=2.092576907 podStartE2EDuration="3.047560407s" totalImagesPullingTime="954.9835ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:12:08.045214011 +0000 UTC m=+613.901686855" watchObservedRunningTime="2026-08-04 16:12:08.047560407 +0000 UTC m=+613.904033254"
Aug 04 16:12:08.080112 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:08.080082    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-m296q"]
Aug 04 16:12:08.080485 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:08.080248    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-m296q" podUID="b6b22101-175f-4551-8e61-d2d22f900b9a" containerName="authorino" containerID="cri-o://98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8" gracePeriod=30
Aug 04 16:12:08.312656 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:08.312632    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-m296q"
Aug 04 16:12:08.365421 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:08.365389    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpm7s\" (UniqueName: \"kubernetes.io/projected/b6b22101-175f-4551-8e61-d2d22f900b9a-kube-api-access-wpm7s\") pod \"b6b22101-175f-4551-8e61-d2d22f900b9a\" (UID: \"b6b22101-175f-4551-8e61-d2d22f900b9a\") "
Aug 04 16:12:08.367322 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:08.367294    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b22101-175f-4551-8e61-d2d22f900b9a-kube-api-access-wpm7s" (OuterVolumeSpecName: "kube-api-access-wpm7s") pod "b6b22101-175f-4551-8e61-d2d22f900b9a" (UID: "b6b22101-175f-4551-8e61-d2d22f900b9a"). InnerVolumeSpecName "kube-api-access-wpm7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:12:08.465943 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:08.465920    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpm7s\" (UniqueName: \"kubernetes.io/projected/b6b22101-175f-4551-8e61-d2d22f900b9a-kube-api-access-wpm7s\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:12:08.691988 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:08.691955    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f6834b0-6885-4fc1-a8cb-2e89ea091e30" path="/var/lib/kubelet/pods/0f6834b0-6885-4fc1-a8cb-2e89ea091e30/volumes"
Aug 04 16:12:08.692255 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:08.692236    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73a68f28-1484-427f-8e27-6d17559e1ccb" path="/var/lib/kubelet/pods/73a68f28-1484-427f-8e27-6d17559e1ccb/volumes"
Aug 04 16:12:09.031111 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:09.031026    2558 generic.go:356] "Generic (PLEG): container finished" podID="b6b22101-175f-4551-8e61-d2d22f900b9a" containerID="98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8" exitCode=0
Aug 04 16:12:09.031111 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:09.031068    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-m296q"
Aug 04 16:12:09.031302 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:09.031114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-m296q" event={"ID":"b6b22101-175f-4551-8e61-d2d22f900b9a","Type":"ContainerDied","Data":"98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8"}
Aug 04 16:12:09.031302 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:09.031156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-m296q" event={"ID":"b6b22101-175f-4551-8e61-d2d22f900b9a","Type":"ContainerDied","Data":"da88d039577f0a73f97bd4cb0486421224d6a58e33b1b086120bd9edc7b8955e"}
Aug 04 16:12:09.031302 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:09.031173    2558 scope.go:117] "RemoveContainer" containerID="98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8"
Aug 04 16:12:09.039512 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:09.039496    2558 scope.go:117] "RemoveContainer" containerID="98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8"
Aug 04 16:12:09.039782 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:12:09.039763    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8\": container with ID starting with 98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8 not found: ID does not exist" containerID="98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8"
Aug 04 16:12:09.039835 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:09.039791    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8"} err="failed to get container status \"98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8\": rpc error: code = NotFound desc = could not find container \"98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8\": container with ID starting with 98676d24567d0d51f64eadd5d9fb0a80386508488275718c61263aa647d55cb8 not found: ID does not exist"
Aug 04 16:12:09.053247 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:09.053219    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-m296q"]
Aug 04 16:12:09.057455 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:09.057432    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-m296q"]
Aug 04 16:12:10.692636 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:10.692602    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6b22101-175f-4551-8e61-d2d22f900b9a" path="/var/lib/kubelet/pods/b6b22101-175f-4551-8e61-d2d22f900b9a/volumes"
Aug 04 16:12:13.038696 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.038661    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f8c96b8bc-rrnhg"]
Aug 04 16:12:13.039090 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.038978    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b22101-175f-4551-8e61-d2d22f900b9a" containerName="authorino"
Aug 04 16:12:13.039090 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.038991    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b22101-175f-4551-8e61-d2d22f900b9a" containerName="authorino"
Aug 04 16:12:13.039090 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.039050    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6b22101-175f-4551-8e61-d2d22f900b9a" containerName="authorino"
Aug 04 16:12:13.042925 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.042907    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:13.046019 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.045997    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-kqxq7\""
Aug 04 16:12:13.046124 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.046001    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 16:12:13.046183 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.046147    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 16:12:13.054236 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.054213    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f8c96b8bc-rrnhg"]
Aug 04 16:12:13.103899 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.103867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n27d8\" (UniqueName: \"kubernetes.io/projected/3f492dd1-45ec-4f47-adce-71c494c85d56-kube-api-access-n27d8\") pod \"maas-controller-6f8c96b8bc-rrnhg\" (UID: \"3f492dd1-45ec-4f47-adce-71c494c85d56\") " pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:13.104066 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.103998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f492dd1-45ec-4f47-adce-71c494c85d56-webhook-cert\") pod \"maas-controller-6f8c96b8bc-rrnhg\" (UID: \"3f492dd1-45ec-4f47-adce-71c494c85d56\") " pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:13.205327 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.205296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f492dd1-45ec-4f47-adce-71c494c85d56-webhook-cert\") pod \"maas-controller-6f8c96b8bc-rrnhg\" (UID: \"3f492dd1-45ec-4f47-adce-71c494c85d56\") " pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:13.205481 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.205348    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n27d8\" (UniqueName: \"kubernetes.io/projected/3f492dd1-45ec-4f47-adce-71c494c85d56-kube-api-access-n27d8\") pod \"maas-controller-6f8c96b8bc-rrnhg\" (UID: \"3f492dd1-45ec-4f47-adce-71c494c85d56\") " pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:13.207742 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.207721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f492dd1-45ec-4f47-adce-71c494c85d56-webhook-cert\") pod \"maas-controller-6f8c96b8bc-rrnhg\" (UID: \"3f492dd1-45ec-4f47-adce-71c494c85d56\") " pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:13.214538 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.214512    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n27d8\" (UniqueName: \"kubernetes.io/projected/3f492dd1-45ec-4f47-adce-71c494c85d56-kube-api-access-n27d8\") pod \"maas-controller-6f8c96b8bc-rrnhg\" (UID: \"3f492dd1-45ec-4f47-adce-71c494c85d56\") " pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:13.353550 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.353465    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:13.481114 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:13.481066    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f8c96b8bc-rrnhg"]
Aug 04 16:12:13.483600 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:12:13.483574    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f492dd1_45ec_4f47_adce_71c494c85d56.slice/crio-97c078277de41ff809686cfd12693e612e4ae5dc1b1725e11503bff959a4ff1f WatchSource:0}: Error finding container 97c078277de41ff809686cfd12693e612e4ae5dc1b1725e11503bff959a4ff1f: Status 404 returned error can't find the container with id 97c078277de41ff809686cfd12693e612e4ae5dc1b1725e11503bff959a4ff1f
Aug 04 16:12:14.054227 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:14.054194    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg" event={"ID":"3f492dd1-45ec-4f47-adce-71c494c85d56","Type":"ContainerStarted","Data":"97c078277de41ff809686cfd12693e612e4ae5dc1b1725e11503bff959a4ff1f"}
Aug 04 16:12:16.065453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:16.065417    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg" event={"ID":"3f492dd1-45ec-4f47-adce-71c494c85d56","Type":"ContainerStarted","Data":"144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62"}
Aug 04 16:12:16.065940 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:16.065567    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:16.087805 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:16.087727    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg" podStartSLOduration=0.650108428 podStartE2EDuration="3.087710898s" totalImagesPullingTime="2.43760247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:12:16.086829142 +0000 UTC m=+621.943301986" watchObservedRunningTime="2026-08-04 16:12:16.087710898 +0000 UTC m=+621.944183741"
Aug 04 16:12:27.072565 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:27.072531    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:27.489368 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:27.489332    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f8c96b8bc-rrnhg"]
Aug 04 16:12:27.489590 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:27.489549    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg" podUID="3f492dd1-45ec-4f47-adce-71c494c85d56" containerName="manager" containerID="cri-o://144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62" gracePeriod=30
Aug 04 16:12:27.730430 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:27.730406    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:27.841810 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:27.841708    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f492dd1-45ec-4f47-adce-71c494c85d56-webhook-cert\") pod \"3f492dd1-45ec-4f47-adce-71c494c85d56\" (UID: \"3f492dd1-45ec-4f47-adce-71c494c85d56\") "
Aug 04 16:12:27.841945 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:27.841830    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n27d8\" (UniqueName: \"kubernetes.io/projected/3f492dd1-45ec-4f47-adce-71c494c85d56-kube-api-access-n27d8\") pod \"3f492dd1-45ec-4f47-adce-71c494c85d56\" (UID: \"3f492dd1-45ec-4f47-adce-71c494c85d56\") "
Aug 04 16:12:27.843983 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:27.843941    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f492dd1-45ec-4f47-adce-71c494c85d56-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3f492dd1-45ec-4f47-adce-71c494c85d56" (UID: "3f492dd1-45ec-4f47-adce-71c494c85d56"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:12:27.843983 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:27.843975    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f492dd1-45ec-4f47-adce-71c494c85d56-kube-api-access-n27d8" (OuterVolumeSpecName: "kube-api-access-n27d8") pod "3f492dd1-45ec-4f47-adce-71c494c85d56" (UID: "3f492dd1-45ec-4f47-adce-71c494c85d56"). InnerVolumeSpecName "kube-api-access-n27d8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:12:27.943529 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:27.943489    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f492dd1-45ec-4f47-adce-71c494c85d56-webhook-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:12:27.943529 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:27.943523    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n27d8\" (UniqueName: \"kubernetes.io/projected/3f492dd1-45ec-4f47-adce-71c494c85d56-kube-api-access-n27d8\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:12:28.116233 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:28.116201    2558 generic.go:356] "Generic (PLEG): container finished" podID="3f492dd1-45ec-4f47-adce-71c494c85d56" containerID="144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62" exitCode=0
Aug 04 16:12:28.116689 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:28.116241    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg"
Aug 04 16:12:28.116689 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:28.116296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg" event={"ID":"3f492dd1-45ec-4f47-adce-71c494c85d56","Type":"ContainerDied","Data":"144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62"}
Aug 04 16:12:28.116689 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:28.116359    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f8c96b8bc-rrnhg" event={"ID":"3f492dd1-45ec-4f47-adce-71c494c85d56","Type":"ContainerDied","Data":"97c078277de41ff809686cfd12693e612e4ae5dc1b1725e11503bff959a4ff1f"}
Aug 04 16:12:28.116689 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:28.116392    2558 scope.go:117] "RemoveContainer" containerID="144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62"
Aug 04 16:12:28.125107 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:28.125093    2558 scope.go:117] "RemoveContainer" containerID="144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62"
Aug 04 16:12:28.125361 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:12:28.125343    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62\": container with ID starting with 144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62 not found: ID does not exist" containerID="144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62"
Aug 04 16:12:28.125424 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:28.125369    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62"} err="failed to get container status \"144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62\": rpc error: code = NotFound desc = could not find container \"144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62\": container with ID starting with 144225b6dc1235d4ae7f8438cbbfcb6bf48f11931abd046b67a5efe77e76ac62 not found: ID does not exist"
Aug 04 16:12:28.141670 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:28.141649    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f8c96b8bc-rrnhg"]
Aug 04 16:12:28.150090 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:28.150072    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f8c96b8bc-rrnhg"]
Aug 04 16:12:28.692570 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:28.692538    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f492dd1-45ec-4f47-adce-71c494c85d56" path="/var/lib/kubelet/pods/3f492dd1-45ec-4f47-adce-71c494c85d56/volumes"
Aug 04 16:12:59.243653 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:59.243617    2558 generic.go:356] "Generic (PLEG): container finished" podID="71e62d3a-85ac-4e7a-ae12-acc423d3ff3b" containerID="032d352f6a3996155573e905d51cab626143bd5594b2917724dba5d7295e1edd" exitCode=0
Aug 04 16:12:59.244056 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:59.243694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz" event={"ID":"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b","Type":"ContainerDied","Data":"032d352f6a3996155573e905d51cab626143bd5594b2917724dba5d7295e1edd"}
Aug 04 16:12:59.244102 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:59.244089    2558 scope.go:117] "RemoveContainer" containerID="032d352f6a3996155573e905d51cab626143bd5594b2917724dba5d7295e1edd"
Aug 04 16:12:59.245045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:59.245021    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:12:59.245106 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:59.245084    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:12:59.245144 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:12:59.245116    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:13:00.253214 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:00.253161    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz" event={"ID":"71e62d3a-85ac-4e7a-ae12-acc423d3ff3b","Type":"ContainerStarted","Data":"0e4d79e68f0e98ebb3b443f9c51b38634527ebb4748c40eda467a870452fb5a4"}
Aug 04 16:13:00.721080 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:00.721048    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:13:00.721256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:00.721191    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tjljz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Aug 04 16:13:00.721256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:00.721242    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz" podUID="71e62d3a-85ac-4e7a-ae12-acc423d3ff3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Aug 04 16:13:01.720706 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:01.720670    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tjljz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Aug 04 16:13:01.721099 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:01.720725    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz" podUID="71e62d3a-85ac-4e7a-ae12-acc423d3ff3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Aug 04 16:13:02.720446 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:02.720414    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tjljz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Aug 04 16:13:02.720619 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:02.720467    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz" podUID="71e62d3a-85ac-4e7a-ae12-acc423d3ff3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Aug 04 16:13:03.721317 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:03.721284    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tjljz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Aug 04 16:13:03.721681 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:03.721341    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz" podUID="71e62d3a-85ac-4e7a-ae12-acc423d3ff3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Aug 04 16:13:04.721279 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:04.721245    2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-tjljz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused" start-of-body=
Aug 04 16:13:04.721438 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:04.721297    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz" podUID="71e62d3a-85ac-4e7a-ae12-acc423d3ff3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.26:15021/healthz/ready\": dial tcp 10.133.0.26:15021: connect: connection refused"
Aug 04 16:13:05.723962 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:05.723935    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:13:05.724373 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:05.724214    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:13:05.724795 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:05.724780    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-tjljz"
Aug 04 16:13:12.803886 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.803856    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"]
Aug 04 16:13:12.804271 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.804143    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f492dd1-45ec-4f47-adce-71c494c85d56" containerName="manager"
Aug 04 16:13:12.804271 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.804153    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f492dd1-45ec-4f47-adce-71c494c85d56" containerName="manager"
Aug 04 16:13:12.804271 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.804211    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f492dd1-45ec-4f47-adce-71c494c85d56" containerName="manager"
Aug 04 16:13:12.806660 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.806640    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:12.809649 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.809626    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 16:13:12.809789 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.809684    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 16:13:12.811079 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.811058    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Aug 04 16:13:12.811198 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.811093    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l4q6r\""
Aug 04 16:13:12.827267 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.827243    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"]
Aug 04 16:13:12.934933 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.934908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm7nd\" (UniqueName: \"kubernetes.io/projected/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-kube-api-access-gm7nd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:12.935066 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.934950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:12.935066 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.935022    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:12.935066 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.935058    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:12.935234 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.935105    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:12.935234 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:12.935171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.035561 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.035534    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.035705 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.035574    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm7nd\" (UniqueName: \"kubernetes.io/projected/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-kube-api-access-gm7nd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.035705 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.035601    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.035705 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.035629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.035705 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.035645    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.035705 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.035667    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.036125 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.036102    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.036237 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.036181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.036237 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.036210    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.037866 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.037847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.038109 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.038091    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.044379 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.044356    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm7nd\" (UniqueName: \"kubernetes.io/projected/2e5d94bd-f684-4a6f-aa59-a5c178279aa2-kube-api-access-gm7nd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jmsnq\" (UID: \"2e5d94bd-f684-4a6f-aa59-a5c178279aa2\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.117266 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.117246    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:13.245052 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.245030    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"]
Aug 04 16:13:13.247265 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:13:13.247233    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5d94bd_f684_4a6f_aa59_a5c178279aa2.slice/crio-501560b384a6f7b5d0cd3025b71c60474318cdd61e19423fac08c75fb8b2beaa WatchSource:0}: Error finding container 501560b384a6f7b5d0cd3025b71c60474318cdd61e19423fac08c75fb8b2beaa: Status 404 returned error can't find the container with id 501560b384a6f7b5d0cd3025b71c60474318cdd61e19423fac08c75fb8b2beaa
Aug 04 16:13:13.309129 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:13.309102    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq" event={"ID":"2e5d94bd-f684-4a6f-aa59-a5c178279aa2","Type":"ContainerStarted","Data":"501560b384a6f7b5d0cd3025b71c60474318cdd61e19423fac08c75fb8b2beaa"}
Aug 04 16:13:15.321364 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:15.321325    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq" event={"ID":"2e5d94bd-f684-4a6f-aa59-a5c178279aa2","Type":"ContainerStarted","Data":"ce9970b99cd9049bee0d33e3fb4b226e7aee8492705257705b21d207ce00f506"}
Aug 04 16:13:15.341455 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:15.341403    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq" podStartSLOduration=2.250163022 podStartE2EDuration="3.341386598s" totalImagesPullingTime="1.091223576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:13:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:13:15.340206654 +0000 UTC m=+681.196679511" watchObservedRunningTime="2026-08-04 16:13:15.341386598 +0000 UTC m=+681.197859441"
Aug 04 16:13:21.204888 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.204852    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"]
Aug 04 16:13:21.206956 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.206940    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.211256 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.211239    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Aug 04 16:13:21.223075 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.223053    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"]
Aug 04 16:13:21.312010 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.311975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.312167 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.312016    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdzgb\" (UniqueName: \"kubernetes.io/projected/cc41460e-5a5f-49e2-aaae-9292a62f6470-kube-api-access-jdzgb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.312167 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.312086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.312167 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.312118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.312167 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.312150    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.312357 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.312194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc41460e-5a5f-49e2-aaae-9292a62f6470-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.413710 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.413676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.413916 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.413715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdzgb\" (UniqueName: \"kubernetes.io/projected/cc41460e-5a5f-49e2-aaae-9292a62f6470-kube-api-access-jdzgb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.413916 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.413778    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.413916 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.413803    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.413916 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.413839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.413916 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.413880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc41460e-5a5f-49e2-aaae-9292a62f6470-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.414234 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.414200    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.414321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.414236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.414321 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.414276    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.416144 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.416122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cc41460e-5a5f-49e2-aaae-9292a62f6470-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.416233 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.416217    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cc41460e-5a5f-49e2-aaae-9292a62f6470-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.421834 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.421810    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdzgb\" (UniqueName: \"kubernetes.io/projected/cc41460e-5a5f-49e2-aaae-9292a62f6470-kube-api-access-jdzgb\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sgz76\" (UID: \"cc41460e-5a5f-49e2-aaae-9292a62f6470\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.517233 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.517147    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:21.645340 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:21.645313    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"]
Aug 04 16:13:21.646720 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:13:21.646685    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc41460e_5a5f_49e2_aaae_9292a62f6470.slice/crio-394cfb4a0c97e204856587f587dc41756dd67fa27e1c16efcad1a7257bf35901 WatchSource:0}: Error finding container 394cfb4a0c97e204856587f587dc41756dd67fa27e1c16efcad1a7257bf35901: Status 404 returned error can't find the container with id 394cfb4a0c97e204856587f587dc41756dd67fa27e1c16efcad1a7257bf35901
Aug 04 16:13:22.355796 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:22.355741    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76" event={"ID":"cc41460e-5a5f-49e2-aaae-9292a62f6470","Type":"ContainerStarted","Data":"84a39347f9be01fc86dbdc824a9db1e468e8ffb91c0e87964e1a16520b0fd282"}
Aug 04 16:13:22.356238 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:22.355818    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76" event={"ID":"cc41460e-5a5f-49e2-aaae-9292a62f6470","Type":"ContainerStarted","Data":"394cfb4a0c97e204856587f587dc41756dd67fa27e1c16efcad1a7257bf35901"}
Aug 04 16:13:22.387987 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:22.387939    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76" podStartSLOduration=1.176928312 podStartE2EDuration="1.387920722s" totalImagesPullingTime="210.99241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:13:22.386817065 +0000 UTC m=+688.243289910" watchObservedRunningTime="2026-08-04 16:13:22.387920722 +0000 UTC m=+688.244393565"
Aug 04 16:13:23.117459 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:23.117428    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:23.117681 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:23.117486    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:23.129709 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:23.129683    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:23.371718 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:23.371637    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jmsnq"
Aug 04 16:13:31.517555 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:31.517507    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:31.518034 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:31.517578    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:31.529869 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:31.529851    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:32.408124 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:32.408095    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sgz76"
Aug 04 16:13:38.106698 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.106660    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"]
Aug 04 16:13:38.109207 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.109189    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.112583 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.112566    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Aug 04 16:13:38.126444 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.126422    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"]
Aug 04 16:13:38.142293 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.142268    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gjhb\" (UniqueName: \"kubernetes.io/projected/07bbe9af-8afc-4dbb-add5-c5600cbc99de-kube-api-access-4gjhb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.142392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.142306    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.142392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.142328    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07bbe9af-8afc-4dbb-add5-c5600cbc99de-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.142392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.142382    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.142499 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.142459    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.142499 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.142490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.243144 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.243118    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.243275 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.243152    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.243275 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.243197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gjhb\" (UniqueName: \"kubernetes.io/projected/07bbe9af-8afc-4dbb-add5-c5600cbc99de-kube-api-access-4gjhb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.243275 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.243225    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.243275 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.243245    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07bbe9af-8afc-4dbb-add5-c5600cbc99de-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.243442 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.243285    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.243576 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.243555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.243626 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.243567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.243705 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.243674    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.245472 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.245447    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07bbe9af-8afc-4dbb-add5-c5600cbc99de-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.245738 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.245717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07bbe9af-8afc-4dbb-add5-c5600cbc99de-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.253083 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.253061    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gjhb\" (UniqueName: \"kubernetes.io/projected/07bbe9af-8afc-4dbb-add5-c5600cbc99de-kube-api-access-4gjhb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ppcpw\" (UID: \"07bbe9af-8afc-4dbb-add5-c5600cbc99de\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.419880 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.419854    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:38.545412 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:38.545264    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"]
Aug 04 16:13:38.547558 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:13:38.547533    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bbe9af_8afc_4dbb_add5_c5600cbc99de.slice/crio-25bf002a663d6b253dfbbd5b57f028d8255decfcfc224e65ad2c916f76b74c37 WatchSource:0}: Error finding container 25bf002a663d6b253dfbbd5b57f028d8255decfcfc224e65ad2c916f76b74c37: Status 404 returned error can't find the container with id 25bf002a663d6b253dfbbd5b57f028d8255decfcfc224e65ad2c916f76b74c37
Aug 04 16:13:39.429479 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:39.429440    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw" event={"ID":"07bbe9af-8afc-4dbb-add5-c5600cbc99de","Type":"ContainerStarted","Data":"d03a0a3e559b123a91c6480593b87c6b09a2390a70668d6d3b667a0b2b6dd897"}
Aug 04 16:13:39.429969 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:39.429493    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw" event={"ID":"07bbe9af-8afc-4dbb-add5-c5600cbc99de","Type":"ContainerStarted","Data":"25bf002a663d6b253dfbbd5b57f028d8255decfcfc224e65ad2c916f76b74c37"}
Aug 04 16:13:39.453854 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:39.453809    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw" podStartSLOduration=1.2603101460000001 podStartE2EDuration="1.453792792s" totalImagesPullingTime="193.482646ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:13:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:13:39.452894204 +0000 UTC m=+705.309367049" watchObservedRunningTime="2026-08-04 16:13:39.453792792 +0000 UTC m=+705.310265636"
Aug 04 16:13:48.420565 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:48.420476    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:48.420984 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:48.420583    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:48.432959 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:48.432936    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:13:48.480882 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:13:48.480854    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ppcpw"
Aug 04 16:14:17.812322 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:17.812287    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bf6b476bb-cffmx"]
Aug 04 16:14:17.815237 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:17.815222    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bf6b476bb-cffmx"
Aug 04 16:14:17.824243 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:17.824217    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bf6b476bb-cffmx"]
Aug 04 16:14:17.897088 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:17.897059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01-tls-cert\") pod \"authorino-7bf6b476bb-cffmx\" (UID: \"9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01\") " pod="kuadrant-system/authorino-7bf6b476bb-cffmx"
Aug 04 16:14:17.897231 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:17.897116    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfplp\" (UniqueName: \"kubernetes.io/projected/9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01-kube-api-access-bfplp\") pod \"authorino-7bf6b476bb-cffmx\" (UID: \"9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01\") " pod="kuadrant-system/authorino-7bf6b476bb-cffmx"
Aug 04 16:14:17.997977 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:17.997947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01-tls-cert\") pod \"authorino-7bf6b476bb-cffmx\" (UID: \"9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01\") " pod="kuadrant-system/authorino-7bf6b476bb-cffmx"
Aug 04 16:14:17.998121 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:17.998002    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfplp\" (UniqueName: \"kubernetes.io/projected/9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01-kube-api-access-bfplp\") pod \"authorino-7bf6b476bb-cffmx\" (UID: \"9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01\") " pod="kuadrant-system/authorino-7bf6b476bb-cffmx"
Aug 04 16:14:18.000299 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:18.000272    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01-tls-cert\") pod \"authorino-7bf6b476bb-cffmx\" (UID: \"9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01\") " pod="kuadrant-system/authorino-7bf6b476bb-cffmx"
Aug 04 16:14:18.008366 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:18.008343    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfplp\" (UniqueName: \"kubernetes.io/projected/9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01-kube-api-access-bfplp\") pod \"authorino-7bf6b476bb-cffmx\" (UID: \"9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01\") " pod="kuadrant-system/authorino-7bf6b476bb-cffmx"
Aug 04 16:14:18.125216 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:18.125192    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bf6b476bb-cffmx"
Aug 04 16:14:18.250762 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:18.250719    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bf6b476bb-cffmx"]
Aug 04 16:14:18.252680 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:14:18.252655    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bc46510_1ddc_42e3_8a3a_f8c8d8d22e01.slice/crio-2b0389352cc67fd9cdf068e6a91f64041cb44d254a7f48c456aa2d24bab09df9 WatchSource:0}: Error finding container 2b0389352cc67fd9cdf068e6a91f64041cb44d254a7f48c456aa2d24bab09df9: Status 404 returned error can't find the container with id 2b0389352cc67fd9cdf068e6a91f64041cb44d254a7f48c456aa2d24bab09df9
Aug 04 16:14:18.254355 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:18.254338    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:14:18.595594 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:18.595499    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bf6b476bb-cffmx" event={"ID":"9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01","Type":"ContainerStarted","Data":"2b0389352cc67fd9cdf068e6a91f64041cb44d254a7f48c456aa2d24bab09df9"}
Aug 04 16:14:19.612340 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:19.612301    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bf6b476bb-cffmx" event={"ID":"9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01","Type":"ContainerStarted","Data":"be6a0184979a425132fddaeede26b06974c737b8837e021ec7fbe8b01fb25917"}
Aug 04 16:14:19.634257 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:19.634202    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bf6b476bb-cffmx" podStartSLOduration=1.89759239 podStartE2EDuration="2.634181593s" totalImagesPullingTime="736.589203ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:14:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:14:19.632090928 +0000 UTC m=+745.488563778" watchObservedRunningTime="2026-08-04 16:14:19.634181593 +0000 UTC m=+745.490654436"
Aug 04 16:14:19.662821 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:19.662783    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dd7b7b64c-wfzts"]
Aug 04 16:14:19.663071 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:19.663042    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-dd7b7b64c-wfzts" podUID="a0c16309-c931-42cd-b869-5abed1920e03" containerName="authorino" containerID="cri-o://158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe" gracePeriod=30
Aug 04 16:14:19.933970 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:19.933946    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd7b7b64c-wfzts"
Aug 04 16:14:20.014643 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.014613    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a0c16309-c931-42cd-b869-5abed1920e03-tls-cert\") pod \"a0c16309-c931-42cd-b869-5abed1920e03\" (UID: \"a0c16309-c931-42cd-b869-5abed1920e03\") "
Aug 04 16:14:20.014831 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.014741    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7lfr\" (UniqueName: \"kubernetes.io/projected/a0c16309-c931-42cd-b869-5abed1920e03-kube-api-access-m7lfr\") pod \"a0c16309-c931-42cd-b869-5abed1920e03\" (UID: \"a0c16309-c931-42cd-b869-5abed1920e03\") "
Aug 04 16:14:20.016666 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.016630    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c16309-c931-42cd-b869-5abed1920e03-kube-api-access-m7lfr" (OuterVolumeSpecName: "kube-api-access-m7lfr") pod "a0c16309-c931-42cd-b869-5abed1920e03" (UID: "a0c16309-c931-42cd-b869-5abed1920e03"). InnerVolumeSpecName "kube-api-access-m7lfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:14:20.024063 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.024037    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0c16309-c931-42cd-b869-5abed1920e03-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a0c16309-c931-42cd-b869-5abed1920e03" (UID: "a0c16309-c931-42cd-b869-5abed1920e03"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:14:20.116120 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.116083    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7lfr\" (UniqueName: \"kubernetes.io/projected/a0c16309-c931-42cd-b869-5abed1920e03-kube-api-access-m7lfr\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:14:20.116120 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.116112    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a0c16309-c931-42cd-b869-5abed1920e03-tls-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:14:20.617262 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.617228    2558 generic.go:356] "Generic (PLEG): container finished" podID="a0c16309-c931-42cd-b869-5abed1920e03" containerID="158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe" exitCode=0
Aug 04 16:14:20.617721 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.617280    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-dd7b7b64c-wfzts"
Aug 04 16:14:20.617721 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.617309    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dd7b7b64c-wfzts" event={"ID":"a0c16309-c931-42cd-b869-5abed1920e03","Type":"ContainerDied","Data":"158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe"}
Aug 04 16:14:20.617721 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.617354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-dd7b7b64c-wfzts" event={"ID":"a0c16309-c931-42cd-b869-5abed1920e03","Type":"ContainerDied","Data":"5e53f9d6ad30af0940f87fa181287b0f51349f32812f0026a9fcf278f6870932"}
Aug 04 16:14:20.617721 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.617379    2558 scope.go:117] "RemoveContainer" containerID="158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe"
Aug 04 16:14:20.627465 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.627446    2558 scope.go:117] "RemoveContainer" containerID="158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe"
Aug 04 16:14:20.627776 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:14:20.627740    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe\": container with ID starting with 158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe not found: ID does not exist" containerID="158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe"
Aug 04 16:14:20.627842 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.627788    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe"} err="failed to get container status \"158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe\": rpc error: code = NotFound desc = could not find container \"158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe\": container with ID starting with 158f6c8862fa6f979e5095ffdca9014ae5bfeed82481e96dae3d0e85811b87fe not found: ID does not exist"
Aug 04 16:14:20.641588 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.641565    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-dd7b7b64c-wfzts"]
Aug 04 16:14:20.646117 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.646093    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-dd7b7b64c-wfzts"]
Aug 04 16:14:20.692778 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:14:20.692729    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0c16309-c931-42cd-b869-5abed1920e03" path="/var/lib/kubelet/pods/a0c16309-c931-42cd-b869-5abed1920e03/volumes"
Aug 04 16:16:54.587789 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:16:54.587759    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:16:54.589529 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:16:54.589507    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:21:54.622655 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:21:54.622623    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:21:54.625391 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:21:54.622895    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:26:54.646795 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:26:54.646665    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:26:54.650869 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:26:54.649858    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:27:13.922058 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:13.922017    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"]
Aug 04 16:27:13.922532 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:13.922338    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0c16309-c931-42cd-b869-5abed1920e03" containerName="authorino"
Aug 04 16:27:13.922532 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:13.922348    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0c16309-c931-42cd-b869-5abed1920e03" containerName="authorino"
Aug 04 16:27:13.922532 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:13.922398    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0c16309-c931-42cd-b869-5abed1920e03" containerName="authorino"
Aug 04 16:27:13.925229 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:13.925209    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:13.928422 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:13.928405    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-186e23db-kserve-self-signed-certs\""
Aug 04 16:27:13.942822 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:13.942796    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"]
Aug 04 16:27:14.028930 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.028898    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-dshm\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.029064 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.028941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xs6x\" (UniqueName: \"kubernetes.io/projected/32e53620-0570-4f6f-9ed8-bccd17e5023c-kube-api-access-8xs6x\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.029064 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.029017    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-tmp-dir\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.029142 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.029068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-model-cache\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.029142 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.029090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e53620-0570-4f6f-9ed8-bccd17e5023c-tls-certs\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.029142 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.029117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-home\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.130465 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.130434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-tmp-dir\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.130633 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.130489    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-model-cache\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.130685 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.130648    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e53620-0570-4f6f-9ed8-bccd17e5023c-tls-certs\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.130737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.130683    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-home\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.130737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.130728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-dshm\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.130870 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.130773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xs6x\" (UniqueName: \"kubernetes.io/projected/32e53620-0570-4f6f-9ed8-bccd17e5023c-kube-api-access-8xs6x\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.130870 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.130830    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-model-cache\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.130870 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.130853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-tmp-dir\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.131092 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.130978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-home\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.132971 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.132950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-dshm\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.133250 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.133231    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e53620-0570-4f6f-9ed8-bccd17e5023c-tls-certs\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.139578 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.139556    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xs6x\" (UniqueName: \"kubernetes.io/projected/32e53620-0570-4f6f-9ed8-bccd17e5023c-kube-api-access-8xs6x\") pod \"e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") " pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.234928 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.234858    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:14.360800 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.360775    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"]
Aug 04 16:27:14.362921 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:27:14.362894    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32e53620_0570_4f6f_9ed8_bccd17e5023c.slice/crio-83ff28f86de0568b63a91f91286af9eba2a981ba4ae672424520d24d113d1d2b WatchSource:0}: Error finding container 83ff28f86de0568b63a91f91286af9eba2a981ba4ae672424520d24d113d1d2b: Status 404 returned error can't find the container with id 83ff28f86de0568b63a91f91286af9eba2a981ba4ae672424520d24d113d1d2b
Aug 04 16:27:14.942201 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.942157    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr" event={"ID":"32e53620-0570-4f6f-9ed8-bccd17e5023c","Type":"ContainerStarted","Data":"ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1"}
Aug 04 16:27:14.942654 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.942206    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr" event={"ID":"32e53620-0570-4f6f-9ed8-bccd17e5023c","Type":"ContainerStarted","Data":"83ff28f86de0568b63a91f91286af9eba2a981ba4ae672424520d24d113d1d2b"}
Aug 04 16:27:14.963112 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:14.963059    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr" podStartSLOduration=1.963042954 podStartE2EDuration="1.963042954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:27:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:27:14.960500268 +0000 UTC m=+1520.816973112" watchObservedRunningTime="2026-08-04 16:27:14.963042954 +0000 UTC m=+1520.819515797"
Aug 04 16:27:24.235259 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:24.235162    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:24.235259 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:24.235221    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:24.247563 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:24.247535    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:27:24.999839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:27:24.999816    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:28:02.109685 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:02.109649    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"]
Aug 04 16:28:17.128439 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.128375    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr" podUID="32e53620-0570-4f6f-9ed8-bccd17e5023c" containerName="main" containerID="cri-o://ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1" gracePeriod=45
Aug 04 16:28:17.368604 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.368581    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:28:17.472539 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.472449    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-tmp-dir\") pod \"32e53620-0570-4f6f-9ed8-bccd17e5023c\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") "
Aug 04 16:28:17.472539 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.472495    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-model-cache\") pod \"32e53620-0570-4f6f-9ed8-bccd17e5023c\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") "
Aug 04 16:28:17.472539 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.472519    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e53620-0570-4f6f-9ed8-bccd17e5023c-tls-certs\") pod \"32e53620-0570-4f6f-9ed8-bccd17e5023c\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") "
Aug 04 16:28:17.472862 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.472564    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xs6x\" (UniqueName: \"kubernetes.io/projected/32e53620-0570-4f6f-9ed8-bccd17e5023c-kube-api-access-8xs6x\") pod \"32e53620-0570-4f6f-9ed8-bccd17e5023c\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") "
Aug 04 16:28:17.472862 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.472602    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-dshm\") pod \"32e53620-0570-4f6f-9ed8-bccd17e5023c\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") "
Aug 04 16:28:17.472862 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.472686    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-home\") pod \"32e53620-0570-4f6f-9ed8-bccd17e5023c\" (UID: \"32e53620-0570-4f6f-9ed8-bccd17e5023c\") "
Aug 04 16:28:17.472862 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.472777    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-model-cache" (OuterVolumeSpecName: "model-cache") pod "32e53620-0570-4f6f-9ed8-bccd17e5023c" (UID: "32e53620-0570-4f6f-9ed8-bccd17e5023c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:28:17.472862 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.472788    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "32e53620-0570-4f6f-9ed8-bccd17e5023c" (UID: "32e53620-0570-4f6f-9ed8-bccd17e5023c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:28:17.473103 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.472996    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-home" (OuterVolumeSpecName: "home") pod "32e53620-0570-4f6f-9ed8-bccd17e5023c" (UID: "32e53620-0570-4f6f-9ed8-bccd17e5023c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:28:17.473103 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.473052    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-tmp-dir\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:28:17.473103 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.473074    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-model-cache\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:28:17.475028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.474995    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-dshm" (OuterVolumeSpecName: "dshm") pod "32e53620-0570-4f6f-9ed8-bccd17e5023c" (UID: "32e53620-0570-4f6f-9ed8-bccd17e5023c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:28:17.475201 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.475177    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e53620-0570-4f6f-9ed8-bccd17e5023c-kube-api-access-8xs6x" (OuterVolumeSpecName: "kube-api-access-8xs6x") pod "32e53620-0570-4f6f-9ed8-bccd17e5023c" (UID: "32e53620-0570-4f6f-9ed8-bccd17e5023c"). InnerVolumeSpecName "kube-api-access-8xs6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:28:17.475281 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.475180    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32e53620-0570-4f6f-9ed8-bccd17e5023c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "32e53620-0570-4f6f-9ed8-bccd17e5023c" (UID: "32e53620-0570-4f6f-9ed8-bccd17e5023c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:28:17.573926 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.573878    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/32e53620-0570-4f6f-9ed8-bccd17e5023c-tls-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:28:17.573926 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.573920    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xs6x\" (UniqueName: \"kubernetes.io/projected/32e53620-0570-4f6f-9ed8-bccd17e5023c-kube-api-access-8xs6x\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:28:17.573926 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.573930    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-dshm\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:28:17.573926 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:17.573939    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/32e53620-0570-4f6f-9ed8-bccd17e5023c-home\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:28:18.216710 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:18.216681    2558 generic.go:356] "Generic (PLEG): container finished" podID="32e53620-0570-4f6f-9ed8-bccd17e5023c" containerID="ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1" exitCode=0
Aug 04 16:28:18.217198 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:18.216722    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"
Aug 04 16:28:18.217198 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:18.216772    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr" event={"ID":"32e53620-0570-4f6f-9ed8-bccd17e5023c","Type":"ContainerDied","Data":"ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1"}
Aug 04 16:28:18.217198 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:18.216831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr" event={"ID":"32e53620-0570-4f6f-9ed8-bccd17e5023c","Type":"ContainerDied","Data":"83ff28f86de0568b63a91f91286af9eba2a981ba4ae672424520d24d113d1d2b"}
Aug 04 16:28:18.217198 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:18.216857    2558 scope.go:117] "RemoveContainer" containerID="ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1"
Aug 04 16:28:18.225933 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:18.225916    2558 scope.go:117] "RemoveContainer" containerID="ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1"
Aug 04 16:28:18.226178 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:28:18.226159    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1\": container with ID starting with ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1 not found: ID does not exist" containerID="ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1"
Aug 04 16:28:18.226241 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:18.226185    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1"} err="failed to get container status \"ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1\": rpc error: code = NotFound desc = could not find container \"ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1\": container with ID starting with ebdf8267d63f45dd3c80dbf2081c04abdea1aee1e0f36ccbfb37dca617a10bf1 not found: ID does not exist"
Aug 04 16:28:18.238737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:18.238713    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"]
Aug 04 16:28:18.245380 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:18.245362    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-186e23db-kserve-78f4b766c-7vtjr"]
Aug 04 16:28:18.693426 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:28:18.693383    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32e53620-0570-4f6f-9ed8-bccd17e5023c" path="/var/lib/kubelet/pods/32e53620-0570-4f6f-9ed8-bccd17e5023c/volumes"
Aug 04 16:31:54.671431 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:31:54.671318    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:31:54.677706 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:31:54.676040    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:36:54.695988 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:36:54.695884    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:36:54.702295 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:36:54.702276    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:40:16.012063 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.012028    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"]
Aug 04 16:40:16.012667 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.012357    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e53620-0570-4f6f-9ed8-bccd17e5023c" containerName="main"
Aug 04 16:40:16.012667 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.012368    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e53620-0570-4f6f-9ed8-bccd17e5023c" containerName="main"
Aug 04 16:40:16.012667 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.012453    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e53620-0570-4f6f-9ed8-bccd17e5023c" containerName="main"
Aug 04 16:40:16.015427 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.015408    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.018570 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.018548    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8101352f\"/\"kube-root-ca.crt\""
Aug 04 16:40:16.019901 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.019882    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-8101352f\"/\"openshift-service-ca.crt\""
Aug 04 16:40:16.020134 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.020119    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8101352f\"/\"e2e-lifecycle-model-8101352f-kserve-self-signed-certs\""
Aug 04 16:40:16.020208 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.020127    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-8101352f\"/\"default-dockercfg-985z9\""
Aug 04 16:40:16.029506 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.029483    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"]
Aug 04 16:40:16.063496 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.063473    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-home\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.063592 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.063513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tls-certs\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.063592 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.063563    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxnw6\" (UniqueName: \"kubernetes.io/projected/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-kube-api-access-kxnw6\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.063592 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.063590    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-dshm\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.063715 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.063617    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-model-cache\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.063715 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.063659    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tmp-dir\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.164573 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.164538    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-home\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.164769 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.164584    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tls-certs\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.164769 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.164612    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxnw6\" (UniqueName: \"kubernetes.io/projected/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-kube-api-access-kxnw6\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.164769 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.164638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-dshm\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.164769 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.164659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-model-cache\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.164769 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.164682    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tmp-dir\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.165071 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.165044    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-home\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.165071 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.165058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tmp-dir\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.165180 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.165099    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-model-cache\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.166958 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.166936    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-dshm\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.167200 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.167182    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tls-certs\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.174146 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.174128    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxnw6\" (UniqueName: \"kubernetes.io/projected/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-kube-api-access-kxnw6\") pod \"e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") " pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.324687 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.324590    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:16.459807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:16.459775    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"]
Aug 04 16:40:16.463525 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:40:16.463496    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ced9cc5_5ade_42e5_bc54_74c7b77a85c4.slice/crio-ac711832ae2d64de1a8e04e6237a1381b72665900e726a4fb076d48800a9536f WatchSource:0}: Error finding container ac711832ae2d64de1a8e04e6237a1381b72665900e726a4fb076d48800a9536f: Status 404 returned error can't find the container with id ac711832ae2d64de1a8e04e6237a1381b72665900e726a4fb076d48800a9536f
Aug 04 16:40:17.338001 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:17.337961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw" event={"ID":"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4","Type":"ContainerStarted","Data":"8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186"}
Aug 04 16:40:17.338001 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:17.338004    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw" event={"ID":"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4","Type":"ContainerStarted","Data":"ac711832ae2d64de1a8e04e6237a1381b72665900e726a4fb076d48800a9536f"}
Aug 04 16:40:17.361029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:17.360985    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw" podStartSLOduration=2.360970893 podStartE2EDuration="2.360970893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:40:17.360280072 +0000 UTC m=+2303.216752916" watchObservedRunningTime="2026-08-04 16:40:17.360970893 +0000 UTC m=+2303.217443737"
Aug 04 16:40:26.325813 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:26.325772    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:26.326285 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:26.325836    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:26.338253 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:26.338224    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:40:26.388926 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:40:26.388901    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:41:07.898638 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:07.898555    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"]
Aug 04 16:41:22.917168 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:22.917127    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw" podUID="5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" containerName="main" containerID="cri-o://8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186" gracePeriod=45
Aug 04 16:41:23.166091 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.166068    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:41:23.251083 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.250996    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-home\") pod \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") "
Aug 04 16:41:23.251083 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251033    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-model-cache\") pod \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") "
Aug 04 16:41:23.251313 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251099    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxnw6\" (UniqueName: \"kubernetes.io/projected/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-kube-api-access-kxnw6\") pod \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") "
Aug 04 16:41:23.251313 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251182    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tmp-dir\") pod \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") "
Aug 04 16:41:23.251313 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251214    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tls-certs\") pod \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") "
Aug 04 16:41:23.251313 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251268    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-dshm\") pod \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\" (UID: \"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4\") "
Aug 04 16:41:23.251313 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251287    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-home" (OuterVolumeSpecName: "home") pod "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" (UID: "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:41:23.251518 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251374    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-model-cache" (OuterVolumeSpecName: "model-cache") pod "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" (UID: "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:41:23.251518 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251398    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" (UID: "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:41:23.251628 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251530    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tmp-dir\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:41:23.251628 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251546    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-home\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:41:23.251628 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.251559    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-model-cache\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:41:23.253401 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.253371    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-dshm" (OuterVolumeSpecName: "dshm") pod "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" (UID: "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:41:23.253505 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.253429    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" (UID: "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:41:23.253505 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.253443    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-kube-api-access-kxnw6" (OuterVolumeSpecName: "kube-api-access-kxnw6") pod "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" (UID: "5ced9cc5-5ade-42e5-bc54-74c7b77a85c4"). InnerVolumeSpecName "kube-api-access-kxnw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:41:23.352228 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.352195    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxnw6\" (UniqueName: \"kubernetes.io/projected/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-kube-api-access-kxnw6\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:41:23.352228 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.352224    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-tls-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:41:23.352228 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.352234    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4-dshm\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:41:23.632316 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.632287    2558 generic.go:356] "Generic (PLEG): container finished" podID="5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" containerID="8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186" exitCode=0
Aug 04 16:41:23.632489 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.632335    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"
Aug 04 16:41:23.632489 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.632363    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw" event={"ID":"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4","Type":"ContainerDied","Data":"8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186"}
Aug 04 16:41:23.632489 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.632396    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw" event={"ID":"5ced9cc5-5ade-42e5-bc54-74c7b77a85c4","Type":"ContainerDied","Data":"ac711832ae2d64de1a8e04e6237a1381b72665900e726a4fb076d48800a9536f"}
Aug 04 16:41:23.632489 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.632412    2558 scope.go:117] "RemoveContainer" containerID="8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186"
Aug 04 16:41:23.641309 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.641292    2558 scope.go:117] "RemoveContainer" containerID="8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186"
Aug 04 16:41:23.641549 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:41:23.641528    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186\": container with ID starting with 8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186 not found: ID does not exist" containerID="8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186"
Aug 04 16:41:23.641607 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.641556    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186"} err="failed to get container status \"8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186\": rpc error: code = NotFound desc = could not find container \"8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186\": container with ID starting with 8e9dfe940b58e7c2c4399171e1866662288c0455cb7010d508a25af7d97ad186 not found: ID does not exist"
Aug 04 16:41:23.655038 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.655011    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"]
Aug 04 16:41:23.659009 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:23.658990    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-8101352f/e2e-lifecycle-model-8101352f-kserve-74b697d4c-nl9bw"]
Aug 04 16:41:24.692144 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:24.692111    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" path="/var/lib/kubelet/pods/5ced9cc5-5ade-42e5-bc54-74c7b77a85c4/volumes"
Aug 04 16:41:54.720017 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:54.719918    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:41:54.727093 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:41:54.727075    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:43:41.988832 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:41.988801    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"]
Aug 04 16:43:41.989316 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:41.989193    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" containerName="main"
Aug 04 16:43:41.989316 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:41.989210    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" containerName="main"
Aug 04 16:43:41.989316 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:41.989287    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ced9cc5-5ade-42e5-bc54-74c7b77a85c4" containerName="main"
Aug 04 16:43:41.992131 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:41.992113    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:41.996066 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:41.996044    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-19c94c-openshift-default-dockercfg-vbmgm\""
Aug 04 16:43:42.005046 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.005024    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"]
Aug 04 16:43:42.056595 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.056558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-certs\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.056807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.056623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-envoy\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.056807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.056650    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73354dbe-d98c-482f-ad17-10a6922945b7-istiod-ca-cert\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.056807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.056689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-istio-token\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.056807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.056715    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkfqd\" (UniqueName: \"kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-kube-api-access-lkfqd\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.056807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.056742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-data\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.056807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.056793    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73354dbe-d98c-482f-ad17-10a6922945b7-istio-podinfo\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.057091 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.056908    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-credential-socket\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.057091 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.056971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-socket\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158063 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158029    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-credential-socket\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158265 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158198    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-socket\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158335 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158255    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-certs\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158391 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-envoy\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158396    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73354dbe-d98c-482f-ad17-10a6922945b7-istiod-ca-cert\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158431    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-istio-token\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158567 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158463    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkfqd\" (UniqueName: \"kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-kube-api-access-lkfqd\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158567 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158499    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-data\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158567 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158530    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-credential-socket\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158716 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73354dbe-d98c-482f-ad17-10a6922945b7-istio-podinfo\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158716 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158576    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-socket\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.158919 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.158887    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-certs\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.159193 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.159165    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-data\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.159394 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.159374    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73354dbe-d98c-482f-ad17-10a6922945b7-istiod-ca-cert\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.160900 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.160883    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-envoy\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.161006 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.160966    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73354dbe-d98c-482f-ad17-10a6922945b7-istio-podinfo\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.167072 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.167048    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkfqd\" (UniqueName: \"kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-kube-api-access-lkfqd\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.167263 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.167244    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-istio-token\") pod \"e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") " pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.302160 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.302083    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:42.433724 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.433675    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"]
Aug 04 16:43:42.435936 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:43:42.435898    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73354dbe_d98c_482f_ad17_10a6922945b7.slice/crio-c9a8cc44648305259211c37eccf8ff0ebd85526fe21032ebc146cb4652c744a0 WatchSource:0}: Error finding container c9a8cc44648305259211c37eccf8ff0ebd85526fe21032ebc146cb4652c744a0: Status 404 returned error can't find the container with id c9a8cc44648305259211c37eccf8ff0ebd85526fe21032ebc146cb4652c744a0
Aug 04 16:43:42.438078 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.438045    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:43:42.438177 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.438113    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:43:42.438177 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:42.438141    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:43:43.229483 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:43.229447    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" event={"ID":"73354dbe-d98c-482f-ad17-10a6922945b7","Type":"ContainerStarted","Data":"0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f"}
Aug 04 16:43:43.229873 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:43.229506    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" event={"ID":"73354dbe-d98c-482f-ad17-10a6922945b7","Type":"ContainerStarted","Data":"c9a8cc44648305259211c37eccf8ff0ebd85526fe21032ebc146cb4652c744a0"}
Aug 04 16:43:43.254892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:43.254841    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" podStartSLOduration=2.254825999 podStartE2EDuration="2.254825999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:43:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:43:43.249681154 +0000 UTC m=+2509.106153997" watchObservedRunningTime="2026-08-04 16:43:43.254825999 +0000 UTC m=+2509.111298842"
Aug 04 16:43:43.302334 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:43.302309    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:43.307152 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:43.307134    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:44.233670 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:44.233643    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:44.234434 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:44.234413    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:43:59.250196 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:59.250157    2558 patch_prober.go:28] interesting pod/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:36204->10.133.0.41:15021: read: connection reset by peer" start-of-body=
Aug 04 16:43:59.250589 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:59.250247    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:36204->10.133.0.41:15021: read: connection reset by peer"
Aug 04 16:43:59.312088 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:59.312060    2558 generic.go:356] "Generic (PLEG): container finished" podID="73354dbe-d98c-482f-ad17-10a6922945b7" containerID="0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f" exitCode=0
Aug 04 16:43:59.312240 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:59.312137    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" event={"ID":"73354dbe-d98c-482f-ad17-10a6922945b7","Type":"ContainerDied","Data":"0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f"}
Aug 04 16:43:59.312537 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:59.312523    2558 scope.go:117] "RemoveContainer" containerID="0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f"
Aug 04 16:43:59.313477 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:59.313452    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:43:59.313527 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:59.313518    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:43:59.313563 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:43:59.313551    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:44:00.320637 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:00.320603    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" event={"ID":"73354dbe-d98c-482f-ad17-10a6922945b7","Type":"ContainerStarted","Data":"4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a"}
Aug 04 16:44:01.303079 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:01.303041    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:44:01.303419 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:01.303396    2558 patch_prober.go:28] interesting pod/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Aug 04 16:44:01.303511 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:01.303451    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Aug 04 16:44:02.302843 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:02.302802    2558 patch_prober.go:28] interesting pod/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Aug 04 16:44:02.303243 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:02.302863    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Aug 04 16:44:03.302704 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:03.302665    2558 patch_prober.go:28] interesting pod/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Aug 04 16:44:03.302920 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:03.302720    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Aug 04 16:44:04.303206 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:04.303166    2558 patch_prober.go:28] interesting pod/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Aug 04 16:44:04.303598 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:04.303227    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Aug 04 16:44:05.306421 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:05.306388    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:44:05.306823 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:05.306670    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:44:05.307420 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:05.307401    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:44:58.300892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.300857    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"]
Aug 04 16:44:58.304203 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.304187    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.308756 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.308719    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-19c94c\"/\"test-model-19c94c-kserve-self-signed-certs\""
Aug 04 16:44:58.308877 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.308809    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-19c94c\"/\"openshift-service-ca.crt\""
Aug 04 16:44:58.308877 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.308848    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-19c94c\"/\"default-dockercfg-x8djf\""
Aug 04 16:44:58.309050 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.309037    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-19c94c\"/\"kube-root-ca.crt\""
Aug 04 16:44:58.315122 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.315101    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"]
Aug 04 16:44:58.347104 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.347074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-model-cache\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.347104 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.347106    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tmp-dir\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.347261 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.347124    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-dshm\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.347261 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.347143    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tls-certs\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.347261 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.347197    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnpf9\" (UniqueName: \"kubernetes.io/projected/5bdddcdb-bf1c-42a5-8f84-f4918d103739-kube-api-access-lnpf9\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.347261 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.347249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-home\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.447737 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.447712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-model-cache\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.447891 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.447763    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tmp-dir\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.447891 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.447783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-dshm\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.448002 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.447893    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tls-certs\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.448002 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.447929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnpf9\" (UniqueName: \"kubernetes.io/projected/5bdddcdb-bf1c-42a5-8f84-f4918d103739-kube-api-access-lnpf9\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.448002 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.447965    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-home\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.448170 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.448104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-model-cache\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.448227 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.448198    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tmp-dir\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.448365 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.448348    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-home\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.450097 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.450072    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-dshm\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.450330 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.450309    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tls-certs\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.458229 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.458190    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnpf9\" (UniqueName: \"kubernetes.io/projected/5bdddcdb-bf1c-42a5-8f84-f4918d103739-kube-api-access-lnpf9\") pod \"test-model-19c94c-kserve-7944b7fd55-zp89t\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") " pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.613350 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.613259    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:44:58.749377 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:58.749353    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"]
Aug 04 16:44:58.751596 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:44:58.751570    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bdddcdb_bf1c_42a5_8f84_f4918d103739.slice/crio-d301771049c8c336ff2f4bc8e9fb1150f9a6808e476ac2ed2d529992472317ef WatchSource:0}: Error finding container d301771049c8c336ff2f4bc8e9fb1150f9a6808e476ac2ed2d529992472317ef: Status 404 returned error can't find the container with id d301771049c8c336ff2f4bc8e9fb1150f9a6808e476ac2ed2d529992472317ef
Aug 04 16:44:59.583963 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:59.583924    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t" event={"ID":"5bdddcdb-bf1c-42a5-8f84-f4918d103739","Type":"ContainerStarted","Data":"fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c"}
Aug 04 16:44:59.583963 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:59.583968    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t" event={"ID":"5bdddcdb-bf1c-42a5-8f84-f4918d103739","Type":"ContainerStarted","Data":"d301771049c8c336ff2f4bc8e9fb1150f9a6808e476ac2ed2d529992472317ef"}
Aug 04 16:44:59.602629 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:44:59.602581    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t" podStartSLOduration=1.602564592 podStartE2EDuration="1.602564592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:44:59.60200202 +0000 UTC m=+2585.458474873" watchObservedRunningTime="2026-08-04 16:44:59.602564592 +0000 UTC m=+2585.459037435"
Aug 04 16:45:08.614312 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:08.614281    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:45:08.614741 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:08.614497    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:45:08.627236 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:08.627216    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:45:09.641202 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:09.641170    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:45:41.433782 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:41.433685    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"]
Aug 04 16:45:56.452374 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.452310    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t" podUID="5bdddcdb-bf1c-42a5-8f84-f4918d103739" containerName="main" containerID="cri-o://fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c" gracePeriod=45
Aug 04 16:45:56.694980 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.694956    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:45:56.785842 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.785736    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tmp-dir\") pod \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") "
Aug 04 16:45:56.785842 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.785807    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tls-certs\") pod \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") "
Aug 04 16:45:56.785842 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.785834    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-model-cache\") pod \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") "
Aug 04 16:45:56.786076 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.785901    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnpf9\" (UniqueName: \"kubernetes.io/projected/5bdddcdb-bf1c-42a5-8f84-f4918d103739-kube-api-access-lnpf9\") pod \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") "
Aug 04 16:45:56.786076 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.785932    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-home\") pod \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") "
Aug 04 16:45:56.786076 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.785996    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-dshm\") pod \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\" (UID: \"5bdddcdb-bf1c-42a5-8f84-f4918d103739\") "
Aug 04 16:45:56.786076 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.786040    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5bdddcdb-bf1c-42a5-8f84-f4918d103739" (UID: "5bdddcdb-bf1c-42a5-8f84-f4918d103739"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:45:56.786279 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.786223    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-model-cache" (OuterVolumeSpecName: "model-cache") pod "5bdddcdb-bf1c-42a5-8f84-f4918d103739" (UID: "5bdddcdb-bf1c-42a5-8f84-f4918d103739"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:45:56.786279 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.786242    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-home" (OuterVolumeSpecName: "home") pod "5bdddcdb-bf1c-42a5-8f84-f4918d103739" (UID: "5bdddcdb-bf1c-42a5-8f84-f4918d103739"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:45:56.786378 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.786358    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tmp-dir\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:45:56.786425 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.786377    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-model-cache\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:45:56.786425 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.786390    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-home\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:45:56.788109 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.788081    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-dshm" (OuterVolumeSpecName: "dshm") pod "5bdddcdb-bf1c-42a5-8f84-f4918d103739" (UID: "5bdddcdb-bf1c-42a5-8f84-f4918d103739"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:45:56.788223 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.788132    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bdddcdb-bf1c-42a5-8f84-f4918d103739-kube-api-access-lnpf9" (OuterVolumeSpecName: "kube-api-access-lnpf9") pod "5bdddcdb-bf1c-42a5-8f84-f4918d103739" (UID: "5bdddcdb-bf1c-42a5-8f84-f4918d103739"). InnerVolumeSpecName "kube-api-access-lnpf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:45:56.788223 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.788161    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5bdddcdb-bf1c-42a5-8f84-f4918d103739" (UID: "5bdddcdb-bf1c-42a5-8f84-f4918d103739"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:45:56.839597 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.839570    2558 generic.go:356] "Generic (PLEG): container finished" podID="5bdddcdb-bf1c-42a5-8f84-f4918d103739" containerID="fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c" exitCode=0
Aug 04 16:45:56.839717 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.839607    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"
Aug 04 16:45:56.839717 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.839647    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t" event={"ID":"5bdddcdb-bf1c-42a5-8f84-f4918d103739","Type":"ContainerDied","Data":"fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c"}
Aug 04 16:45:56.839717 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.839687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t" event={"ID":"5bdddcdb-bf1c-42a5-8f84-f4918d103739","Type":"ContainerDied","Data":"d301771049c8c336ff2f4bc8e9fb1150f9a6808e476ac2ed2d529992472317ef"}
Aug 04 16:45:56.839717 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.839705    2558 scope.go:117] "RemoveContainer" containerID="fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c"
Aug 04 16:45:56.847772 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.847734    2558 scope.go:117] "RemoveContainer" containerID="fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c"
Aug 04 16:45:56.848070 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:45:56.848051    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c\": container with ID starting with fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c not found: ID does not exist" containerID="fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c"
Aug 04 16:45:56.848162 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.848077    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c"} err="failed to get container status \"fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c\": rpc error: code = NotFound desc = could not find container \"fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c\": container with ID starting with fe8f301e633b0b8bf84780c6daf0d0be826f4b3c87d5244e89e6664f224e718c not found: ID does not exist"
Aug 04 16:45:56.861741 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.861717    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"]
Aug 04 16:45:56.865794 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.865775    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-19c94c/test-model-19c94c-kserve-7944b7fd55-zp89t"]
Aug 04 16:45:56.887645 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.887628    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnpf9\" (UniqueName: \"kubernetes.io/projected/5bdddcdb-bf1c-42a5-8f84-f4918d103739-kube-api-access-lnpf9\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:45:56.887720 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.887649    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bdddcdb-bf1c-42a5-8f84-f4918d103739-dshm\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:45:56.887720 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:56.887659    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bdddcdb-bf1c-42a5-8f84-f4918d103739-tls-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:45:58.693312 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:45:58.693277    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bdddcdb-bf1c-42a5-8f84-f4918d103739" path="/var/lib/kubelet/pods/5bdddcdb-bf1c-42a5-8f84-f4918d103739/volumes"
Aug 04 16:46:16.874172 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:16.874137    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"]
Aug 04 16:46:16.874741 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:16.874404    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy" containerID="cri-o://4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a" gracePeriod=30
Aug 04 16:46:20.309118 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:20.309080    2558 patch_prober.go:28] interesting pod/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 16:46:20.309496 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:20.309136    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 16:46:22.124030 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.124002    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:46:22.208646 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.208563    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-envoy\") pod \"73354dbe-d98c-482f-ad17-10a6922945b7\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") "
Aug 04 16:46:22.208646 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.208607    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-data\") pod \"73354dbe-d98c-482f-ad17-10a6922945b7\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") "
Aug 04 16:46:22.208902 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.208647    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkfqd\" (UniqueName: \"kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-kube-api-access-lkfqd\") pod \"73354dbe-d98c-482f-ad17-10a6922945b7\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") "
Aug 04 16:46:22.208902 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.208671    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73354dbe-d98c-482f-ad17-10a6922945b7-istio-podinfo\") pod \"73354dbe-d98c-482f-ad17-10a6922945b7\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") "
Aug 04 16:46:22.208902 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.208724    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-socket\") pod \"73354dbe-d98c-482f-ad17-10a6922945b7\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") "
Aug 04 16:46:22.208902 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.208781    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73354dbe-d98c-482f-ad17-10a6922945b7-istiod-ca-cert\") pod \"73354dbe-d98c-482f-ad17-10a6922945b7\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") "
Aug 04 16:46:22.208902 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.208808    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-credential-socket\") pod \"73354dbe-d98c-482f-ad17-10a6922945b7\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") "
Aug 04 16:46:22.208902 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.208835    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-istio-token\") pod \"73354dbe-d98c-482f-ad17-10a6922945b7\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") "
Aug 04 16:46:22.208902 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.208876    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-certs\") pod \"73354dbe-d98c-482f-ad17-10a6922945b7\" (UID: \"73354dbe-d98c-482f-ad17-10a6922945b7\") "
Aug 04 16:46:22.209267 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.209031    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "73354dbe-d98c-482f-ad17-10a6922945b7" (UID: "73354dbe-d98c-482f-ad17-10a6922945b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:46:22.209267 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.209175    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73354dbe-d98c-482f-ad17-10a6922945b7" (UID: "73354dbe-d98c-482f-ad17-10a6922945b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:46:22.209370 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.209271    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73354dbe-d98c-482f-ad17-10a6922945b7" (UID: "73354dbe-d98c-482f-ad17-10a6922945b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:46:22.209370 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.209337    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-data\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:46:22.209370 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.209359    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-credential-socket\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:46:22.209517 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.209412    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73354dbe-d98c-482f-ad17-10a6922945b7" (UID: "73354dbe-d98c-482f-ad17-10a6922945b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:46:22.209556 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.209516    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73354dbe-d98c-482f-ad17-10a6922945b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73354dbe-d98c-482f-ad17-10a6922945b7" (UID: "73354dbe-d98c-482f-ad17-10a6922945b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:46:22.211034 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.211010    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73354dbe-d98c-482f-ad17-10a6922945b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73354dbe-d98c-482f-ad17-10a6922945b7" (UID: "73354dbe-d98c-482f-ad17-10a6922945b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:46:22.211153 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.211010    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-kube-api-access-lkfqd" (OuterVolumeSpecName: "kube-api-access-lkfqd") pod "73354dbe-d98c-482f-ad17-10a6922945b7" (UID: "73354dbe-d98c-482f-ad17-10a6922945b7"). InnerVolumeSpecName "kube-api-access-lkfqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:46:22.211153 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.211055    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73354dbe-d98c-482f-ad17-10a6922945b7" (UID: "73354dbe-d98c-482f-ad17-10a6922945b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:46:22.211249 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.211159    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "73354dbe-d98c-482f-ad17-10a6922945b7" (UID: "73354dbe-d98c-482f-ad17-10a6922945b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:46:22.310871 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.310825    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:46:22.310871 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.310868    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-istio-envoy\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:46:22.310871 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.310886    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkfqd\" (UniqueName: \"kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-kube-api-access-lkfqd\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:46:22.311110 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.310897    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73354dbe-d98c-482f-ad17-10a6922945b7-istio-podinfo\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:46:22.311110 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.310906    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73354dbe-d98c-482f-ad17-10a6922945b7-workload-socket\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:46:22.311110 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.310916    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73354dbe-d98c-482f-ad17-10a6922945b7-istiod-ca-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:46:22.311110 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.310925    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73354dbe-d98c-482f-ad17-10a6922945b7-istio-token\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:46:22.954170 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.954078    2558 generic.go:356] "Generic (PLEG): container finished" podID="73354dbe-d98c-482f-ad17-10a6922945b7" containerID="4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a" exitCode=0
Aug 04 16:46:22.954170 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.954128    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"
Aug 04 16:46:22.954170 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.954157    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" event={"ID":"73354dbe-d98c-482f-ad17-10a6922945b7","Type":"ContainerDied","Data":"4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a"}
Aug 04 16:46:22.954423 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.954211    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95" event={"ID":"73354dbe-d98c-482f-ad17-10a6922945b7","Type":"ContainerDied","Data":"c9a8cc44648305259211c37eccf8ff0ebd85526fe21032ebc146cb4652c744a0"}
Aug 04 16:46:22.954423 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.954237    2558 scope.go:117] "RemoveContainer" containerID="4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a"
Aug 04 16:46:22.963113 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.963092    2558 scope.go:117] "RemoveContainer" containerID="0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f"
Aug 04 16:46:22.973077 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.973033    2558 scope.go:117] "RemoveContainer" containerID="4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a"
Aug 04 16:46:22.973844 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:46:22.973816    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a\": container with ID starting with 4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a not found: ID does not exist" containerID="4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a"
Aug 04 16:46:22.973950 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.973849    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a"} err="failed to get container status \"4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a\": rpc error: code = NotFound desc = could not find container \"4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a\": container with ID starting with 4bfc1a76327d1472a8c625354ab6665f54e54048b07f6b1b08a9efd24f62f29a not found: ID does not exist"
Aug 04 16:46:22.973950 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.973891    2558 scope.go:117] "RemoveContainer" containerID="0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f"
Aug 04 16:46:22.974171 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:46:22.974146    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f\": container with ID starting with 0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f not found: ID does not exist" containerID="0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f"
Aug 04 16:46:22.974216 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.974171    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f"} err="failed to get container status \"0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f\": rpc error: code = NotFound desc = could not find container \"0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f\": container with ID starting with 0b329c47cf12432b20f872b6cd52fb2367b1822d22a6d26bd9d8f3411790235f not found: ID does not exist"
Aug 04 16:46:22.975383 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.975363    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"]
Aug 04 16:46:22.979456 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:22.979434    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-19c94c-openshift-default-fcd96b886-btp95"]
Aug 04 16:46:24.695848 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:24.695768    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" path="/var/lib/kubelet/pods/73354dbe-d98c-482f-ad17-10a6922945b7/volumes"
Aug 04 16:46:46.109578 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.109547    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"]
Aug 04 16:46:46.110028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.109882    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy"
Aug 04 16:46:46.110028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.109894    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy"
Aug 04 16:46:46.110028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.109907    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bdddcdb-bf1c-42a5-8f84-f4918d103739" containerName="main"
Aug 04 16:46:46.110028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.109912    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bdddcdb-bf1c-42a5-8f84-f4918d103739" containerName="main"
Aug 04 16:46:46.110028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.109968    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy"
Aug 04 16:46:46.110028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.109976    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bdddcdb-bf1c-42a5-8f84-f4918d103739" containerName="main"
Aug 04 16:46:46.110028 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.109982    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy"
Aug 04 16:46:46.112780 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.112761    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.115867 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.115835    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-2847c7-openshift-default-dockercfg-rwrv6\""
Aug 04 16:46:46.126577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.126555    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"]
Aug 04 16:46:46.223897 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.223856    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2860b454-337e-4c8f-a334-df0ce8938ad6-istiod-ca-cert\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.223897 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.223900    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-data\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.224101 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.223987    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-certs\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.224101 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.224019    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-envoy\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.224101 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.224040    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-credential-socket\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.224101 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.224063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-socket\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.224231 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.224119    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-podinfo\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.224231 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.224147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-token\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.224231 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.224178    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkx9s\" (UniqueName: \"kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-kube-api-access-lkx9s\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325014 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.324933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-podinfo\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325014 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.324974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-token\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325014 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325005    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkx9s\" (UniqueName: \"kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-kube-api-access-lkx9s\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325310 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325056    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2860b454-337e-4c8f-a334-df0ce8938ad6-istiod-ca-cert\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325310 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-data\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325310 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-certs\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325310 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325162    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-envoy\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325310 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325180    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-credential-socket\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325310 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-socket\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325674 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-certs\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325799 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325775    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-socket\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325883 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325824    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-data\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.325883 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.325857    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-credential-socket\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.326045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.326022    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2860b454-337e-4c8f-a334-df0ce8938ad6-istiod-ca-cert\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.327447 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.327423    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-envoy\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.327587 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.327567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-podinfo\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.333555 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.333526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-token\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.333736 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.333717    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkx9s\" (UniqueName: \"kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-kube-api-access-lkx9s\") pod \"e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") " pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.422831 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.422809    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:46.553537 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.553512    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"]
Aug 04 16:46:46.555588 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:46:46.555557    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2860b454_337e_4c8f_a334_df0ce8938ad6.slice/crio-a3ebc8618c550db28ac5c2f38476216cdcdc9ec8a37c73304b23941d0857a41e WatchSource:0}: Error finding container a3ebc8618c550db28ac5c2f38476216cdcdc9ec8a37c73304b23941d0857a41e: Status 404 returned error can't find the container with id a3ebc8618c550db28ac5c2f38476216cdcdc9ec8a37c73304b23941d0857a41e
Aug 04 16:46:46.557840 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.557801    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:46:46.557948 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.557863    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:46:46.557948 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:46.557893    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:46:47.057798 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:47.057760    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" event={"ID":"2860b454-337e-4c8f-a334-df0ce8938ad6","Type":"ContainerStarted","Data":"e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8"}
Aug 04 16:46:47.058000 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:47.057814    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" event={"ID":"2860b454-337e-4c8f-a334-df0ce8938ad6","Type":"ContainerStarted","Data":"a3ebc8618c550db28ac5c2f38476216cdcdc9ec8a37c73304b23941d0857a41e"}
Aug 04 16:46:47.079857 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:47.079803    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" podStartSLOduration=1.079787222 podStartE2EDuration="1.079787222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:46:47.078672462 +0000 UTC m=+2692.935145306" watchObservedRunningTime="2026-08-04 16:46:47.079787222 +0000 UTC m=+2692.936260066"
Aug 04 16:46:47.423107 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:47.423075    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:47.428605 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:47.428577    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:48.062087 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:48.062058    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:48.062994 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:48.062973    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:46:54.770037 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:54.770004    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:46:54.776807 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:46:54.776781    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:47:03.063974 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:03.063883    2558 patch_prober.go:28] interesting pod/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Aug 04 16:47:03.063974 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:03.063943    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Aug 04 16:47:03.129050 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:03.129017    2558 generic.go:356] "Generic (PLEG): container finished" podID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerID="e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8" exitCode=0
Aug 04 16:47:03.129213 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:03.129090    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" event={"ID":"2860b454-337e-4c8f-a334-df0ce8938ad6","Type":"ContainerDied","Data":"e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8"}
Aug 04 16:47:03.129469 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:03.129455    2558 scope.go:117] "RemoveContainer" containerID="e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8"
Aug 04 16:47:03.130461 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:03.130435    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:47:03.130570 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:03.130509    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:47:03.130570 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:03.130547    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:47:04.135754 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:04.135706    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" event={"ID":"2860b454-337e-4c8f-a334-df0ce8938ad6","Type":"ContainerStarted","Data":"ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b"}
Aug 04 16:47:04.423973 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:04.423880    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:47:04.424130 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:04.424093    2558 patch_prober.go:28] interesting pod/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Aug 04 16:47:04.424175 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:04.424153    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Aug 04 16:47:05.424064 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:05.424028    2558 patch_prober.go:28] interesting pod/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Aug 04 16:47:05.424446 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:05.424093    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Aug 04 16:47:06.424169 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:06.424129    2558 patch_prober.go:28] interesting pod/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Aug 04 16:47:06.424580 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:06.424185    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Aug 04 16:47:07.423899 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:07.423864    2558 patch_prober.go:28] interesting pod/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Aug 04 16:47:07.424079 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:07.423932    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Aug 04 16:47:08.423279 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:08.423242    2558 patch_prober.go:28] interesting pod/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Aug 04 16:47:08.423676 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:08.423319    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Aug 04 16:47:09.427607 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:09.427574    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:47:09.428020 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:09.427836    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:47:09.428576 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:47:09.428559    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:48:01.748505 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:01.748471    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"]
Aug 04 16:48:01.749247 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:01.748670    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy" containerID="cri-o://ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b" gracePeriod=30
Aug 04 16:48:06.989201 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:06.989174    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:48:07.043126 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043047    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2860b454-337e-4c8f-a334-df0ce8938ad6-istiod-ca-cert\") pod \"2860b454-337e-4c8f-a334-df0ce8938ad6\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") "
Aug 04 16:48:07.043126 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043085    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkx9s\" (UniqueName: \"kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-kube-api-access-lkx9s\") pod \"2860b454-337e-4c8f-a334-df0ce8938ad6\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") "
Aug 04 16:48:07.043126 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043110    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-token\") pod \"2860b454-337e-4c8f-a334-df0ce8938ad6\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") "
Aug 04 16:48:07.043388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043140    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-certs\") pod \"2860b454-337e-4c8f-a334-df0ce8938ad6\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") "
Aug 04 16:48:07.043388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043220    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-envoy\") pod \"2860b454-337e-4c8f-a334-df0ce8938ad6\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") "
Aug 04 16:48:07.043388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043281    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-credential-socket\") pod \"2860b454-337e-4c8f-a334-df0ce8938ad6\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") "
Aug 04 16:48:07.043388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043318    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-podinfo\") pod \"2860b454-337e-4c8f-a334-df0ce8938ad6\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") "
Aug 04 16:48:07.043388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043354    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-socket\") pod \"2860b454-337e-4c8f-a334-df0ce8938ad6\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") "
Aug 04 16:48:07.043640 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043390    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-data\") pod \"2860b454-337e-4c8f-a334-df0ce8938ad6\" (UID: \"2860b454-337e-4c8f-a334-df0ce8938ad6\") "
Aug 04 16:48:07.043640 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043450    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2860b454-337e-4c8f-a334-df0ce8938ad6" (UID: "2860b454-337e-4c8f-a334-df0ce8938ad6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:48:07.043778 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043699    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-data" (OuterVolumeSpecName: "istio-data") pod "2860b454-337e-4c8f-a334-df0ce8938ad6" (UID: "2860b454-337e-4c8f-a334-df0ce8938ad6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:48:07.043778 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043457    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2860b454-337e-4c8f-a334-df0ce8938ad6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2860b454-337e-4c8f-a334-df0ce8938ad6" (UID: "2860b454-337e-4c8f-a334-df0ce8938ad6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:48:07.043778 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043715    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2860b454-337e-4c8f-a334-df0ce8938ad6" (UID: "2860b454-337e-4c8f-a334-df0ce8938ad6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:48:07.043949 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043801    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:48:07.043949 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.043824    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2860b454-337e-4c8f-a334-df0ce8938ad6" (UID: "2860b454-337e-4c8f-a334-df0ce8938ad6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:48:07.045399 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.045363    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2860b454-337e-4c8f-a334-df0ce8938ad6" (UID: "2860b454-337e-4c8f-a334-df0ce8938ad6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:48:07.045506 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.045467    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-kube-api-access-lkx9s" (OuterVolumeSpecName: "kube-api-access-lkx9s") pod "2860b454-337e-4c8f-a334-df0ce8938ad6" (UID: "2860b454-337e-4c8f-a334-df0ce8938ad6"). InnerVolumeSpecName "kube-api-access-lkx9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:48:07.045679 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.045657    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-token" (OuterVolumeSpecName: "istio-token") pod "2860b454-337e-4c8f-a334-df0ce8938ad6" (UID: "2860b454-337e-4c8f-a334-df0ce8938ad6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:48:07.045740 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.045661    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2860b454-337e-4c8f-a334-df0ce8938ad6" (UID: "2860b454-337e-4c8f-a334-df0ce8938ad6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:48:07.144862 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.144837    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-envoy\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:48:07.144862 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.144860    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-credential-socket\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:48:07.145029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.144869    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-podinfo\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:48:07.145029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.144879    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-workload-socket\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:48:07.145029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.144887    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-data\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:48:07.145029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.144896    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2860b454-337e-4c8f-a334-df0ce8938ad6-istiod-ca-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:48:07.145029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.144903    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkx9s\" (UniqueName: \"kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-kube-api-access-lkx9s\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:48:07.145029 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.144912    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2860b454-337e-4c8f-a334-df0ce8938ad6-istio-token\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:48:07.415660 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.415629    2558 generic.go:356] "Generic (PLEG): container finished" podID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerID="ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b" exitCode=0
Aug 04 16:48:07.415858 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.415674    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"
Aug 04 16:48:07.415858 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.415698    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" event={"ID":"2860b454-337e-4c8f-a334-df0ce8938ad6","Type":"ContainerDied","Data":"ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b"}
Aug 04 16:48:07.415858 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.415741    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl" event={"ID":"2860b454-337e-4c8f-a334-df0ce8938ad6","Type":"ContainerDied","Data":"a3ebc8618c550db28ac5c2f38476216cdcdc9ec8a37c73304b23941d0857a41e"}
Aug 04 16:48:07.415858 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.415776    2558 scope.go:117] "RemoveContainer" containerID="ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b"
Aug 04 16:48:07.424425 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.424408    2558 scope.go:117] "RemoveContainer" containerID="e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8"
Aug 04 16:48:07.432126 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.432100    2558 scope.go:117] "RemoveContainer" containerID="ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b"
Aug 04 16:48:07.432440 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:48:07.432419    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b\": container with ID starting with ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b not found: ID does not exist" containerID="ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b"
Aug 04 16:48:07.432524 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.432448    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b"} err="failed to get container status \"ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b\": rpc error: code = NotFound desc = could not find container \"ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b\": container with ID starting with ef3ac0e6c4402ace472040b1c247263f624b1244311bf446fb45d368ed44218b not found: ID does not exist"
Aug 04 16:48:07.432524 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.432465    2558 scope.go:117] "RemoveContainer" containerID="e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8"
Aug 04 16:48:07.432724 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:48:07.432702    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8\": container with ID starting with e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8 not found: ID does not exist" containerID="e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8"
Aug 04 16:48:07.432818 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.432730    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8"} err="failed to get container status \"e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8\": rpc error: code = NotFound desc = could not find container \"e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8\": container with ID starting with e280b9af37214479963326ef94ed3783b90062e59803ed4dfe122e06f7a530f8 not found: ID does not exist"
Aug 04 16:48:07.439044 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.439023    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"]
Aug 04 16:48:07.443346 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:07.443323    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-2847c7-openshift-default-59fc9bc5fb-9s5cl"]
Aug 04 16:48:08.692699 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:08.692666    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" path="/var/lib/kubelet/pods/2860b454-337e-4c8f-a334-df0ce8938ad6/volumes"
Aug 04 16:48:31.923840 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:31.923763    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"]
Aug 04 16:48:31.924287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:31.924125    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy"
Aug 04 16:48:31.924287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:31.924137    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy"
Aug 04 16:48:31.924287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:31.924158    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy"
Aug 04 16:48:31.924287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:31.924163    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="73354dbe-d98c-482f-ad17-10a6922945b7" containerName="istio-proxy"
Aug 04 16:48:31.924287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:31.924222    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy"
Aug 04 16:48:31.924287 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:31.924230    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy"
Aug 04 16:48:31.926982 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:31.926966    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:31.930159 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:31.930136    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-222eca-openshift-default-dockercfg-p998c\""
Aug 04 16:48:31.944066 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:31.944044    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"]
Aug 04 16:48:32.058631 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.058596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-certs\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.058819 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.058637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-data\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.058819 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.058658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-socket\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.058819 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.058732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istiod-ca-cert\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.058819 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.058791    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-credential-socket\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.058972 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.058853    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-token\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.058972 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.058872    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4ckc\" (UniqueName: \"kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-kube-api-access-z4ckc\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.058972 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.058928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-podinfo\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.058972 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.058962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-envoy\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.159757 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.159721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-podinfo\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.159919 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.159787    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-envoy\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.159919 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.159825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-certs\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.159919 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.159843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-data\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.159919 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.159862    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-socket\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.160095 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.160024    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istiod-ca-cert\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.160095 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.160071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-credential-socket\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.160198 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.160137    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-token\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.160198 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.160163    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4ckc\" (UniqueName: \"kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-kube-api-access-z4ckc\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.160342 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.160228    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-data\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.160342 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.160250    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-socket\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.160542 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.160515    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-certs\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.160672 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.160549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-credential-socket\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.160838 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.160816    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istiod-ca-cert\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.162187 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.162168    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-envoy\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.162280 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.162214    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-podinfo\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.168441 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.168420    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-token\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.168650 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.168626    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4ckc\" (UniqueName: \"kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-kube-api-access-z4ckc\") pod \"e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") " pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.236702 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.236650    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:32.367273 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.367247    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"]
Aug 04 16:48:32.369510 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:48:32.369477    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6169ebb_7dd8_4665_acd9_4edddbbd2aed.slice/crio-649ae3ded6d0c0c3f7739853c1dd364eec2ba0cf470bfa72d1d8866fa5a650d5 WatchSource:0}: Error finding container 649ae3ded6d0c0c3f7739853c1dd364eec2ba0cf470bfa72d1d8866fa5a650d5: Status 404 returned error can't find the container with id 649ae3ded6d0c0c3f7739853c1dd364eec2ba0cf470bfa72d1d8866fa5a650d5
Aug 04 16:48:32.374281 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.374251    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:48:32.374365 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.374311    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:48:32.374365 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.374341    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:48:32.527137 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.527039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" event={"ID":"c6169ebb-7dd8-4665-acd9-4edddbbd2aed","Type":"ContainerStarted","Data":"6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4"}
Aug 04 16:48:32.527137 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:32.527102    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" event={"ID":"c6169ebb-7dd8-4665-acd9-4edddbbd2aed","Type":"ContainerStarted","Data":"649ae3ded6d0c0c3f7739853c1dd364eec2ba0cf470bfa72d1d8866fa5a650d5"}
Aug 04 16:48:33.236922 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:33.236891    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:33.241834 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:33.241812    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:33.264670 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:33.264623    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" podStartSLOduration=2.264607929 podStartE2EDuration="2.264607929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:48:32.546881916 +0000 UTC m=+2798.403354764" watchObservedRunningTime="2026-08-04 16:48:33.264607929 +0000 UTC m=+2799.121080772"
Aug 04 16:48:33.532124 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:33.532035    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:33.533498 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:33.533474    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:48.533833 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:48.533795    2558 patch_prober.go:28] interesting pod/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 16:48:48.534269 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:48.533861    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 16:48:48.606392 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:48.606358    2558 generic.go:356] "Generic (PLEG): container finished" podID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerID="6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4" exitCode=0
Aug 04 16:48:48.606554 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:48.606433    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" event={"ID":"c6169ebb-7dd8-4665-acd9-4edddbbd2aed","Type":"ContainerDied","Data":"6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4"}
Aug 04 16:48:48.606873 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:48.606858    2558 scope.go:117] "RemoveContainer" containerID="6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4"
Aug 04 16:48:48.607976 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:48.607949    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:48:48.608046 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:48.608022    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:48:48.608080 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:48.608058    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:48:49.613206 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:49.613173    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" event={"ID":"c6169ebb-7dd8-4665-acd9-4edddbbd2aed","Type":"ContainerStarted","Data":"9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0"}
Aug 04 16:48:50.237840 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:50.237802    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:50.238075 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:50.238043    2558 patch_prober.go:28] interesting pod/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 16:48:50.238151 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:50.238105    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 16:48:51.238165 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:51.238128    2558 patch_prober.go:28] interesting pod/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 16:48:51.238803 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:51.238763    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 16:48:52.238161 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:52.238117    2558 patch_prober.go:28] interesting pod/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 16:48:52.238660 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:52.238185    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 16:48:53.237261 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:53.237210    2558 patch_prober.go:28] interesting pod/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 16:48:53.237450 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:53.237281    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 16:48:54.237727 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:54.237682    2558 patch_prober.go:28] interesting pod/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Aug 04 16:48:54.238225 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:54.237773    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Aug 04 16:48:55.241532 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:55.241447    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:55.241963 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:55.241706    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:48:55.242564 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:48:55.242548    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 16:49:19.810349 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.810316    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"]
Aug 04 16:49:19.810984 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.810856    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy"
Aug 04 16:49:19.810984 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.810878    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2860b454-337e-4c8f-a334-df0ce8938ad6" containerName="istio-proxy"
Aug 04 16:49:19.812859 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.812840    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:19.817079 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.817055    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e1c51\"/\"auth-test-model-4e1c51-kserve-self-signed-certs\""
Aug 04 16:49:19.817216 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.817076    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e1c51\"/\"kube-root-ca.crt\""
Aug 04 16:49:19.817299 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.817127    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e1c51\"/\"default-dockercfg-s64fs\""
Aug 04 16:49:19.817371 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.817279    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e1c51\"/\"openshift-service-ca.crt\""
Aug 04 16:49:19.823275 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.823253    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"]
Aug 04 16:49:19.898947 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.898918    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tmp-dir\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:19.899073 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.898956    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-dshm\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:19.899073 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.899029    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdmpp\" (UniqueName: \"kubernetes.io/projected/45cc3be2-a19b-4709-b1db-3b4e7f199c52-kube-api-access-zdmpp\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:19.899170 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.899113    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tls-certs\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:19.899170 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.899151    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-home\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:19.899252 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.899170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-model-cache\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:19.999969 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:19.999939    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdmpp\" (UniqueName: \"kubernetes.io/projected/45cc3be2-a19b-4709-b1db-3b4e7f199c52-kube-api-access-zdmpp\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.000140 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.000009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tls-certs\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.000140 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.000062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-home\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.000140 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.000085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-model-cache\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.000140 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.000110    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tmp-dir\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.000140 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.000138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-dshm\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.000492 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.000468    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-model-cache\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.000552 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.000491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-home\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.000552 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.000520    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tmp-dir\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.002240 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.002223    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-dshm\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.002365 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.002348    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tls-certs\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.010374 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.010350    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdmpp\" (UniqueName: \"kubernetes.io/projected/45cc3be2-a19b-4709-b1db-3b4e7f199c52-kube-api-access-zdmpp\") pod \"auth-test-model-4e1c51-kserve-6d7984664c-5tq58\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") " pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.122681 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.122649    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:20.264183 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.264154    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"]
Aug 04 16:49:20.265585 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:49:20.265549    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45cc3be2_a19b_4709_b1db_3b4e7f199c52.slice/crio-c82a78bac6ec280d200ec8f7e33c341a3c2af40c127b4642581542b866fc5803 WatchSource:0}: Error finding container c82a78bac6ec280d200ec8f7e33c341a3c2af40c127b4642581542b866fc5803: Status 404 returned error can't find the container with id c82a78bac6ec280d200ec8f7e33c341a3c2af40c127b4642581542b866fc5803
Aug 04 16:49:20.753924 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.753892    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58" event={"ID":"45cc3be2-a19b-4709-b1db-3b4e7f199c52","Type":"ContainerStarted","Data":"dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d"}
Aug 04 16:49:20.754094 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.753938    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58" event={"ID":"45cc3be2-a19b-4709-b1db-3b4e7f199c52","Type":"ContainerStarted","Data":"c82a78bac6ec280d200ec8f7e33c341a3c2af40c127b4642581542b866fc5803"}
Aug 04 16:49:20.773102 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:20.773056    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58" podStartSLOduration=1.773040741 podStartE2EDuration="1.773040741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:49:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:49:20.771664395 +0000 UTC m=+2846.628137238" watchObservedRunningTime="2026-08-04 16:49:20.773040741 +0000 UTC m=+2846.629513576"
Aug 04 16:49:30.123306 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:30.123273    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:30.123802 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:30.123330    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:30.135557 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:30.135531    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:49:30.810364 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:49:30.810333    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:50:04.314450 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.314374    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"]
Aug 04 16:50:04.317338 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.317321    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.322002 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.321975    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"auth-test-model-222eca-kserve-self-signed-certs\""
Aug 04 16:50:04.322002 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.321992    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"kube-root-ca.crt\""
Aug 04 16:50:04.322191 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.321975    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"openshift-service-ca.crt\""
Aug 04 16:50:04.322191 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.321979    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"default-dockercfg-jgfrm\""
Aug 04 16:50:04.326502 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.326472    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"]
Aug 04 16:50:04.406453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.406406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-dshm\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.406453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.406455    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7048657f-65a9-4287-87e1-3bc67aa52995-tls-certs\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.406723 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.406485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-home\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.406723 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.406560    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-tmp-dir\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.406723 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.406688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-model-cache\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.406723 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.406719    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jqdw\" (UniqueName: \"kubernetes.io/projected/7048657f-65a9-4287-87e1-3bc67aa52995-kube-api-access-7jqdw\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.508042 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.507997    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-model-cache\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.508042 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.508039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jqdw\" (UniqueName: \"kubernetes.io/projected/7048657f-65a9-4287-87e1-3bc67aa52995-kube-api-access-7jqdw\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.508278 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.508062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-dshm\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.508278 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.508078    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7048657f-65a9-4287-87e1-3bc67aa52995-tls-certs\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.508278 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.508095    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-home\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.508278 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.508138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-tmp-dir\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.508508 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.508456    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-model-cache\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.508569 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.508510    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-home\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.508622 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.508563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-tmp-dir\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.510319 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.510297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-dshm\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.510635 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.510612    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7048657f-65a9-4287-87e1-3bc67aa52995-tls-certs\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.518195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.518173    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jqdw\" (UniqueName: \"kubernetes.io/projected/7048657f-65a9-4287-87e1-3bc67aa52995-kube-api-access-7jqdw\") pod \"auth-test-model-222eca-kserve-84cb97c467-8cvkp\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") " pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.627419 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.627381    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:04.761864 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.761838    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"]
Aug 04 16:50:04.763562 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:50:04.763531    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7048657f_65a9_4287_87e1_3bc67aa52995.slice/crio-738cf4b60f6b751a3f8bba333dba095b6313398eaa13279fbc415a1969f49f9b WatchSource:0}: Error finding container 738cf4b60f6b751a3f8bba333dba095b6313398eaa13279fbc415a1969f49f9b: Status 404 returned error can't find the container with id 738cf4b60f6b751a3f8bba333dba095b6313398eaa13279fbc415a1969f49f9b
Aug 04 16:50:04.945534 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.945444    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp" event={"ID":"7048657f-65a9-4287-87e1-3bc67aa52995","Type":"ContainerStarted","Data":"9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b"}
Aug 04 16:50:04.945534 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.945487    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp" event={"ID":"7048657f-65a9-4287-87e1-3bc67aa52995","Type":"ContainerStarted","Data":"738cf4b60f6b751a3f8bba333dba095b6313398eaa13279fbc415a1969f49f9b"}
Aug 04 16:50:04.964182 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:04.964111    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp" podStartSLOduration=0.964089501 podStartE2EDuration="964.089501ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:50:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:50:04.96303715 +0000 UTC m=+2890.819509993" watchObservedRunningTime="2026-08-04 16:50:04.964089501 +0000 UTC m=+2890.820562346"
Aug 04 16:50:14.628181 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:14.628142    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:14.628685 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:14.628216    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:14.641550 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:14.641522    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:50:14.999769 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:50:14.999680    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:51:54.797627 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:51:54.797599    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:51:54.802851 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:51:54.802829    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:54:03.531273 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:03.531235    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"]
Aug 04 16:54:04.306086 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:04.306043    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"]
Aug 04 16:54:18.550127 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.549982    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58" podUID="45cc3be2-a19b-4709-b1db-3b4e7f199c52" containerName="main" containerID="cri-o://dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d" gracePeriod=45
Aug 04 16:54:18.804776 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.804688    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:54:18.829619 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.829577    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-dshm\") pod \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") "
Aug 04 16:54:18.829815 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.829656    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tmp-dir\") pod \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") "
Aug 04 16:54:18.829815 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.829685    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdmpp\" (UniqueName: \"kubernetes.io/projected/45cc3be2-a19b-4709-b1db-3b4e7f199c52-kube-api-access-zdmpp\") pod \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") "
Aug 04 16:54:18.829815 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.829791    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tls-certs\") pod \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") "
Aug 04 16:54:18.830012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.829850    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-model-cache\") pod \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") "
Aug 04 16:54:18.830012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.829914    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-home\") pod \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\" (UID: \"45cc3be2-a19b-4709-b1db-3b4e7f199c52\") "
Aug 04 16:54:18.830012 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.829929    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "45cc3be2-a19b-4709-b1db-3b4e7f199c52" (UID: "45cc3be2-a19b-4709-b1db-3b4e7f199c52"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:54:18.830179 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.830152    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-model-cache" (OuterVolumeSpecName: "model-cache") pod "45cc3be2-a19b-4709-b1db-3b4e7f199c52" (UID: "45cc3be2-a19b-4709-b1db-3b4e7f199c52"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:54:18.830243 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.830204    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tmp-dir\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:18.830301 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.830258    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-home" (OuterVolumeSpecName: "home") pod "45cc3be2-a19b-4709-b1db-3b4e7f199c52" (UID: "45cc3be2-a19b-4709-b1db-3b4e7f199c52"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:54:18.832043 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.832015    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-dshm" (OuterVolumeSpecName: "dshm") pod "45cc3be2-a19b-4709-b1db-3b4e7f199c52" (UID: "45cc3be2-a19b-4709-b1db-3b4e7f199c52"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:54:18.832312 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.832280    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "45cc3be2-a19b-4709-b1db-3b4e7f199c52" (UID: "45cc3be2-a19b-4709-b1db-3b4e7f199c52"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:54:18.832422 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.832342    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45cc3be2-a19b-4709-b1db-3b4e7f199c52-kube-api-access-zdmpp" (OuterVolumeSpecName: "kube-api-access-zdmpp") pod "45cc3be2-a19b-4709-b1db-3b4e7f199c52" (UID: "45cc3be2-a19b-4709-b1db-3b4e7f199c52"). InnerVolumeSpecName "kube-api-access-zdmpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:54:18.931248 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.931209    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-model-cache\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:18.931248 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.931240    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-home\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:18.931248 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.931249    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cc3be2-a19b-4709-b1db-3b4e7f199c52-dshm\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:18.931248 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.931258    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdmpp\" (UniqueName: \"kubernetes.io/projected/45cc3be2-a19b-4709-b1db-3b4e7f199c52-kube-api-access-zdmpp\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:18.931519 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:18.931268    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cc3be2-a19b-4709-b1db-3b4e7f199c52-tls-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:19.085824 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.085719    2558 generic.go:356] "Generic (PLEG): container finished" podID="45cc3be2-a19b-4709-b1db-3b4e7f199c52" containerID="dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d" exitCode=0
Aug 04 16:54:19.085824 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.085792    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58" event={"ID":"45cc3be2-a19b-4709-b1db-3b4e7f199c52","Type":"ContainerDied","Data":"dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d"}
Aug 04 16:54:19.086049 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.085834    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58" event={"ID":"45cc3be2-a19b-4709-b1db-3b4e7f199c52","Type":"ContainerDied","Data":"c82a78bac6ec280d200ec8f7e33c341a3c2af40c127b4642581542b866fc5803"}
Aug 04 16:54:19.086049 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.085851    2558 scope.go:117] "RemoveContainer" containerID="dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d"
Aug 04 16:54:19.086049 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.085796    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"
Aug 04 16:54:19.094632 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.094614    2558 scope.go:117] "RemoveContainer" containerID="dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d"
Aug 04 16:54:19.094921 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:54:19.094891    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d\": container with ID starting with dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d not found: ID does not exist" containerID="dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d"
Aug 04 16:54:19.095003 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.094924    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d"} err="failed to get container status \"dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d\": rpc error: code = NotFound desc = could not find container \"dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d\": container with ID starting with dbd92483b6afbe82011b2523812a8be79f8056f5bd57fccb4f9b84696d3ecd1d not found: ID does not exist"
Aug 04 16:54:19.107410 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.107382    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"]
Aug 04 16:54:19.110845 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.110825    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/auth-test-model-4e1c51-kserve-6d7984664c-5tq58"]
Aug 04 16:54:19.325475 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.325431    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp" podUID="7048657f-65a9-4287-87e1-3bc67aa52995" containerName="main" containerID="cri-o://9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b" gracePeriod=45
Aug 04 16:54:19.577953 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.577921    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:54:19.637920 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.637885    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-model-cache\") pod \"7048657f-65a9-4287-87e1-3bc67aa52995\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") "
Aug 04 16:54:19.638117 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.637956    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-dshm\") pod \"7048657f-65a9-4287-87e1-3bc67aa52995\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") "
Aug 04 16:54:19.638117 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.637980    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7048657f-65a9-4287-87e1-3bc67aa52995-tls-certs\") pod \"7048657f-65a9-4287-87e1-3bc67aa52995\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") "
Aug 04 16:54:19.638117 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.638013    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-tmp-dir\") pod \"7048657f-65a9-4287-87e1-3bc67aa52995\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") "
Aug 04 16:54:19.638117 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.638042    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jqdw\" (UniqueName: \"kubernetes.io/projected/7048657f-65a9-4287-87e1-3bc67aa52995-kube-api-access-7jqdw\") pod \"7048657f-65a9-4287-87e1-3bc67aa52995\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") "
Aug 04 16:54:19.638117 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.638061    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-home\") pod \"7048657f-65a9-4287-87e1-3bc67aa52995\" (UID: \"7048657f-65a9-4287-87e1-3bc67aa52995\") "
Aug 04 16:54:19.638388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.638176    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-model-cache" (OuterVolumeSpecName: "model-cache") pod "7048657f-65a9-4287-87e1-3bc67aa52995" (UID: "7048657f-65a9-4287-87e1-3bc67aa52995"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:54:19.638388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.638294    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7048657f-65a9-4287-87e1-3bc67aa52995" (UID: "7048657f-65a9-4287-87e1-3bc67aa52995"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:54:19.638388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.638382    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-home" (OuterVolumeSpecName: "home") pod "7048657f-65a9-4287-87e1-3bc67aa52995" (UID: "7048657f-65a9-4287-87e1-3bc67aa52995"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:54:19.638523 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.638436    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-model-cache\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:19.638523 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.638456    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-tmp-dir\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:19.640343 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.640323    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7048657f-65a9-4287-87e1-3bc67aa52995-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7048657f-65a9-4287-87e1-3bc67aa52995" (UID: "7048657f-65a9-4287-87e1-3bc67aa52995"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:54:19.640429 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.640385    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-dshm" (OuterVolumeSpecName: "dshm") pod "7048657f-65a9-4287-87e1-3bc67aa52995" (UID: "7048657f-65a9-4287-87e1-3bc67aa52995"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:54:19.640477 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.640421    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7048657f-65a9-4287-87e1-3bc67aa52995-kube-api-access-7jqdw" (OuterVolumeSpecName: "kube-api-access-7jqdw") pod "7048657f-65a9-4287-87e1-3bc67aa52995" (UID: "7048657f-65a9-4287-87e1-3bc67aa52995"). InnerVolumeSpecName "kube-api-access-7jqdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:54:19.739154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.739069    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-dshm\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:19.739154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.739100    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7048657f-65a9-4287-87e1-3bc67aa52995-tls-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:19.739154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.739112    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jqdw\" (UniqueName: \"kubernetes.io/projected/7048657f-65a9-4287-87e1-3bc67aa52995-kube-api-access-7jqdw\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:19.739154 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:19.739121    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7048657f-65a9-4287-87e1-3bc67aa52995-home\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:54:20.092659 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.092574    2558 generic.go:356] "Generic (PLEG): container finished" podID="7048657f-65a9-4287-87e1-3bc67aa52995" containerID="9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b" exitCode=0
Aug 04 16:54:20.092659 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.092615    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"
Aug 04 16:54:20.092857 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.092655    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp" event={"ID":"7048657f-65a9-4287-87e1-3bc67aa52995","Type":"ContainerDied","Data":"9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b"}
Aug 04 16:54:20.092857 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.092697    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp" event={"ID":"7048657f-65a9-4287-87e1-3bc67aa52995","Type":"ContainerDied","Data":"738cf4b60f6b751a3f8bba333dba095b6313398eaa13279fbc415a1969f49f9b"}
Aug 04 16:54:20.092857 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.092716    2558 scope.go:117] "RemoveContainer" containerID="9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b"
Aug 04 16:54:20.101435 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.101420    2558 scope.go:117] "RemoveContainer" containerID="9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b"
Aug 04 16:54:20.101701 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:54:20.101684    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b\": container with ID starting with 9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b not found: ID does not exist" containerID="9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b"
Aug 04 16:54:20.101768 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.101709    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b"} err="failed to get container status \"9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b\": rpc error: code = NotFound desc = could not find container \"9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b\": container with ID starting with 9f86c67c13cedfd5cc0b167ff0f68dfdd18924f6bbd44b256346a57ddc43865b not found: ID does not exist"
Aug 04 16:54:20.113394 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.113371    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"]
Aug 04 16:54:20.117596 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.117574    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/auth-test-model-222eca-kserve-84cb97c467-8cvkp"]
Aug 04 16:54:20.693615 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.693581    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45cc3be2-a19b-4709-b1db-3b4e7f199c52" path="/var/lib/kubelet/pods/45cc3be2-a19b-4709-b1db-3b4e7f199c52/volumes"
Aug 04 16:54:20.694023 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:20.694009    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7048657f-65a9-4287-87e1-3bc67aa52995" path="/var/lib/kubelet/pods/7048657f-65a9-4287-87e1-3bc67aa52995/volumes"
Aug 04 16:54:43.557381 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.557347    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"]
Aug 04 16:54:43.557789 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.557692    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45cc3be2-a19b-4709-b1db-3b4e7f199c52" containerName="main"
Aug 04 16:54:43.557789 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.557703    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="45cc3be2-a19b-4709-b1db-3b4e7f199c52" containerName="main"
Aug 04 16:54:43.557789 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.557717    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7048657f-65a9-4287-87e1-3bc67aa52995" containerName="main"
Aug 04 16:54:43.557789 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.557722    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7048657f-65a9-4287-87e1-3bc67aa52995" containerName="main"
Aug 04 16:54:43.557933 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.557816    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7048657f-65a9-4287-87e1-3bc67aa52995" containerName="main"
Aug 04 16:54:43.557933 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.557826    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="45cc3be2-a19b-4709-b1db-3b4e7f199c52" containerName="main"
Aug 04 16:54:43.560719 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.560704    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.565108 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.565088    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"kube-root-ca.crt\""
Aug 04 16:54:43.566409 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.566387    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"sub-test-model-222eca-kserve-self-signed-certs\""
Aug 04 16:54:43.566525 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.566389    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"openshift-service-ca.crt\""
Aug 04 16:54:43.566525 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.566479    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"default-dockercfg-jgfrm\""
Aug 04 16:54:43.574895 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.574874    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"]
Aug 04 16:54:43.654365 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.654332    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tmp-dir\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.654653 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.654404    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-home\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.654653 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.654460    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7sxd\" (UniqueName: \"kubernetes.io/projected/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-kube-api-access-h7sxd\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.654653 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.654533    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tls-certs\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.654653 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.654632    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-model-cache\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.654857 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.654666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-dshm\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.755429 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.755391    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-home\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.755630 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.755443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7sxd\" (UniqueName: \"kubernetes.io/projected/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-kube-api-access-h7sxd\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.755630 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.755462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tls-certs\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.755630 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.755499    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-model-cache\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.755630 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.755515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-dshm\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.755630 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.755556    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tmp-dir\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.755938 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.755906    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-home\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.755983 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.755933    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tmp-dir\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.756022 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.755977    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-model-cache\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.757792 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.757773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-dshm\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.758127 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.758111    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tls-certs\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.769052 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.769025    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7sxd\" (UniqueName: \"kubernetes.io/projected/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-kube-api-access-h7sxd\") pod \"sub-test-model-222eca-kserve-868f76758f-kcbvr\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") " pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:43.869803 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:43.869775    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:44.034313 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:44.034242    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"]
Aug 04 16:54:44.037606 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:54:44.037573    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92bb0ef5_1c6b_4034_9b38_8e3fbe67c330.slice/crio-7e8f8b6e192548b2559f68e7e68b54f9894758f11b7399e5beaaf4d58e675f99 WatchSource:0}: Error finding container 7e8f8b6e192548b2559f68e7e68b54f9894758f11b7399e5beaaf4d58e675f99: Status 404 returned error can't find the container with id 7e8f8b6e192548b2559f68e7e68b54f9894758f11b7399e5beaaf4d58e675f99
Aug 04 16:54:44.198814 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:44.198724    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr" event={"ID":"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330","Type":"ContainerStarted","Data":"40c8f56c01bce5f2535bb364e7bced8141d4124018453bf1724a50a4cc4eba37"}
Aug 04 16:54:44.198814 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:44.198782    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr" event={"ID":"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330","Type":"ContainerStarted","Data":"7e8f8b6e192548b2559f68e7e68b54f9894758f11b7399e5beaaf4d58e675f99"}
Aug 04 16:54:44.218461 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:44.218413    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr" podStartSLOduration=1.218397964 podStartE2EDuration="1.218397964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:54:44.216426277 +0000 UTC m=+3170.072899124" watchObservedRunningTime="2026-08-04 16:54:44.218397964 +0000 UTC m=+3170.074870841"
Aug 04 16:54:53.870149 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:53.870118    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:53.870598 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:53.870384    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:53.882736 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:53.882714    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:54:54.254377 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:54:54.254298    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:55:51.415442 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:55:51.415360    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"]
Aug 04 16:56:06.434307 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.434249    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr" podUID="92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" containerName="main" containerID="cri-o://40c8f56c01bce5f2535bb364e7bced8141d4124018453bf1724a50a4cc4eba37" gracePeriod=45
Aug 04 16:56:06.564268 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.564236    2558 generic.go:356] "Generic (PLEG): container finished" podID="92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" containerID="40c8f56c01bce5f2535bb364e7bced8141d4124018453bf1724a50a4cc4eba37" exitCode=0
Aug 04 16:56:06.564389 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.564307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr" event={"ID":"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330","Type":"ContainerDied","Data":"40c8f56c01bce5f2535bb364e7bced8141d4124018453bf1724a50a4cc4eba37"}
Aug 04 16:56:06.677481 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.677459    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:56:06.790439 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.790340    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tmp-dir\") pod \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") "
Aug 04 16:56:06.790439 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.790411    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-home\") pod \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") "
Aug 04 16:56:06.790692 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.790459    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7sxd\" (UniqueName: \"kubernetes.io/projected/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-kube-api-access-h7sxd\") pod \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") "
Aug 04 16:56:06.790692 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.790480    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-model-cache\") pod \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") "
Aug 04 16:56:06.790692 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.790616    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tls-certs\") pod \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") "
Aug 04 16:56:06.790692 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.790652    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" (UID: "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:56:06.790874 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.790701    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-home" (OuterVolumeSpecName: "home") pod "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" (UID: "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:56:06.790874 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.790711    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-model-cache" (OuterVolumeSpecName: "model-cache") pod "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" (UID: "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:56:06.790874 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.790705    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-dshm\") pod \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\" (UID: \"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330\") "
Aug 04 16:56:06.791062 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.791043    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tmp-dir\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:56:06.791129 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.791065    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-home\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:56:06.791129 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.791074    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-model-cache\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:56:06.792585 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.792564    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-dshm" (OuterVolumeSpecName: "dshm") pod "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" (UID: "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:56:06.792684 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.792609    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" (UID: "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:56:06.792684 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.792667    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-kube-api-access-h7sxd" (OuterVolumeSpecName: "kube-api-access-h7sxd") pod "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" (UID: "92bb0ef5-1c6b-4034-9b38-8e3fbe67c330"). InnerVolumeSpecName "kube-api-access-h7sxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:56:06.891695 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.891670    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7sxd\" (UniqueName: \"kubernetes.io/projected/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-kube-api-access-h7sxd\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:56:06.891695 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.891690    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-tls-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:56:06.891695 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:06.891700    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330-dshm\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:56:07.569608 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:07.569567    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr" event={"ID":"92bb0ef5-1c6b-4034-9b38-8e3fbe67c330","Type":"ContainerDied","Data":"7e8f8b6e192548b2559f68e7e68b54f9894758f11b7399e5beaaf4d58e675f99"}
Aug 04 16:56:07.569608 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:07.569594    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"
Aug 04 16:56:07.570150 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:07.569620    2558 scope.go:117] "RemoveContainer" containerID="40c8f56c01bce5f2535bb364e7bced8141d4124018453bf1724a50a4cc4eba37"
Aug 04 16:56:07.592172 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:07.592148    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"]
Aug 04 16:56:07.595641 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:07.595618    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/sub-test-model-222eca-kserve-868f76758f-kcbvr"]
Aug 04 16:56:08.692114 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:08.692079    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" path="/var/lib/kubelet/pods/92bb0ef5-1c6b-4034-9b38-8e3fbe67c330/volumes"
Aug 04 16:56:13.309332 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.309295    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"]
Aug 04 16:56:13.309872 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.309852    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" containerName="main"
Aug 04 16:56:13.309956 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.309877    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" containerName="main"
Aug 04 16:56:13.310004 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.309982    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="92bb0ef5-1c6b-4034-9b38-8e3fbe67c330" containerName="main"
Aug 04 16:56:13.314721 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.314701    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.317489 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.317465    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e1c51\"/\"kube-root-ca.crt\""
Aug 04 16:56:13.319110 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.319008    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e1c51\"/\"rate-test-model-4e1c51-kserve-self-signed-certs\""
Aug 04 16:56:13.319110 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.319022    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e1c51\"/\"default-dockercfg-s64fs\""
Aug 04 16:56:13.319401 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.319377    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e1c51\"/\"openshift-service-ca.crt\""
Aug 04 16:56:13.321660 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.321638    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"]
Aug 04 16:56:13.449944 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.449907    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-home\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.450112 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.449963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-model-cache\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.450112 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.450042    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltqb\" (UniqueName: \"kubernetes.io/projected/9d743e4b-0b72-4a5e-9025-d264fa49bf42-kube-api-access-8ltqb\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.450112 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.450107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tmp-dir\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.450237 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.450186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-dshm\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.450237 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.450206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tls-certs\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.550824 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.550791    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tmp-dir\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.550977 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.550851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-dshm\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.550977 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.550883    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tls-certs\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.550977 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.550925    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-home\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.550977 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.550955    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-model-cache\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.551204 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.550984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltqb\" (UniqueName: \"kubernetes.io/projected/9d743e4b-0b72-4a5e-9025-d264fa49bf42-kube-api-access-8ltqb\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.551285 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.551259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tmp-dir\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.551354 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.551333    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-home\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.551407 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.551357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-model-cache\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.553078 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.553058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-dshm\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.553417 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.553401    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tls-certs\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.559577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.559515    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltqb\" (UniqueName: \"kubernetes.io/projected/9d743e4b-0b72-4a5e-9025-d264fa49bf42-kube-api-access-8ltqb\") pod \"rate-test-model-4e1c51-kserve-575cfd787-jncdf\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") " pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.625519 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.625488    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:13.753585 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:13.753554    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"]
Aug 04 16:56:13.756435 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:56:13.756401    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d743e4b_0b72_4a5e_9025_d264fa49bf42.slice/crio-3797b17063d788686aafc377094c3339055c2905bdc9bda4880bf8fde916e196 WatchSource:0}: Error finding container 3797b17063d788686aafc377094c3339055c2905bdc9bda4880bf8fde916e196: Status 404 returned error can't find the container with id 3797b17063d788686aafc377094c3339055c2905bdc9bda4880bf8fde916e196
Aug 04 16:56:14.599896 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:14.599863    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf" event={"ID":"9d743e4b-0b72-4a5e-9025-d264fa49bf42","Type":"ContainerStarted","Data":"617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6"}
Aug 04 16:56:14.599896 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:14.599900    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf" event={"ID":"9d743e4b-0b72-4a5e-9025-d264fa49bf42","Type":"ContainerStarted","Data":"3797b17063d788686aafc377094c3339055c2905bdc9bda4880bf8fde916e196"}
Aug 04 16:56:14.618858 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:14.618814    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf" podStartSLOduration=1.6187998270000001 podStartE2EDuration="1.618799827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:56:14.617154835 +0000 UTC m=+3260.473627679" watchObservedRunningTime="2026-08-04 16:56:14.618799827 +0000 UTC m=+3260.475272722"
Aug 04 16:56:23.626303 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:23.626266    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:23.626891 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:23.626342    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:23.639219 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:23.639196    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:23.651493 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:23.651470    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:56:42.507245 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.507210    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"]
Aug 04 16:56:42.510683 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.510660    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.514672 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.514644    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"rate-test-model-222eca-kserve-self-signed-certs\""
Aug 04 16:56:42.514828 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.514730    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"default-dockercfg-jgfrm\""
Aug 04 16:56:42.514903 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.514852    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"openshift-service-ca.crt\""
Aug 04 16:56:42.514903 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.514873    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-222eca\"/\"kube-root-ca.crt\""
Aug 04 16:56:42.519404 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.519379    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"]
Aug 04 16:56:42.602361 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.602327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-tmp-dir\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.602541 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.602367    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f1c86e-416c-4978-8806-8cee2a5a209a-tls-certs\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.602541 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.602395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-dshm\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.602541 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.602509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-home\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.602727 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.602618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2lml\" (UniqueName: \"kubernetes.io/projected/f4f1c86e-416c-4978-8806-8cee2a5a209a-kube-api-access-b2lml\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.602727 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.602658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-model-cache\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.703495 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.703463    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2lml\" (UniqueName: \"kubernetes.io/projected/f4f1c86e-416c-4978-8806-8cee2a5a209a-kube-api-access-b2lml\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.703495 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.703497    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-model-cache\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.703777 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.703516    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-tmp-dir\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.703777 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.703537    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f1c86e-416c-4978-8806-8cee2a5a209a-tls-certs\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.703777 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.703707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-dshm\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.704015 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.703828    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-home\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.704015 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.703980    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-model-cache\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.704088 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.704012    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-tmp-dir\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.704138 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.704121    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-home\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.705758 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.705721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-dshm\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.706052 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.706034    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f1c86e-416c-4978-8806-8cee2a5a209a-tls-certs\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.712046 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.712027    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2lml\" (UniqueName: \"kubernetes.io/projected/f4f1c86e-416c-4978-8806-8cee2a5a209a-kube-api-access-b2lml\") pod \"rate-test-model-222eca-kserve-6c8fd56dc5-kds74\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") " pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.822170 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.822080    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:42.953601 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:42.953576    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"]
Aug 04 16:56:42.955581 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:56:42.955554    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4f1c86e_416c_4978_8806_8cee2a5a209a.slice/crio-79f6b4463a51d4756460d52ec7f5cd5d3fe9a55253eb224e3289d6e1818861aa WatchSource:0}: Error finding container 79f6b4463a51d4756460d52ec7f5cd5d3fe9a55253eb224e3289d6e1818861aa: Status 404 returned error can't find the container with id 79f6b4463a51d4756460d52ec7f5cd5d3fe9a55253eb224e3289d6e1818861aa
Aug 04 16:56:43.729830 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:43.729794    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74" event={"ID":"f4f1c86e-416c-4978-8806-8cee2a5a209a","Type":"ContainerStarted","Data":"6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158"}
Aug 04 16:56:43.730212 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:43.729838    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74" event={"ID":"f4f1c86e-416c-4978-8806-8cee2a5a209a","Type":"ContainerStarted","Data":"79f6b4463a51d4756460d52ec7f5cd5d3fe9a55253eb224e3289d6e1818861aa"}
Aug 04 16:56:43.748216 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:43.748163    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74" podStartSLOduration=1.748146485 podStartE2EDuration="1.748146485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:56:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:56:43.746262472 +0000 UTC m=+3289.602735316" watchObservedRunningTime="2026-08-04 16:56:43.748146485 +0000 UTC m=+3289.604619328"
Aug 04 16:56:52.822667 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:52.822628    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:52.823097 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:52.822683    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:52.834934 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:52.834908    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:53.785229 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:53.785199    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:56:54.824718 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:54.824691    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:56:54.831689 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:56:54.831668    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 16:58:05.025588 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:05.025545    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"]
Aug 04 16:58:05.789637 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:05.789607    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"]
Aug 04 16:58:20.045100 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.045029    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf" podUID="9d743e4b-0b72-4a5e-9025-d264fa49bf42" containerName="main" containerID="cri-o://617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6" gracePeriod=45
Aug 04 16:58:20.290946 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.290919    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:58:20.392868 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.392839    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tmp-dir\") pod \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") "
Aug 04 16:58:20.393124 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.392907    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ltqb\" (UniqueName: \"kubernetes.io/projected/9d743e4b-0b72-4a5e-9025-d264fa49bf42-kube-api-access-8ltqb\") pod \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") "
Aug 04 16:58:20.393124 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.392937    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-dshm\") pod \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") "
Aug 04 16:58:20.393124 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.392974    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-home\") pod \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") "
Aug 04 16:58:20.393124 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.392994    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tls-certs\") pod \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") "
Aug 04 16:58:20.393124 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.393033    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-model-cache\") pod \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\" (UID: \"9d743e4b-0b72-4a5e-9025-d264fa49bf42\") "
Aug 04 16:58:20.393473 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.393117    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9d743e4b-0b72-4a5e-9025-d264fa49bf42" (UID: "9d743e4b-0b72-4a5e-9025-d264fa49bf42"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:58:20.393473 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.393241    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-home" (OuterVolumeSpecName: "home") pod "9d743e4b-0b72-4a5e-9025-d264fa49bf42" (UID: "9d743e4b-0b72-4a5e-9025-d264fa49bf42"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:58:20.393473 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.393343    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-model-cache" (OuterVolumeSpecName: "model-cache") pod "9d743e4b-0b72-4a5e-9025-d264fa49bf42" (UID: "9d743e4b-0b72-4a5e-9025-d264fa49bf42"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:58:20.393473 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.393399    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tmp-dir\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:20.393473 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.393416    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-home\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:20.395141 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.395114    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-dshm" (OuterVolumeSpecName: "dshm") pod "9d743e4b-0b72-4a5e-9025-d264fa49bf42" (UID: "9d743e4b-0b72-4a5e-9025-d264fa49bf42"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:58:20.395241 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.395134    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d743e4b-0b72-4a5e-9025-d264fa49bf42-kube-api-access-8ltqb" (OuterVolumeSpecName: "kube-api-access-8ltqb") pod "9d743e4b-0b72-4a5e-9025-d264fa49bf42" (UID: "9d743e4b-0b72-4a5e-9025-d264fa49bf42"). InnerVolumeSpecName "kube-api-access-8ltqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:58:20.395241 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.395148    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9d743e4b-0b72-4a5e-9025-d264fa49bf42" (UID: "9d743e4b-0b72-4a5e-9025-d264fa49bf42"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:58:20.494817 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.494787    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9d743e4b-0b72-4a5e-9025-d264fa49bf42-tls-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:20.494817 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.494812    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-model-cache\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:20.494817 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.494821    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ltqb\" (UniqueName: \"kubernetes.io/projected/9d743e4b-0b72-4a5e-9025-d264fa49bf42-kube-api-access-8ltqb\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:20.495040 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.494831    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9d743e4b-0b72-4a5e-9025-d264fa49bf42-dshm\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:20.808315 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:20.808256    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74" podUID="f4f1c86e-416c-4978-8806-8cee2a5a209a" containerName="main" containerID="cri-o://6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158" gracePeriod=45
Aug 04 16:58:21.044827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.044799    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:58:21.099978 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.099942    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-tmp-dir\") pod \"f4f1c86e-416c-4978-8806-8cee2a5a209a\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") "
Aug 04 16:58:21.100397 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100057    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-model-cache\") pod \"f4f1c86e-416c-4978-8806-8cee2a5a209a\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") "
Aug 04 16:58:21.100397 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100089    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f1c86e-416c-4978-8806-8cee2a5a209a-tls-certs\") pod \"f4f1c86e-416c-4978-8806-8cee2a5a209a\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") "
Aug 04 16:58:21.100397 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100151    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-dshm\") pod \"f4f1c86e-416c-4978-8806-8cee2a5a209a\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") "
Aug 04 16:58:21.100397 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100178    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-home\") pod \"f4f1c86e-416c-4978-8806-8cee2a5a209a\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") "
Aug 04 16:58:21.100397 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100208    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2lml\" (UniqueName: \"kubernetes.io/projected/f4f1c86e-416c-4978-8806-8cee2a5a209a-kube-api-access-b2lml\") pod \"f4f1c86e-416c-4978-8806-8cee2a5a209a\" (UID: \"f4f1c86e-416c-4978-8806-8cee2a5a209a\") "
Aug 04 16:58:21.100397 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100256    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f4f1c86e-416c-4978-8806-8cee2a5a209a" (UID: "f4f1c86e-416c-4978-8806-8cee2a5a209a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:58:21.100397 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100341    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-model-cache" (OuterVolumeSpecName: "model-cache") pod "f4f1c86e-416c-4978-8806-8cee2a5a209a" (UID: "f4f1c86e-416c-4978-8806-8cee2a5a209a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:58:21.100827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100488    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-home" (OuterVolumeSpecName: "home") pod "f4f1c86e-416c-4978-8806-8cee2a5a209a" (UID: "f4f1c86e-416c-4978-8806-8cee2a5a209a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:58:21.100827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100623    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-model-cache\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:21.100827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100639    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-home\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:21.100827 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.100648    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-tmp-dir\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:21.102305 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.102278    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-dshm" (OuterVolumeSpecName: "dshm") pod "f4f1c86e-416c-4978-8806-8cee2a5a209a" (UID: "f4f1c86e-416c-4978-8806-8cee2a5a209a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:58:21.102430 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.102378    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f1c86e-416c-4978-8806-8cee2a5a209a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f4f1c86e-416c-4978-8806-8cee2a5a209a" (UID: "f4f1c86e-416c-4978-8806-8cee2a5a209a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:58:21.102430 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.102382    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f1c86e-416c-4978-8806-8cee2a5a209a-kube-api-access-b2lml" (OuterVolumeSpecName: "kube-api-access-b2lml") pod "f4f1c86e-416c-4978-8806-8cee2a5a209a" (UID: "f4f1c86e-416c-4978-8806-8cee2a5a209a"). InnerVolumeSpecName "kube-api-access-b2lml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:58:21.150965 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.150928    2558 generic.go:356] "Generic (PLEG): container finished" podID="f4f1c86e-416c-4978-8806-8cee2a5a209a" containerID="6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158" exitCode=0
Aug 04 16:58:21.151153 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.150975    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"
Aug 04 16:58:21.151153 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.151013    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74" event={"ID":"f4f1c86e-416c-4978-8806-8cee2a5a209a","Type":"ContainerDied","Data":"6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158"}
Aug 04 16:58:21.151153 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.151052    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74" event={"ID":"f4f1c86e-416c-4978-8806-8cee2a5a209a","Type":"ContainerDied","Data":"79f6b4463a51d4756460d52ec7f5cd5d3fe9a55253eb224e3289d6e1818861aa"}
Aug 04 16:58:21.151153 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.151071    2558 scope.go:117] "RemoveContainer" containerID="6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158"
Aug 04 16:58:21.152568 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.152404    2558 generic.go:356] "Generic (PLEG): container finished" podID="9d743e4b-0b72-4a5e-9025-d264fa49bf42" containerID="617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6" exitCode=0
Aug 04 16:58:21.152568 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.152463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf" event={"ID":"9d743e4b-0b72-4a5e-9025-d264fa49bf42","Type":"ContainerDied","Data":"617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6"}
Aug 04 16:58:21.152568 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.152467    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"
Aug 04 16:58:21.152568 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.152489    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf" event={"ID":"9d743e4b-0b72-4a5e-9025-d264fa49bf42","Type":"ContainerDied","Data":"3797b17063d788686aafc377094c3339055c2905bdc9bda4880bf8fde916e196"}
Aug 04 16:58:21.167478 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.167458    2558 scope.go:117] "RemoveContainer" containerID="6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158"
Aug 04 16:58:21.167792 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:58:21.167768    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158\": container with ID starting with 6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158 not found: ID does not exist" containerID="6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158"
Aug 04 16:58:21.167843 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.167801    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158"} err="failed to get container status \"6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158\": rpc error: code = NotFound desc = could not find container \"6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158\": container with ID starting with 6ad68fb0997d4e9fa1c80faa3f7a36ea12c95c82a52232af83f621d8fc200158 not found: ID does not exist"
Aug 04 16:58:21.167843 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.167818    2558 scope.go:117] "RemoveContainer" containerID="617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6"
Aug 04 16:58:21.171820 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.171790    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"]
Aug 04 16:58:21.176130 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.176106    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4e1c51/rate-test-model-4e1c51-kserve-575cfd787-jncdf"]
Aug 04 16:58:21.176232 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.176147    2558 scope.go:117] "RemoveContainer" containerID="617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6"
Aug 04 16:58:21.176516 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:58:21.176490    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6\": container with ID starting with 617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6 not found: ID does not exist" containerID="617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6"
Aug 04 16:58:21.176569 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.176534    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6"} err="failed to get container status \"617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6\": rpc error: code = NotFound desc = could not find container \"617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6\": container with ID starting with 617a7ae88c7cdc1fe51900c3bf1fd38af986327cd9bbcd17d4ee2425a9aa85d6 not found: ID does not exist"
Aug 04 16:58:21.185411 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.185388    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"]
Aug 04 16:58:21.189616 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.189595    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-222eca/rate-test-model-222eca-kserve-6c8fd56dc5-kds74"]
Aug 04 16:58:21.201616 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.201591    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4f1c86e-416c-4978-8806-8cee2a5a209a-tls-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:21.201616 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.201614    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4f1c86e-416c-4978-8806-8cee2a5a209a-dshm\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:21.201719 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:21.201624    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2lml\" (UniqueName: \"kubernetes.io/projected/f4f1c86e-416c-4978-8806-8cee2a5a209a-kube-api-access-b2lml\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:22.077097 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.077060    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7667-140255613726416"]
Aug 04 16:58:22.077436 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.077422    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d743e4b-0b72-4a5e-9025-d264fa49bf42" containerName="main"
Aug 04 16:58:22.077480 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.077437    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d743e4b-0b72-4a5e-9025-d264fa49bf42" containerName="main"
Aug 04 16:58:22.077480 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.077447    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f1c86e-416c-4978-8806-8cee2a5a209a" containerName="main"
Aug 04 16:58:22.077480 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.077453    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f1c86e-416c-4978-8806-8cee2a5a209a" containerName="main"
Aug 04 16:58:22.077575 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.077511    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4f1c86e-416c-4978-8806-8cee2a5a209a" containerName="main"
Aug 04 16:58:22.077575 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.077519    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d743e4b-0b72-4a5e-9025-d264fa49bf42" containerName="main"
Aug 04 16:58:22.081667 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.081649    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:22.084603 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.084477    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zj6q8\""
Aug 04 16:58:22.084927 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.084905    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-140255613726416"]
Aug 04 16:58:22.210124 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.210086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkfc\" (UniqueName: \"kubernetes.io/projected/1dd51ff8-9fa0-4d96-82a0-d951213d079e-kube-api-access-dfkfc\") pod \"test-curl-7667-140255613726416\" (UID: \"1dd51ff8-9fa0-4d96-82a0-d951213d079e\") " pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:22.311584 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.311542    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkfc\" (UniqueName: \"kubernetes.io/projected/1dd51ff8-9fa0-4d96-82a0-d951213d079e-kube-api-access-dfkfc\") pod \"test-curl-7667-140255613726416\" (UID: \"1dd51ff8-9fa0-4d96-82a0-d951213d079e\") " pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:22.320763 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.320704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkfc\" (UniqueName: \"kubernetes.io/projected/1dd51ff8-9fa0-4d96-82a0-d951213d079e-kube-api-access-dfkfc\") pod \"test-curl-7667-140255613726416\" (UID: \"1dd51ff8-9fa0-4d96-82a0-d951213d079e\") " pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:22.392316 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.392282    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:22.519883 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.519855    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-140255613726416"]
Aug 04 16:58:22.521763 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:58:22.521722    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dd51ff8_9fa0_4d96_82a0_d951213d079e.slice/crio-d7f7fddf7bee9ad6aa8f5eaf219ca13b77f548b43cb87167845f053874d6fd86 WatchSource:0}: Error finding container d7f7fddf7bee9ad6aa8f5eaf219ca13b77f548b43cb87167845f053874d6fd86: Status 404 returned error can't find the container with id d7f7fddf7bee9ad6aa8f5eaf219ca13b77f548b43cb87167845f053874d6fd86
Aug 04 16:58:22.523045 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.523026    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:58:22.693402 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.693327    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d743e4b-0b72-4a5e-9025-d264fa49bf42" path="/var/lib/kubelet/pods/9d743e4b-0b72-4a5e-9025-d264fa49bf42/volumes"
Aug 04 16:58:22.693727 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:22.693713    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f1c86e-416c-4978-8806-8cee2a5a209a" path="/var/lib/kubelet/pods/f4f1c86e-416c-4978-8806-8cee2a5a209a/volumes"
Aug 04 16:58:23.166107 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:23.166076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-140255613726416" event={"ID":"1dd51ff8-9fa0-4d96-82a0-d951213d079e","Type":"ContainerStarted","Data":"d7f7fddf7bee9ad6aa8f5eaf219ca13b77f548b43cb87167845f053874d6fd86"}
Aug 04 16:58:24.171585 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:24.171553    2558 generic.go:356] "Generic (PLEG): container finished" podID="1dd51ff8-9fa0-4d96-82a0-d951213d079e" containerID="6a6af6c16ac1c33f6b69adda16ea7d1bcc5c1adeba49fea095a73358a0196e08" exitCode=0
Aug 04 16:58:24.171981 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:24.171603    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-140255613726416" event={"ID":"1dd51ff8-9fa0-4d96-82a0-d951213d079e","Type":"ContainerDied","Data":"6a6af6c16ac1c33f6b69adda16ea7d1bcc5c1adeba49fea095a73358a0196e08"}
Aug 04 16:58:25.300758 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:25.300727    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:25.334185 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:25.334159    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7667-140255613726416_1dd51ff8-9fa0-4d96-82a0-d951213d079e/test-curl-7667-140255613726416/0.log"
Aug 04 16:58:25.356708 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:25.356684    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7667-140255613726416"]
Aug 04 16:58:25.362453 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:25.362434    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7667-140255613726416"]
Aug 04 16:58:25.441267 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:25.441202    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfkfc\" (UniqueName: \"kubernetes.io/projected/1dd51ff8-9fa0-4d96-82a0-d951213d079e-kube-api-access-dfkfc\") pod \"1dd51ff8-9fa0-4d96-82a0-d951213d079e\" (UID: \"1dd51ff8-9fa0-4d96-82a0-d951213d079e\") "
Aug 04 16:58:25.443195 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:25.443170    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dd51ff8-9fa0-4d96-82a0-d951213d079e-kube-api-access-dfkfc" (OuterVolumeSpecName: "kube-api-access-dfkfc") pod "1dd51ff8-9fa0-4d96-82a0-d951213d079e" (UID: "1dd51ff8-9fa0-4d96-82a0-d951213d079e"). InnerVolumeSpecName "kube-api-access-dfkfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:58:25.542168 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:25.542136    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfkfc\" (UniqueName: \"kubernetes.io/projected/1dd51ff8-9fa0-4d96-82a0-d951213d079e-kube-api-access-dfkfc\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 16:58:26.165595 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.165566    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"]
Aug 04 16:58:26.165930 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.165918    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dd51ff8-9fa0-4d96-82a0-d951213d079e" containerName="test-curl-7667-140255613726416"
Aug 04 16:58:26.165981 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.165932    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dd51ff8-9fa0-4d96-82a0-d951213d079e" containerName="test-curl-7667-140255613726416"
Aug 04 16:58:26.166020 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.165990    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dd51ff8-9fa0-4d96-82a0-d951213d079e" containerName="test-curl-7667-140255613726416"
Aug 04 16:58:26.168958 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.168942    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.171958 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.171933    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-a125dd-openshift-default-dockercfg-2tr4g\""
Aug 04 16:58:26.179849 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.179816    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"]
Aug 04 16:58:26.183690 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.183673    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7f7fddf7bee9ad6aa8f5eaf219ca13b77f548b43cb87167845f053874d6fd86"
Aug 04 16:58:26.183690 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.183688    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:26.201603 ip-10-0-141-219 kubenswrapper[2558]: E0804 16:58:26.201574    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7667-140255613726416\" is forbidden: User \"system:node:ip-10-0-141-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-219.ec2.internal' and this object" podUID="1dd51ff8-9fa0-4d96-82a0-d951213d079e" pod="opendatahub/test-curl-7667-140255613726416"
Aug 04 16:58:26.248084 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.248050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-credential-socket\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.248084 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.248092    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjt5k\" (UniqueName: \"kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-kube-api-access-rjt5k\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.248247 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.248123    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-socket\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.248247 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.248144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-data\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.248247 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.248181    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-podinfo\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.248247 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.248233    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-envoy\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.248388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.248263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-certs\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.248388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.248313    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-token\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.248388 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.248372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istiod-ca-cert\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.349467 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.349423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istiod-ca-cert\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.349892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.349487    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-credential-socket\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.349892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.349602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjt5k\" (UniqueName: \"kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-kube-api-access-rjt5k\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.349892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.349653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-socket\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.349892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.349680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-data\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.349892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.349705    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-podinfo\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.349892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.349798    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-envoy\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.349892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.349839    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-certs\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.349892 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.349845    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-credential-socket\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.350340 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.349911    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-token\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.350340 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.350117    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-socket\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.350340 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.350224    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istiod-ca-cert\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.350340 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.350235    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-certs\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.350340 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.350336    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-data\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.352085 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.352062    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-envoy\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.352300 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.352283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-podinfo\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.358456 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.358432    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-token\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.358674 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.358653    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjt5k\" (UniqueName: \"kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-kube-api-access-rjt5k\") pod \"e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") " pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.480463 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.480369    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:26.612170 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.612145    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"]
Aug 04 16:58:26.614133 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:58:26.614105    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e9294c5_2abd_41ad_9cf4_ad14f4b91a95.slice/crio-c288f6ddbf0457adac3ceb5d0c056e5f75c4cbbcb3a0eaab6e6f92cdde94db4a WatchSource:0}: Error finding container c288f6ddbf0457adac3ceb5d0c056e5f75c4cbbcb3a0eaab6e6f92cdde94db4a: Status 404 returned error can't find the container with id c288f6ddbf0457adac3ceb5d0c056e5f75c4cbbcb3a0eaab6e6f92cdde94db4a
Aug 04 16:58:26.616344 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.616314    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:58:26.616478 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.616377    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:58:26.616478 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.616410    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:58:26.692903 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:26.692875    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dd51ff8-9fa0-4d96-82a0-d951213d079e" path="/var/lib/kubelet/pods/1dd51ff8-9fa0-4d96-82a0-d951213d079e/volumes"
Aug 04 16:58:27.190141 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:27.190105    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" event={"ID":"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95","Type":"ContainerStarted","Data":"fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3"}
Aug 04 16:58:27.190317 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:27.190168    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" event={"ID":"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95","Type":"ContainerStarted","Data":"c288f6ddbf0457adac3ceb5d0c056e5f75c4cbbcb3a0eaab6e6f92cdde94db4a"}
Aug 04 16:58:27.211562 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:27.211517    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" podStartSLOduration=1.2115013000000001 podStartE2EDuration="1.2115013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:58:27.21014438 +0000 UTC m=+3393.066617224" watchObservedRunningTime="2026-08-04 16:58:27.2115013 +0000 UTC m=+3393.067974144"
Aug 04 16:58:27.481112 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:27.481027    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:27.485832 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:27.485807    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:28.194457 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:28.194425    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:28.195511 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:28.195489    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:43.441038 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:43.441004    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": read tcp 10.133.0.2:35958->10.133.0.51:15021: read: connection reset by peer" start-of-body=
Aug 04 16:58:43.441488 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:43.441076    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": read tcp 10.133.0.2:35958->10.133.0.51:15021: read: connection reset by peer"
Aug 04 16:58:44.279667 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:44.279636    2558 generic.go:356] "Generic (PLEG): container finished" podID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerID="fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3" exitCode=0
Aug 04 16:58:44.279874 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:44.279707    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" event={"ID":"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95","Type":"ContainerDied","Data":"fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3"}
Aug 04 16:58:44.280143 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:44.280125    2558 scope.go:117] "RemoveContainer" containerID="fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3"
Aug 04 16:58:44.281190 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:44.281165    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:58:44.281255 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:44.281243    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:58:44.281299 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:44.281278    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 16:58:45.286023 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:45.285989    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" event={"ID":"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95","Type":"ContainerStarted","Data":"2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e"}
Aug 04 16:58:45.480783 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:45.480723    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:45.481013 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:45.480990    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Aug 04 16:58:45.481102 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:45.481046    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Aug 04 16:58:46.481431 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:46.481346    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Aug 04 16:58:46.481431 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:46.481416    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Aug 04 16:58:47.481729 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:47.481685    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Aug 04 16:58:47.482156 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:47.481779    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Aug 04 16:58:48.480943 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:48.480906    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Aug 04 16:58:48.481159 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:48.480975    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Aug 04 16:58:49.481707 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:49.481658    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Aug 04 16:58:49.482098 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:49.481730    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Aug 04 16:58:50.485243 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:50.485213    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:50.485670 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:50.485651    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:58:50.486253 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:58:50.486236    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 16:59:26.902123 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:26.902094    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"]
Aug 04 16:59:26.905083 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:26.905066    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:26.907763 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:26.907728    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-a125dd\"/\"kube-root-ca.crt\""
Aug 04 16:59:26.907905 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:26.907810    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-a125dd\"/\"default-dockercfg-rxzk9\""
Aug 04 16:59:26.907905 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:26.907866    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-a125dd\"/\"ipp-route-a125dd-kserve-self-signed-certs\""
Aug 04 16:59:26.908032 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:26.907953    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-a125dd\"/\"openshift-service-ca.crt\""
Aug 04 16:59:26.914638 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:26.914615    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"]
Aug 04 16:59:27.001161 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.001130    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tmp-dir\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.001161 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.001163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-dshm\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.001378 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.001190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-model-cache\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.001378 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.001208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tls-certs\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.001378 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.001305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-home\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.001378 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.001340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fdtn\" (UniqueName: \"kubernetes.io/projected/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-kube-api-access-6fdtn\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.102765 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.102712    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-dshm\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.102934 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.102792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-model-cache\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.102934 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.102813    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tls-certs\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.102934 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.102843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-home\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.102934 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.102866    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fdtn\" (UniqueName: \"kubernetes.io/projected/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-kube-api-access-6fdtn\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.103093 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.102947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tmp-dir\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.103446 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.103250    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tmp-dir\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.103577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.103514    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-home\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.103816 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.103794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-model-cache\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.105391 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.105364    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-dshm\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.105787 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.105770    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tls-certs\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.111940 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.111894    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fdtn\" (UniqueName: \"kubernetes.io/projected/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-kube-api-access-6fdtn\") pod \"ipp-route-a125dd-kserve-76bd75db67-ch8xf\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") " pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.215299 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.215219    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:27.344909 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.344882    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"]
Aug 04 16:59:27.346608 ip-10-0-141-219 kubenswrapper[2558]: W0804 16:59:27.346583    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ab3e8e8_de9c_43e9_ae44_c7a72a45f31a.slice/crio-847d95ca02dcbe489d38afefcec5b5dc6d7f0374b9866f820ed0f6431c04988a WatchSource:0}: Error finding container 847d95ca02dcbe489d38afefcec5b5dc6d7f0374b9866f820ed0f6431c04988a: Status 404 returned error can't find the container with id 847d95ca02dcbe489d38afefcec5b5dc6d7f0374b9866f820ed0f6431c04988a
Aug 04 16:59:27.477839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.477741    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf" event={"ID":"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a","Type":"ContainerStarted","Data":"265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64"}
Aug 04 16:59:27.477839 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.477807    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf" event={"ID":"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a","Type":"ContainerStarted","Data":"847d95ca02dcbe489d38afefcec5b5dc6d7f0374b9866f820ed0f6431c04988a"}
Aug 04 16:59:27.497552 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:27.497507    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf" podStartSLOduration=1.497489643 podStartE2EDuration="1.497489643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:59:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:59:27.496471197 +0000 UTC m=+3453.352944044" watchObservedRunningTime="2026-08-04 16:59:27.497489643 +0000 UTC m=+3453.353962486"
Aug 04 16:59:37.215806 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:37.215766    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:37.216290 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:37.215822    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:37.228577 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:37.228546    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 16:59:37.532509 ip-10-0-141-219 kubenswrapper[2558]: I0804 16:59:37.532419    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 17:00:00.137480 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.137437    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx"]
Aug 04 17:00:00.141142 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.141118    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf"]
Aug 04 17:00:00.141263 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.141242    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx"
Aug 04 17:00:00.143880 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.143860    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4pxfk\""
Aug 04 17:00:00.144415 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.144396    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf"
Aug 04 17:00:00.152037 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.152009    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx"]
Aug 04 17:00:00.154075 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.153892    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx"
Aug 04 17:00:00.154498 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.154472    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf"]
Aug 04 17:00:00.166060 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.166025    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf"
Aug 04 17:00:00.323867 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.323842    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf"]
Aug 04 17:00:00.326030 ip-10-0-141-219 kubenswrapper[2558]: W0804 17:00:00.326001    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad117afa_cf52_42e9_81be_011bd85c9fcd.slice/crio-5ce2074a9191f3dda9ffbd688d0fa1b098e76fe74945318965bac6349ce31bf1 WatchSource:0}: Error finding container 5ce2074a9191f3dda9ffbd688d0fa1b098e76fe74945318965bac6349ce31bf1: Status 404 returned error can't find the container with id 5ce2074a9191f3dda9ffbd688d0fa1b098e76fe74945318965bac6349ce31bf1
Aug 04 17:00:00.503407 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.503381    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx"]
Aug 04 17:00:00.505134 ip-10-0-141-219 kubenswrapper[2558]: W0804 17:00:00.505105    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod122c75de_95c9_4a46_b44b_4c006883e0aa.slice/crio-717763e256ad0dc348428aa7c2c414dc8db7bd0c4884249399ffa684d4105673 WatchSource:0}: Error finding container 717763e256ad0dc348428aa7c2c414dc8db7bd0c4884249399ffa684d4105673: Status 404 returned error can't find the container with id 717763e256ad0dc348428aa7c2c414dc8db7bd0c4884249399ffa684d4105673
Aug 04 17:00:00.626911 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.626873    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx" event={"ID":"122c75de-95c9-4a46-b44b-4c006883e0aa","Type":"ContainerStarted","Data":"717763e256ad0dc348428aa7c2c414dc8db7bd0c4884249399ffa684d4105673"}
Aug 04 17:00:00.627977 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:00.627954    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf" event={"ID":"ad117afa-cf52-42e9-81be-011bd85c9fcd","Type":"ContainerStarted","Data":"5ce2074a9191f3dda9ffbd688d0fa1b098e76fe74945318965bac6349ce31bf1"}
Aug 04 17:00:03.644458 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:03.644422    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf" event={"ID":"ad117afa-cf52-42e9-81be-011bd85c9fcd","Type":"ContainerStarted","Data":"c6a53837a35735cf2a07ded2f51a118ece3c20f89cb94d59a6502d6230e8f917"}
Aug 04 17:00:03.663914 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:03.663866    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf" podStartSLOduration=0.83492092 podStartE2EDuration="3.663852073s" totalImagesPullingTime="2.828931153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:00:03.663040303 +0000 UTC m=+3489.519513149" watchObservedRunningTime="2026-08-04 17:00:03.663852073 +0000 UTC m=+3489.520324894"
Aug 04 17:00:04.650678 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:04.650643    2558 generic.go:356] "Generic (PLEG): container finished" podID="ad117afa-cf52-42e9-81be-011bd85c9fcd" containerID="c6a53837a35735cf2a07ded2f51a118ece3c20f89cb94d59a6502d6230e8f917" exitCode=0
Aug 04 17:00:04.651181 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:04.650729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf" event={"ID":"ad117afa-cf52-42e9-81be-011bd85c9fcd","Type":"ContainerDied","Data":"c6a53837a35735cf2a07ded2f51a118ece3c20f89cb94d59a6502d6230e8f917"}
Aug 04 17:00:05.656544 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:05.656505    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx" event={"ID":"122c75de-95c9-4a46-b44b-4c006883e0aa","Type":"ContainerStarted","Data":"c909e4695de9bc79317e24726fe96963f20b76955f4326d0da9836541b353628"}
Aug 04 17:00:05.672836 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:05.672779    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx" podStartSLOduration=1.102577695 podStartE2EDuration="5.672761187s" totalImagesPullingTime="4.570183492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:00:05.671106869 +0000 UTC m=+3491.527579717" watchObservedRunningTime="2026-08-04 17:00:05.672761187 +0000 UTC m=+3491.529234021"
Aug 04 17:00:05.790317 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:05.790289    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf"
Aug 04 17:00:06.662423 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:06.662395    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf"
Aug 04 17:00:06.662423 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:06.662422    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf" event={"ID":"ad117afa-cf52-42e9-81be-011bd85c9fcd","Type":"ContainerDied","Data":"5ce2074a9191f3dda9ffbd688d0fa1b098e76fe74945318965bac6349ce31bf1"}
Aug 04 17:00:06.663113 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:06.662470    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ce2074a9191f3dda9ffbd688d0fa1b098e76fe74945318965bac6349ce31bf1"
Aug 04 17:00:06.664152 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:06.664125    2558 generic.go:356] "Generic (PLEG): container finished" podID="122c75de-95c9-4a46-b44b-4c006883e0aa" containerID="c909e4695de9bc79317e24726fe96963f20b76955f4326d0da9836541b353628" exitCode=0
Aug 04 17:00:06.664285 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:06.664187    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx" event={"ID":"122c75de-95c9-4a46-b44b-4c006883e0aa","Type":"ContainerDied","Data":"c909e4695de9bc79317e24726fe96963f20b76955f4326d0da9836541b353628"}
Aug 04 17:00:07.792318 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:07.792293    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx"
Aug 04 17:00:08.675693 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:08.675665    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx"
Aug 04 17:00:08.675909 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:08.675709    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx" event={"ID":"122c75de-95c9-4a46-b44b-4c006883e0aa","Type":"ContainerDied","Data":"717763e256ad0dc348428aa7c2c414dc8db7bd0c4884249399ffa684d4105673"}
Aug 04 17:00:08.675909 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:08.675786    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="717763e256ad0dc348428aa7c2c414dc8db7bd0c4884249399ffa684d4105673"
Aug 04 17:00:10.864776 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.864730    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"]
Aug 04 17:00:10.865131 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.865094    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad117afa-cf52-42e9-81be-011bd85c9fcd" containerName="cleanup"
Aug 04 17:00:10.865131 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.865106    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad117afa-cf52-42e9-81be-011bd85c9fcd" containerName="cleanup"
Aug 04 17:00:10.865131 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.865115    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="122c75de-95c9-4a46-b44b-4c006883e0aa" containerName="cleanup"
Aug 04 17:00:10.865131 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.865120    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="122c75de-95c9-4a46-b44b-4c006883e0aa" containerName="cleanup"
Aug 04 17:00:10.865263 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.865173    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="122c75de-95c9-4a46-b44b-4c006883e0aa" containerName="cleanup"
Aug 04 17:00:10.865263 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.865183    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad117afa-cf52-42e9-81be-011bd85c9fcd" containerName="cleanup"
Aug 04 17:00:10.868103 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.868085    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:10.870806 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.870785    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-72d790-openshift-default-dockercfg-spg94\""
Aug 04 17:00:10.878999 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.878975    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"]
Aug 04 17:00:10.917092 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.917064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8894311-7b83-4ad4-84af-25ba4991cffe-istiod-ca-cert\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:10.917230 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.917109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-socket\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:10.917230 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.917139    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-token\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:10.917230 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.917204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-certs\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:10.917346 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.917262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-envoy\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:10.917346 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.917280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-data\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:10.917412 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.917348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnh5m\" (UniqueName: \"kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-kube-api-access-vnh5m\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:10.917412 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.917391    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-credential-socket\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:10.917412 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:10.917407    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-podinfo\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.018605 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.018571    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-credential-socket\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.018605 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.018602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-podinfo\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.018893 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.018630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8894311-7b83-4ad4-84af-25ba4991cffe-istiod-ca-cert\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.018893 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.018666    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-socket\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.018893 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.018696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-token\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.018893 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.018715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-certs\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.018893 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.018740    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-envoy\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.018893 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.018792    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-data\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.018893 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.018864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnh5m\" (UniqueName: \"kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-kube-api-access-vnh5m\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.019256 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.019049    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-credential-socket\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.019323 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.019268    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-certs\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.019323 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.019273    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-data\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.019444 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.019348    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-socket\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.019558 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.019535    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8894311-7b83-4ad4-84af-25ba4991cffe-istiod-ca-cert\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.021118 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.021099    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-envoy\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.021340 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.021319    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-podinfo\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.026537 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.026507    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-token\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.027053 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.027032    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnh5m\" (UniqueName: \"kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-kube-api-access-vnh5m\") pod \"e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") " pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.179616 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.179520    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:11.313268 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.313244    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"]
Aug 04 17:00:11.318443 ip-10-0-141-219 kubenswrapper[2558]: W0804 17:00:11.317461    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8894311_7b83_4ad4_84af_25ba4991cffe.slice/crio-8602bf651d848d95586b73113fdcf4f21aa4a85f35ca2c5b76b457d4ae4df68f WatchSource:0}: Error finding container 8602bf651d848d95586b73113fdcf4f21aa4a85f35ca2c5b76b457d4ae4df68f: Status 404 returned error can't find the container with id 8602bf651d848d95586b73113fdcf4f21aa4a85f35ca2c5b76b457d4ae4df68f
Aug 04 17:00:11.319890 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.319856    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 17:00:11.319977 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.319918    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 17:00:11.319977 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.319953    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 17:00:11.691021 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.690970    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" event={"ID":"b8894311-7b83-4ad4-84af-25ba4991cffe","Type":"ContainerStarted","Data":"a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7"}
Aug 04 17:00:11.691190 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.691069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" event={"ID":"b8894311-7b83-4ad4-84af-25ba4991cffe","Type":"ContainerStarted","Data":"8602bf651d848d95586b73113fdcf4f21aa4a85f35ca2c5b76b457d4ae4df68f"}
Aug 04 17:00:11.715386 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:11.715340    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" podStartSLOduration=1.715323361 podStartE2EDuration="1.715323361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 17:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:00:11.715086263 +0000 UTC m=+3497.571559108" watchObservedRunningTime="2026-08-04 17:00:11.715323361 +0000 UTC m=+3497.571796204"
Aug 04 17:00:12.180595 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:12.180556    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:12.185809 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:12.185784    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:12.694865 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:12.694837    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:12.695709 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:12.695686    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:28.736885 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:28.736854    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 04 17:00:28.737244 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:28.736907    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 04 17:00:30.786826 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:30.786791    2558 generic.go:356] "Generic (PLEG): container finished" podID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerID="a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7" exitCode=0
Aug 04 17:00:30.787247 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:30.786865    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" event={"ID":"b8894311-7b83-4ad4-84af-25ba4991cffe","Type":"ContainerDied","Data":"a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7"}
Aug 04 17:00:30.787298 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:30.787263    2558 scope.go:117] "RemoveContainer" containerID="a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7"
Aug 04 17:00:30.788361 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:30.788327    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 17:00:30.788467 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:30.788396    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 17:00:30.788467 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:30.788429    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 04 17:00:31.793262 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:31.793227    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" event={"ID":"b8894311-7b83-4ad4-84af-25ba4991cffe","Type":"ContainerStarted","Data":"cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470"}
Aug 04 17:00:32.180232 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:32.180197    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:32.180425 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:32.180377    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Aug 04 17:00:32.180480 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:32.180425    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Aug 04 17:00:33.180222 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:33.180192    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Aug 04 17:00:33.180621 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:33.180244    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Aug 04 17:00:34.180064 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:34.180029    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Aug 04 17:00:34.180242 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:34.180091    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Aug 04 17:00:35.180522 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:35.180490    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Aug 04 17:00:35.180930 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:35.180543    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Aug 04 17:00:36.180089 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:36.180049    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Aug 04 17:00:36.180291 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:36.180110    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Aug 04 17:00:37.183820 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:37.183785    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:37.184283 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:37.184033    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:37.184875 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:37.184855    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:41.360565 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:41.360531    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"]
Aug 04 17:00:41.361059 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:41.360726    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy" containerID="cri-o://cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470" gracePeriod=30
Aug 04 17:00:46.613191 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.613166    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:46.681140 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681079    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-certs\") pod \"b8894311-7b83-4ad4-84af-25ba4991cffe\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") "
Aug 04 17:00:46.681140 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681125    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8894311-7b83-4ad4-84af-25ba4991cffe-istiod-ca-cert\") pod \"b8894311-7b83-4ad4-84af-25ba4991cffe\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") "
Aug 04 17:00:46.681297 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681198    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-credential-socket\") pod \"b8894311-7b83-4ad4-84af-25ba4991cffe\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") "
Aug 04 17:00:46.681297 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681231    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnh5m\" (UniqueName: \"kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-kube-api-access-vnh5m\") pod \"b8894311-7b83-4ad4-84af-25ba4991cffe\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") "
Aug 04 17:00:46.681297 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681280    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-socket\") pod \"b8894311-7b83-4ad4-84af-25ba4991cffe\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") "
Aug 04 17:00:46.681454 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681302    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-envoy\") pod \"b8894311-7b83-4ad4-84af-25ba4991cffe\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") "
Aug 04 17:00:46.681454 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681346    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8894311-7b83-4ad4-84af-25ba4991cffe" (UID: "b8894311-7b83-4ad4-84af-25ba4991cffe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:00:46.681454 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681356    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-podinfo\") pod \"b8894311-7b83-4ad4-84af-25ba4991cffe\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") "
Aug 04 17:00:46.681454 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681383    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-data\") pod \"b8894311-7b83-4ad4-84af-25ba4991cffe\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") "
Aug 04 17:00:46.681657 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681459    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-token\") pod \"b8894311-7b83-4ad4-84af-25ba4991cffe\" (UID: \"b8894311-7b83-4ad4-84af-25ba4991cffe\") "
Aug 04 17:00:46.681657 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681474    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8894311-7b83-4ad4-84af-25ba4991cffe" (UID: "b8894311-7b83-4ad4-84af-25ba4991cffe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:00:46.681657 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681543    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8894311-7b83-4ad4-84af-25ba4991cffe" (UID: "b8894311-7b83-4ad4-84af-25ba4991cffe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:00:46.681657 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681567    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8894311-7b83-4ad4-84af-25ba4991cffe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8894311-7b83-4ad4-84af-25ba4991cffe" (UID: "b8894311-7b83-4ad4-84af-25ba4991cffe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:00:46.681905 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.681700    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8894311-7b83-4ad4-84af-25ba4991cffe" (UID: "b8894311-7b83-4ad4-84af-25ba4991cffe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:00:46.682105 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.682085    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-credential-socket\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:00:46.682179 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.682109    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-socket\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:00:46.682179 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.682125    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-data\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:00:46.682179 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.682140    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-workload-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:00:46.682179 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.682153    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8894311-7b83-4ad4-84af-25ba4991cffe-istiod-ca-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:00:46.683447 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.683419    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8894311-7b83-4ad4-84af-25ba4991cffe" (UID: "b8894311-7b83-4ad4-84af-25ba4991cffe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:00:46.683447 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.683433    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-kube-api-access-vnh5m" (OuterVolumeSpecName: "kube-api-access-vnh5m") pod "b8894311-7b83-4ad4-84af-25ba4991cffe" (UID: "b8894311-7b83-4ad4-84af-25ba4991cffe"). InnerVolumeSpecName "kube-api-access-vnh5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:00:46.683582 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.683445    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8894311-7b83-4ad4-84af-25ba4991cffe" (UID: "b8894311-7b83-4ad4-84af-25ba4991cffe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 17:00:46.683582 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.683535    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8894311-7b83-4ad4-84af-25ba4991cffe" (UID: "b8894311-7b83-4ad4-84af-25ba4991cffe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:00:46.782788 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.782738    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnh5m\" (UniqueName: \"kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-kube-api-access-vnh5m\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:00:46.782788 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.782786    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-envoy\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:00:46.782936 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.782795    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-podinfo\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:00:46.782936 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.782803    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8894311-7b83-4ad4-84af-25ba4991cffe-istio-token\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:00:46.867541 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.867507    2558 generic.go:356] "Generic (PLEG): container finished" podID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerID="cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470" exitCode=0
Aug 04 17:00:46.867664 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.867561    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"
Aug 04 17:00:46.867664 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.867584    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" event={"ID":"b8894311-7b83-4ad4-84af-25ba4991cffe","Type":"ContainerDied","Data":"cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470"}
Aug 04 17:00:46.867664 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.867635    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t" event={"ID":"b8894311-7b83-4ad4-84af-25ba4991cffe","Type":"ContainerDied","Data":"8602bf651d848d95586b73113fdcf4f21aa4a85f35ca2c5b76b457d4ae4df68f"}
Aug 04 17:00:46.867664 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.867658    2558 scope.go:117] "RemoveContainer" containerID="cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470"
Aug 04 17:00:46.876157 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.876142    2558 scope.go:117] "RemoveContainer" containerID="a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7"
Aug 04 17:00:46.884003 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.883986    2558 scope.go:117] "RemoveContainer" containerID="cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470"
Aug 04 17:00:46.884257 ip-10-0-141-219 kubenswrapper[2558]: E0804 17:00:46.884238    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470\": container with ID starting with cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470 not found: ID does not exist" containerID="cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470"
Aug 04 17:00:46.884343 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.884263    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470"} err="failed to get container status \"cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470\": rpc error: code = NotFound desc = could not find container \"cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470\": container with ID starting with cd5c84219f7a7e05a7ff39d05404196aae1cca003b07679907805fbc20836470 not found: ID does not exist"
Aug 04 17:00:46.884343 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.884279    2558 scope.go:117] "RemoveContainer" containerID="a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7"
Aug 04 17:00:46.884477 ip-10-0-141-219 kubenswrapper[2558]: E0804 17:00:46.884462    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7\": container with ID starting with a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7 not found: ID does not exist" containerID="a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7"
Aug 04 17:00:46.884532 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.884480    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7"} err="failed to get container status \"a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7\": rpc error: code = NotFound desc = could not find container \"a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7\": container with ID starting with a46c70a8ef5bd68f08747fab3225241665ad6be7e023653de505556dabdaa3d7 not found: ID does not exist"
Aug 04 17:00:46.885489 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.885468    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"]
Aug 04 17:00:46.888832 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:46.888814    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-72d790-openshift-default-5cd75858b-sws4t"]
Aug 04 17:00:48.698399 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:00:48.698359    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" path="/var/lib/kubelet/pods/b8894311-7b83-4ad4-84af-25ba4991cffe/volumes"
Aug 04 17:01:03.973280 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:03.973246    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"]
Aug 04 17:01:18.992321 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:18.992246    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf" podUID="1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" containerName="main" containerID="cri-o://265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64" gracePeriod=45
Aug 04 17:01:19.235603 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.235581    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 17:01:19.380036 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380008    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-home\") pod \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") "
Aug 04 17:01:19.380220 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380082    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-dshm\") pod \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") "
Aug 04 17:01:19.380220 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380131    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tls-certs\") pod \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") "
Aug 04 17:01:19.380220 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380153    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-model-cache\") pod \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") "
Aug 04 17:01:19.380220 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380176    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tmp-dir\") pod \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") "
Aug 04 17:01:19.380220 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380213    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fdtn\" (UniqueName: \"kubernetes.io/projected/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-kube-api-access-6fdtn\") pod \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\" (UID: \"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a\") "
Aug 04 17:01:19.380487 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380309    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-home" (OuterVolumeSpecName: "home") pod "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" (UID: "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:01:19.380487 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380438    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" (UID: "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:01:19.380487 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380452    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-model-cache" (OuterVolumeSpecName: "model-cache") pod "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" (UID: "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:01:19.380629 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380608    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-model-cache\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:19.380779 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380645    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tmp-dir\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:19.380779 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.380654    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-home\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:19.382339 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.382309    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-kube-api-access-6fdtn" (OuterVolumeSpecName: "kube-api-access-6fdtn") pod "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" (UID: "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a"). InnerVolumeSpecName "kube-api-access-6fdtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:01:19.382339 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.382323    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" (UID: "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 17:01:19.382453 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.382323    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-dshm" (OuterVolumeSpecName: "dshm") pod "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" (UID: "1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:01:19.481243 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.481218    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fdtn\" (UniqueName: \"kubernetes.io/projected/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-kube-api-access-6fdtn\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:19.481243 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.481242    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-dshm\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:19.481378 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:19.481253    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a-tls-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:20.020810 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:20.020771    2558 generic.go:356] "Generic (PLEG): container finished" podID="1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" containerID="265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64" exitCode=0
Aug 04 17:01:20.020810 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:20.020800    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"
Aug 04 17:01:20.021273 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:20.020783    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf" event={"ID":"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a","Type":"ContainerDied","Data":"265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64"}
Aug 04 17:01:20.021273 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:20.020901    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf" event={"ID":"1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a","Type":"ContainerDied","Data":"847d95ca02dcbe489d38afefcec5b5dc6d7f0374b9866f820ed0f6431c04988a"}
Aug 04 17:01:20.021273 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:20.020922    2558 scope.go:117] "RemoveContainer" containerID="265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64"
Aug 04 17:01:20.029880 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:20.029863    2558 scope.go:117] "RemoveContainer" containerID="265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64"
Aug 04 17:01:20.030136 ip-10-0-141-219 kubenswrapper[2558]: E0804 17:01:20.030115    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64\": container with ID starting with 265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64 not found: ID does not exist" containerID="265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64"
Aug 04 17:01:20.030184 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:20.030150    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64"} err="failed to get container status \"265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64\": rpc error: code = NotFound desc = could not find container \"265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64\": container with ID starting with 265414661cc249878d7d86ceecf81bb3bffaa6c8b0e4e3e143dad4c2b099dd64 not found: ID does not exist"
Aug 04 17:01:20.042616 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:20.042593    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"]
Aug 04 17:01:20.048446 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:20.048423    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-a125dd/ipp-route-a125dd-kserve-76bd75db67-ch8xf"]
Aug 04 17:01:20.692035 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:20.692003    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" path="/var/lib/kubelet/pods/1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a/volumes"
Aug 04 17:01:47.423179 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.423099    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"]
Aug 04 17:01:47.423697 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.423331    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy" containerID="cri-o://2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e" gracePeriod=30
Aug 04 17:01:47.737258 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.737183    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"]
Aug 04 17:01:47.737514 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.737503    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" containerName="main"
Aug 04 17:01:47.737558 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.737516    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" containerName="main"
Aug 04 17:01:47.737558 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.737524    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy"
Aug 04 17:01:47.737558 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.737529    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy"
Aug 04 17:01:47.737558 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.737541    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy"
Aug 04 17:01:47.737558 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.737547    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy"
Aug 04 17:01:47.737716 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.737600    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy"
Aug 04 17:01:47.737716 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.737607    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ab3e8e8-de9c-43e9-ae44-c7a72a45f31a" containerName="main"
Aug 04 17:01:47.737716 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.737616    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8894311-7b83-4ad4-84af-25ba4991cffe" containerName="istio-proxy"
Aug 04 17:01:47.739330 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.739315    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"
Aug 04 17:01:47.742112 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.742093    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4pxfk\""
Aug 04 17:01:47.748172 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.748152    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"]
Aug 04 17:01:47.816824 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.816795    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e018b04d-c672-4e2d-bdb4-85a421900b2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w\" (UID: \"e018b04d-c672-4e2d-bdb4-85a421900b2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"
Aug 04 17:01:47.918328 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.918295    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e018b04d-c672-4e2d-bdb4-85a421900b2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w\" (UID: \"e018b04d-c672-4e2d-bdb4-85a421900b2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"
Aug 04 17:01:47.918999 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:47.918979    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e018b04d-c672-4e2d-bdb4-85a421900b2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w\" (UID: \"e018b04d-c672-4e2d-bdb4-85a421900b2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"
Aug 04 17:01:48.050852 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:48.050765    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"
Aug 04 17:01:48.178553 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:48.178516    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"]
Aug 04 17:01:48.180037 ip-10-0-141-219 kubenswrapper[2558]: W0804 17:01:48.180011    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode018b04d_c672_4e2d_bdb4_85a421900b2e.slice/crio-85074b4af5d20e21722675c563dc3e42a141d5db07f8452b91e30a65eb65cc31 WatchSource:0}: Error finding container 85074b4af5d20e21722675c563dc3e42a141d5db07f8452b91e30a65eb65cc31: Status 404 returned error can't find the container with id 85074b4af5d20e21722675c563dc3e42a141d5db07f8452b91e30a65eb65cc31
Aug 04 17:01:49.160010 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:49.159965    2558 generic.go:356] "Generic (PLEG): container finished" podID="e018b04d-c672-4e2d-bdb4-85a421900b2e" containerID="d87b3e10e3c6be145916a01182607fac4fc4dc9ffe0c2b7d386fc6b689c81565" exitCode=0
Aug 04 17:01:49.160392 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:49.160051    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w" event={"ID":"e018b04d-c672-4e2d-bdb4-85a421900b2e","Type":"ContainerDied","Data":"d87b3e10e3c6be145916a01182607fac4fc4dc9ffe0c2b7d386fc6b689c81565"}
Aug 04 17:01:49.160392 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:49.160111    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w" event={"ID":"e018b04d-c672-4e2d-bdb4-85a421900b2e","Type":"ContainerStarted","Data":"85074b4af5d20e21722675c563dc3e42a141d5db07f8452b91e30a65eb65cc31"}
Aug 04 17:01:50.287122 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:50.287094    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"
Aug 04 17:01:50.339454 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:50.339428    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e018b04d-c672-4e2d-bdb4-85a421900b2e-maas-api-service-ca\") pod \"e018b04d-c672-4e2d-bdb4-85a421900b2e\" (UID: \"e018b04d-c672-4e2d-bdb4-85a421900b2e\") "
Aug 04 17:01:50.339805 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:50.339785    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e018b04d-c672-4e2d-bdb4-85a421900b2e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e018b04d-c672-4e2d-bdb4-85a421900b2e" (UID: "e018b04d-c672-4e2d-bdb4-85a421900b2e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:01:50.441152 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:50.441080    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e018b04d-c672-4e2d-bdb4-85a421900b2e-maas-api-service-ca\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:50.488256 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:50.488223    2558 patch_prober.go:28] interesting pod/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 04 17:01:50.488404 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:50.488283    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 04 17:01:51.170333 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:51.170306    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"
Aug 04 17:01:51.170530 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:51.170340    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w" event={"ID":"e018b04d-c672-4e2d-bdb4-85a421900b2e","Type":"ContainerDied","Data":"85074b4af5d20e21722675c563dc3e42a141d5db07f8452b91e30a65eb65cc31"}
Aug 04 17:01:51.170530 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:51.170385    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85074b4af5d20e21722675c563dc3e42a141d5db07f8452b91e30a65eb65cc31"
Aug 04 17:01:52.679861 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.679837    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 17:01:52.762654 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.762617    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-credential-socket\") pod \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") "
Aug 04 17:01:52.762851 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.762663    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjt5k\" (UniqueName: \"kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-kube-api-access-rjt5k\") pod \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") "
Aug 04 17:01:52.762851 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.762686    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-envoy\") pod \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") "
Aug 04 17:01:52.762851 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.762770    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-podinfo\") pod \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") "
Aug 04 17:01:52.762851 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.762800    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-certs\") pod \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") "
Aug 04 17:01:52.763073 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.762854    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-socket\") pod \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") "
Aug 04 17:01:52.763073 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.762895    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istiod-ca-cert\") pod \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") "
Aug 04 17:01:52.763073 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.762927    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-data\") pod \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") "
Aug 04 17:01:52.763073 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.762961    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" (UID: "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:01:52.763073 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.762980    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-token\") pod \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\" (UID: \"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95\") "
Aug 04 17:01:52.763342 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.763092    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" (UID: "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:01:52.763342 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.763289    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" (UID: "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:01:52.763691 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.763363    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-data" (OuterVolumeSpecName: "istio-data") pod "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" (UID: "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:01:52.763691 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.763451    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" (UID: "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:01:52.763691 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.763446    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-credential-socket\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:52.764011 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.763710    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:52.765313 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.765280    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-kube-api-access-rjt5k" (OuterVolumeSpecName: "kube-api-access-rjt5k") pod "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" (UID: "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95"). InnerVolumeSpecName "kube-api-access-rjt5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:01:52.765415 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.765310    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" (UID: "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 17:01:52.765415 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.765384    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" (UID: "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:01:52.765508 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.765417    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" (UID: "3e9294c5-2abd-41ad-9cf4-ad14f4b91a95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:01:52.865017 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.864987    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-podinfo\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:52.865017 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.865017    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-workload-socket\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:52.865215 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.865030    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istiod-ca-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:52.865215 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.865039    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-data\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:52.865215 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.865047    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-token\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:52.865215 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.865055    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjt5k\" (UniqueName: \"kubernetes.io/projected/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-kube-api-access-rjt5k\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:52.865215 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:52.865063    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95-istio-envoy\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:01:53.096394 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.096359    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"]
Aug 04 17:01:53.099319 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.099290    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-3589b4-4qj7w"]
Aug 04 17:01:53.181521 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.181431    2558 generic.go:356] "Generic (PLEG): container finished" podID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerID="2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e" exitCode=0
Aug 04 17:01:53.181521 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.181476    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"
Aug 04 17:01:53.181521 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.181484    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" event={"ID":"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95","Type":"ContainerDied","Data":"2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e"}
Aug 04 17:01:53.181794 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.181528    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b" event={"ID":"3e9294c5-2abd-41ad-9cf4-ad14f4b91a95","Type":"ContainerDied","Data":"c288f6ddbf0457adac3ceb5d0c056e5f75c4cbbcb3a0eaab6e6f92cdde94db4a"}
Aug 04 17:01:53.181794 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.181552    2558 scope.go:117] "RemoveContainer" containerID="2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e"
Aug 04 17:01:53.190800 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.190777    2558 scope.go:117] "RemoveContainer" containerID="fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3"
Aug 04 17:01:53.198372 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.198347    2558 scope.go:117] "RemoveContainer" containerID="2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e"
Aug 04 17:01:53.198648 ip-10-0-141-219 kubenswrapper[2558]: E0804 17:01:53.198627    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e\": container with ID starting with 2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e not found: ID does not exist" containerID="2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e"
Aug 04 17:01:53.198696 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.198657    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e"} err="failed to get container status \"2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e\": rpc error: code = NotFound desc = could not find container \"2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e\": container with ID starting with 2a18c1fc642e4c26e5110f05d6b4f64a2fe9f6e37d90fed2cbbf3b92ee03822e not found: ID does not exist"
Aug 04 17:01:53.198696 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.198677    2558 scope.go:117] "RemoveContainer" containerID="fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3"
Aug 04 17:01:53.198944 ip-10-0-141-219 kubenswrapper[2558]: E0804 17:01:53.198924    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3\": container with ID starting with fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3 not found: ID does not exist" containerID="fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3"
Aug 04 17:01:53.199022 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.198948    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3"} err="failed to get container status \"fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3\": rpc error: code = NotFound desc = could not find container \"fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3\": container with ID starting with fa8f750bab2cd0a5de3ae8c9c19c8a9c61ab22d2ef8a7eac0a7d19a120e4e7a3 not found: ID does not exist"
Aug 04 17:01:53.203555 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.203534    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"]
Aug 04 17:01:53.209969 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:53.209948    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-a125dd-openshift-default-56b8ffd46d-8mh2b"]
Aug 04 17:01:54.694182 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:54.694150    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" path="/var/lib/kubelet/pods/3e9294c5-2abd-41ad-9cf4-ad14f4b91a95/volumes"
Aug 04 17:01:54.694545 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:54.694494    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e018b04d-c672-4e2d-bdb4-85a421900b2e" path="/var/lib/kubelet/pods/e018b04d-c672-4e2d-bdb4-85a421900b2e/volumes"
Aug 04 17:01:54.850961 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:54.850935    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 17:01:54.858924 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:01:54.858904    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 17:02:10.594277 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:10.594223    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf"]
Aug 04 17:02:10.595796 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:10.595775    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-4e1c51-29764380-qvqdf"]
Aug 04 17:02:10.691963 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:10.691935    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad117afa-cf52-42e9-81be-011bd85c9fcd" path="/var/lib/kubelet/pods/ad117afa-cf52-42e9-81be-011bd85c9fcd/volumes"
Aug 04 17:02:28.202595 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:28.202557    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx"]
Aug 04 17:02:28.203952 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:28.203931    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-222eca-29764380-wmrxx"]
Aug 04 17:02:28.693105 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:28.693062    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="122c75de-95c9-4a46-b44b-4c006883e0aa" path="/var/lib/kubelet/pods/122c75de-95c9-4a46-b44b-4c006883e0aa/volumes"
Aug 04 17:02:34.914580 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:34.914543    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"]
Aug 04 17:02:34.915028 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:34.914811    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy" containerID="cri-o://9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0" gracePeriod=30
Aug 04 17:02:35.608422 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:35.608387    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bf6b476bb-cffmx_9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01/authorino/0.log"
Aug 04 17:02:40.169927 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.169901    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 17:02:40.274167 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274076    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istiod-ca-cert\") pod \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") "
Aug 04 17:02:40.274451 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274430    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-envoy\") pod \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") "
Aug 04 17:02:40.274542 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274486    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-certs\") pod \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") "
Aug 04 17:02:40.274542 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274514    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-credential-socket\") pod \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") "
Aug 04 17:02:40.274647 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274581    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-token\") pod \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") "
Aug 04 17:02:40.274703 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274665    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-socket\") pod \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") "
Aug 04 17:02:40.274800 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274708    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-podinfo\") pod \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") "
Aug 04 17:02:40.274800 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274727    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c6169ebb-7dd8-4665-acd9-4edddbbd2aed" (UID: "c6169ebb-7dd8-4665-acd9-4edddbbd2aed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 17:02:40.274913 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274842    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4ckc\" (UniqueName: \"kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-kube-api-access-z4ckc\") pod \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") "
Aug 04 17:02:40.274913 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274886    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-data\") pod \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\" (UID: \"c6169ebb-7dd8-4665-acd9-4edddbbd2aed\") "
Aug 04 17:02:40.275024 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.274918    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c6169ebb-7dd8-4665-acd9-4edddbbd2aed" (UID: "c6169ebb-7dd8-4665-acd9-4edddbbd2aed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:40.275867 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.275307    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c6169ebb-7dd8-4665-acd9-4edddbbd2aed" (UID: "c6169ebb-7dd8-4665-acd9-4edddbbd2aed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:40.275867 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.275441    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istiod-ca-cert\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:02:40.275867 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.275498    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-certs\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:02:40.275867 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.275515    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-workload-socket\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:02:40.275867 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.275532    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-data" (OuterVolumeSpecName: "istio-data") pod "c6169ebb-7dd8-4665-acd9-4edddbbd2aed" (UID: "c6169ebb-7dd8-4665-acd9-4edddbbd2aed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:40.275867 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.275789    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c6169ebb-7dd8-4665-acd9-4edddbbd2aed" (UID: "c6169ebb-7dd8-4665-acd9-4edddbbd2aed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:40.278411 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.277711    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c6169ebb-7dd8-4665-acd9-4edddbbd2aed" (UID: "c6169ebb-7dd8-4665-acd9-4edddbbd2aed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 17:02:40.278733 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.278693    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-kube-api-access-z4ckc" (OuterVolumeSpecName: "kube-api-access-z4ckc") pod "c6169ebb-7dd8-4665-acd9-4edddbbd2aed" (UID: "c6169ebb-7dd8-4665-acd9-4edddbbd2aed"). InnerVolumeSpecName "kube-api-access-z4ckc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:02:40.279487 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.279460    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-token" (OuterVolumeSpecName: "istio-token") pod "c6169ebb-7dd8-4665-acd9-4edddbbd2aed" (UID: "c6169ebb-7dd8-4665-acd9-4edddbbd2aed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 17:02:40.282885 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.282859    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c6169ebb-7dd8-4665-acd9-4edddbbd2aed" (UID: "c6169ebb-7dd8-4665-acd9-4edddbbd2aed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 17:02:40.376826 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.376788    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4ckc\" (UniqueName: \"kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-kube-api-access-z4ckc\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:02:40.376826 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.376821    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-data\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:02:40.376826 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.376830    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-envoy\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:02:40.376826 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.376838    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-credential-socket\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:02:40.377086 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.376847    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-token\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:02:40.377086 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.376855    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c6169ebb-7dd8-4665-acd9-4edddbbd2aed-istio-podinfo\") on node \"ip-10-0-141-219.ec2.internal\" DevicePath \"\""
Aug 04 17:02:40.403078 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.403046    2558 generic.go:356] "Generic (PLEG): container finished" podID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerID="9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0" exitCode=0
Aug 04 17:02:40.403235 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.403084    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" event={"ID":"c6169ebb-7dd8-4665-acd9-4edddbbd2aed","Type":"ContainerDied","Data":"9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0"}
Aug 04 17:02:40.403235 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.403117    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"
Aug 04 17:02:40.403235 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.403149    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278" event={"ID":"c6169ebb-7dd8-4665-acd9-4edddbbd2aed","Type":"ContainerDied","Data":"649ae3ded6d0c0c3f7739853c1dd364eec2ba0cf470bfa72d1d8866fa5a650d5"}
Aug 04 17:02:40.403235 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.403171    2558 scope.go:117] "RemoveContainer" containerID="9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0"
Aug 04 17:02:40.412315 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.412297    2558 scope.go:117] "RemoveContainer" containerID="6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4"
Aug 04 17:02:40.422326 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.422310    2558 scope.go:117] "RemoveContainer" containerID="9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0"
Aug 04 17:02:40.422607 ip-10-0-141-219 kubenswrapper[2558]: E0804 17:02:40.422586    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0\": container with ID starting with 9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0 not found: ID does not exist" containerID="9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0"
Aug 04 17:02:40.422655 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.422615    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0"} err="failed to get container status \"9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0\": rpc error: code = NotFound desc = could not find container \"9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0\": container with ID starting with 9e50328e5c959ff4365de385c5708e66fcdade0423b6f8e4b3b722fef98f1ac0 not found: ID does not exist"
Aug 04 17:02:40.422655 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.422631    2558 scope.go:117] "RemoveContainer" containerID="6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4"
Aug 04 17:02:40.422948 ip-10-0-141-219 kubenswrapper[2558]: E0804 17:02:40.422908    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4\": container with ID starting with 6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4 not found: ID does not exist" containerID="6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4"
Aug 04 17:02:40.423049 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.422945    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4"} err="failed to get container status \"6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4\": rpc error: code = NotFound desc = could not find container \"6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4\": container with ID starting with 6d70ed14d75d6bdd8dc1c70e36b1e16870db80477328d54d50eefd354cc7c9c4 not found: ID does not exist"
Aug 04 17:02:40.425257 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.425236    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"]
Aug 04 17:02:40.429255 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.429233    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-222eca-openshift-default-6f7c4f8dd8-lk278"]
Aug 04 17:02:40.693022 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:40.692988    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" path="/var/lib/kubelet/pods/c6169ebb-7dd8-4665-acd9-4edddbbd2aed/volumes"
Aug 04 17:02:41.501921 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:41.501886    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sjxjf_bb40d4b9-5cc6-4985-ac80-d9330f627340/manager/0.log"
Aug 04 17:02:41.881207 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:41.881180    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd47f799b-m2kgm_6a3f1220-56b0-4e77-b9a5-8f15c8b562ef/copy-manifests/0.log"
Aug 04 17:02:41.888236 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:41.888214    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd47f799b-m2kgm_6a3f1220-56b0-4e77-b9a5-8f15c8b562ef/manager/0.log"
Aug 04 17:02:42.705010 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:42.704977    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-kddzk_3d140e1c-6f4b-42cc-adbf-bd22a80a18ec/postgres/0.log"
Aug 04 17:02:43.503826 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:43.503783    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bf6b476bb-cffmx_9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01/authorino/0.log"
Aug 04 17:02:43.844976 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:43.844894    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-597v4_8342179f-3e2b-4395-a0a6-1593b6fa0903/kuadrant-console-plugin/0.log"
Aug 04 17:02:44.958470 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:44.958440    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb97f6d89-qpjnm_e2debd93-f80e-41bd-8760-c636431fc4f5/kube-auth-proxy/0.log"
Aug 04 17:02:45.096806 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:45.096772    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tjljz_71e62d3a-85ac-4e7a-ae12-acc423d3ff3b/istio-proxy/1.log"
Aug 04 17:02:45.923286 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:45.923253    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jmsnq_2e5d94bd-f684-4a6f-aa59-a5c178279aa2/main/0.log"
Aug 04 17:02:46.040439 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:46.040400    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-sgz76_cc41460e-5a5f-49e2-aaae-9292a62f6470/main/0.log"
Aug 04 17:02:46.262032 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:46.261941    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ppcpw_07bbe9af-8afc-4dbb-add5-c5600cbc99de/main/0.log"
Aug 04 17:02:54.574766 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:54.574709    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-567wr_1970ae52-3a87-4857-86ee-7b8f65d2b970/global-pull-secret-syncer/0.log"
Aug 04 17:02:54.791566 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:54.791533    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qt5hg_34cb4228-a3d9-4bd8-982b-6a941e97db27/konnectivity-agent/0.log"
Aug 04 17:02:54.868640 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:54.868610    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-219.ec2.internal_0ce7e1ec722c560af91b69ec211c1787/haproxy/0.log"
Aug 04 17:02:59.811961 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:59.811927    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7bf6b476bb-cffmx_9bc46510-1ddc-42e3-8a3a-f8c8d8d22e01/authorino/0.log"
Aug 04 17:02:59.902064 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:02:59.902039    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-597v4_8342179f-3e2b-4395-a0a6-1593b6fa0903/kuadrant-console-plugin/0.log"
Aug 04 17:03:01.926475 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:01.926443    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78874bbd75-8j8dt_636ad6d4-461d-4690-85a2-1a91acdc5bcc/metrics-server/0.log"
Aug 04 17:03:01.952348 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:01.952322    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-npsbr_e0e4e77e-042a-4898-ab2d-6f571cc0dbd8/monitoring-plugin/0.log"
Aug 04 17:03:01.985493 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:01.985469    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7pvr5_3ef4138b-77ec-4cd6-a141-c91c1d0549f7/node-exporter/0.log"
Aug 04 17:03:02.006134 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:02.006098    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7pvr5_3ef4138b-77ec-4cd6-a141-c91c1d0549f7/kube-rbac-proxy/0.log"
Aug 04 17:03:02.025432 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:02.025400    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7pvr5_3ef4138b-77ec-4cd6-a141-c91c1d0549f7/init-textfile/0.log"
Aug 04 17:03:02.276240 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:02.276204    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2691e708-a784-4d82-b0c6-a88b8e1be401/prometheus/0.log"
Aug 04 17:03:02.296559 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:02.296521    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2691e708-a784-4d82-b0c6-a88b8e1be401/config-reloader/0.log"
Aug 04 17:03:02.319972 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:02.319950    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2691e708-a784-4d82-b0c6-a88b8e1be401/thanos-sidecar/0.log"
Aug 04 17:03:02.340616 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:02.340592    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2691e708-a784-4d82-b0c6-a88b8e1be401/kube-rbac-proxy-web/0.log"
Aug 04 17:03:02.363795 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:02.363767    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2691e708-a784-4d82-b0c6-a88b8e1be401/kube-rbac-proxy/0.log"
Aug 04 17:03:02.388467 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:02.388444    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2691e708-a784-4d82-b0c6-a88b8e1be401/kube-rbac-proxy-thanos/0.log"
Aug 04 17:03:02.412240 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:02.412208    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2691e708-a784-4d82-b0c6-a88b8e1be401/init-config-reloader/0.log"
Aug 04 17:03:04.307534 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307501    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"]
Aug 04 17:03:04.307932 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307858    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy"
Aug 04 17:03:04.307932 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307872    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy"
Aug 04 17:03:04.307932 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307881    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e018b04d-c672-4e2d-bdb4-85a421900b2e" containerName="revoke-keys"
Aug 04 17:03:04.307932 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307886    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e018b04d-c672-4e2d-bdb4-85a421900b2e" containerName="revoke-keys"
Aug 04 17:03:04.307932 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307893    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy"
Aug 04 17:03:04.307932 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307898    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy"
Aug 04 17:03:04.307932 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307914    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy"
Aug 04 17:03:04.307932 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307919    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy"
Aug 04 17:03:04.308184 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307970    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e9294c5-2abd-41ad-9cf4-ad14f4b91a95" containerName="istio-proxy"
Aug 04 17:03:04.308184 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307980    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e018b04d-c672-4e2d-bdb4-85a421900b2e" containerName="revoke-keys"
Aug 04 17:03:04.308184 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307987    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy"
Aug 04 17:03:04.308184 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.307992    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6169ebb-7dd8-4665-acd9-4edddbbd2aed" containerName="istio-proxy"
Aug 04 17:03:04.312689 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.312669    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.315508 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.315465    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wj42w\"/\"openshift-service-ca.crt\""
Aug 04 17:03:04.316849 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.316827    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wj42w\"/\"kube-root-ca.crt\""
Aug 04 17:03:04.316936 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.316894    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wj42w\"/\"default-dockercfg-ddj78\""
Aug 04 17:03:04.321173 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.321150    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"]
Aug 04 17:03:04.490730 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.490690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-podres\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.490730 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.490729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-sys\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.490966 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.490773    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcwf8\" (UniqueName: \"kubernetes.io/projected/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-kube-api-access-xcwf8\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.490966 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.490890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-lib-modules\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.490966 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.490930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-proc\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.591871 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.591788    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-lib-modules\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.591871 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.591837    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-proc\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.592055 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.591906    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-podres\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.592055 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.591929    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-sys\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.592055 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.591953    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcwf8\" (UniqueName: \"kubernetes.io/projected/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-kube-api-access-xcwf8\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.592055 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.591996    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-lib-modules\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.592055 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.591998    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-proc\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.592055 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.592006    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-sys\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.592055 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.592028    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-podres\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.601298 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.601271    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcwf8\" (UniqueName: \"kubernetes.io/projected/1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc-kube-api-access-xcwf8\") pod \"perf-node-gather-daemonset-ccpph\" (UID: \"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc\") " pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.623213 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.623187    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:04.758580 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:04.758555    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"]
Aug 04 17:03:04.761298 ip-10-0-141-219 kubenswrapper[2558]: W0804 17:03:04.761269    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1f2b8663_f5ff_43cd_aebd_efd3aa40d8cc.slice/crio-acc9a3ffc11a4d7594f70c3e000d39dcc215aa7e12a15dd69288eb5163984d22 WatchSource:0}: Error finding container acc9a3ffc11a4d7594f70c3e000d39dcc215aa7e12a15dd69288eb5163984d22: Status 404 returned error can't find the container with id acc9a3ffc11a4d7594f70c3e000d39dcc215aa7e12a15dd69288eb5163984d22
Aug 04 17:03:05.232994 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:05.232962    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-849df987-54qf5_1ae48a28-2eaa-4e01-9eb7-3360bea2688a/console/0.log"
Aug 04 17:03:05.517094 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:05.516998    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph" event={"ID":"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc","Type":"ContainerStarted","Data":"dfc18b9e14f1f0d603bbfb7d13664f2f04a633e661df3fdda48b9581ea5a9b34"}
Aug 04 17:03:05.517094 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:05.517066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph" event={"ID":"1f2b8663-f5ff-43cd-aebd-efd3aa40d8cc","Type":"ContainerStarted","Data":"acc9a3ffc11a4d7594f70c3e000d39dcc215aa7e12a15dd69288eb5163984d22"}
Aug 04 17:03:05.517502 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:05.517101    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:05.534430 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:05.534378    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph" podStartSLOduration=1.534363339 podStartE2EDuration="1.534363339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 17:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 17:03:05.532688238 +0000 UTC m=+3671.389161121" watchObservedRunningTime="2026-08-04 17:03:05.534363339 +0000 UTC m=+3671.390836184"
Aug 04 17:03:06.963945 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:06.963914    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vv65q_1ff3ee70-603d-4e02-b093-fa8a34dfce43/dns/0.log"
Aug 04 17:03:06.984870 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:06.984836    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vv65q_1ff3ee70-603d-4e02-b093-fa8a34dfce43/kube-rbac-proxy/0.log"
Aug 04 17:03:07.102432 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:07.102399    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zmjsp_539c6194-4c8c-4a36-aa43-5fb5237a4aa9/dns-node-resolver/0.log"
Aug 04 17:03:07.625870 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:07.625839    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55567984d8-pb5wt_b8d38fb3-9509-44cd-953e-2d3d0fb62f6e/registry/0.log"
Aug 04 17:03:07.658684 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:07.658654    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pqks_260ae6f4-c39b-44c0-8283-f1917eaa49ed/node-ca/0.log"
Aug 04 17:03:08.997384 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:08.997353    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb97f6d89-qpjnm_e2debd93-f80e-41bd-8760-c636431fc4f5/kube-auth-proxy/0.log"
Aug 04 17:03:09.030758 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:09.030716    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tjljz_71e62d3a-85ac-4e7a-ae12-acc423d3ff3b/istio-proxy/0.log"
Aug 04 17:03:09.044179 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:09.044147    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tjljz_71e62d3a-85ac-4e7a-ae12-acc423d3ff3b/istio-proxy/1.log"
Aug 04 17:03:09.929627 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:09.929588    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gjs4z_a13f1b0b-f1fe-4c3b-a7e5-cd4d773d859c/serve-healthcheck-canary/0.log"
Aug 04 17:03:10.539685 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:10.539631    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tlmpb_4cddeb9d-83a3-4912-aa95-87a787061f13/kube-rbac-proxy/0.log"
Aug 04 17:03:10.558575 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:10.558551    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tlmpb_4cddeb9d-83a3-4912-aa95-87a787061f13/exporter/0.log"
Aug 04 17:03:10.580259 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:10.580225    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tlmpb_4cddeb9d-83a3-4912-aa95-87a787061f13/extractor/0.log"
Aug 04 17:03:11.530986 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:11.530959    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wj42w/perf-node-gather-daemonset-ccpph"
Aug 04 17:03:13.477601 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:13.477560    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sjxjf_bb40d4b9-5cc6-4985-ac80-d9330f627340/manager/0.log"
Aug 04 17:03:13.726907 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:13.726872    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd47f799b-m2kgm_6a3f1220-56b0-4e77-b9a5-8f15c8b562ef/manager/0.log"
Aug 04 17:03:13.745896 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:13.745822    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dd47f799b-m2kgm_6a3f1220-56b0-4e77-b9a5-8f15c8b562ef/copy-manifests/0.log"
Aug 04 17:03:14.316428 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:14.316390    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb97f6d89-qpjnm_e2debd93-f80e-41bd-8760-c636431fc4f5/kube-auth-proxy/0.log"
Aug 04 17:03:14.337537 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:14.337504    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tjljz_71e62d3a-85ac-4e7a-ae12-acc423d3ff3b/istio-proxy/0.log"
Aug 04 17:03:14.350143 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:14.350106    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tjljz_71e62d3a-85ac-4e7a-ae12-acc423d3ff3b/istio-proxy/1.log"
Aug 04 17:03:15.109720 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:15.109690    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c58867685-7294c_6a029e0d-b22e-4d22-baf1-1daafef4f2fe/manager/0.log"
Aug 04 17:03:16.243110 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:16.243078    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5cb97f6d89-qpjnm_e2debd93-f80e-41bd-8760-c636431fc4f5/kube-auth-proxy/0.log"
Aug 04 17:03:16.262416 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:16.262385    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tjljz_71e62d3a-85ac-4e7a-ae12-acc423d3ff3b/istio-proxy/0.log"
Aug 04 17:03:16.274664 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:16.274633    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-tjljz_71e62d3a-85ac-4e7a-ae12-acc423d3ff3b/istio-proxy/1.log"
Aug 04 17:03:21.255625 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.255582    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/0.log"
Aug 04 17:03:21.272124 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.272093    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-65rhv_70e1a8ed-3f32-4741-88f6-83c335916944/kube-multus/1.log"
Aug 04 17:03:21.613699 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.613616    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hm7nd_0affb8f6-4aea-42d6-ab48-ffe1fb5b682b/kube-multus-additional-cni-plugins/0.log"
Aug 04 17:03:21.635041 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.635014    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hm7nd_0affb8f6-4aea-42d6-ab48-ffe1fb5b682b/egress-router-binary-copy/0.log"
Aug 04 17:03:21.654249 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.654222    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hm7nd_0affb8f6-4aea-42d6-ab48-ffe1fb5b682b/cni-plugins/0.log"
Aug 04 17:03:21.672833 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.672802    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hm7nd_0affb8f6-4aea-42d6-ab48-ffe1fb5b682b/bond-cni-plugin/0.log"
Aug 04 17:03:21.694890 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.694860    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hm7nd_0affb8f6-4aea-42d6-ab48-ffe1fb5b682b/routeoverride-cni/0.log"
Aug 04 17:03:21.713008 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.712982    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hm7nd_0affb8f6-4aea-42d6-ab48-ffe1fb5b682b/whereabouts-cni-bincopy/0.log"
Aug 04 17:03:21.732555 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.732527    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hm7nd_0affb8f6-4aea-42d6-ab48-ffe1fb5b682b/whereabouts-cni/0.log"
Aug 04 17:03:21.854876 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.854833    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mgh47_94745705-d59a-4672-b018-7a34bca41ca6/network-metrics-daemon/0.log"
Aug 04 17:03:21.874849 ip-10-0-141-219 kubenswrapper[2558]: I0804 17:03:21.874823    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mgh47_94745705-d59a-4672-b018-7a34bca41ca6/kube-rbac-proxy/0.log"