Jul 13 19:23:13.811079 ip-10-0-143-201 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 19:23:13.811092 ip-10-0-143-201 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 19:23:13.811101 ip-10-0-143-201 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 19:23:13.811462 ip-10-0-143-201 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 19:23:24.990260 ip-10-0-143-201 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 13 19:23:24.990276 ip-10-0-143-201 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e4935bf45e23429a9a9873f4b33337c0 --
Jul 13 19:25:26.872164 ip-10-0-143-201 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 19:25:27.274964 ip-10-0-143-201 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 19:25:27.274964 ip-10-0-143-201 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 19:25:27.274964 ip-10-0-143-201 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 19:25:27.274964 ip-10-0-143-201 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 19:25:27.274964 ip-10-0-143-201 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 19:25:27.276971 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.276870    2550 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 19:25:27.280375 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280356    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 19:25:27.280375 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280375    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280380    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280383    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280386    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280389    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280392    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280394    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280397    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280400    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280408    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280413    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280417    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280420    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280422    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280426    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280429    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280431    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280434    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280437    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280440    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 19:25:27.280450 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280443    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280445    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280448    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280450    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280453    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280456    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280459    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280462    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280464    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280468    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280470    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280473    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280475    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280477    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280480    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280483    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280486    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280489    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280491    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 19:25:27.280951 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280494    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280496    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280500    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280502    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280504    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280507    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280509    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280512    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280514    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280516    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280519    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280521    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280523    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280526    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280529    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280532    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280535    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280538    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280541    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280543    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 19:25:27.281408 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280546    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280548    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280551    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280553    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280556    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280559    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280561    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280563    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280566    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280568    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280571    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280573    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280575    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280578    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280580    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280598    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280602    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280604    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280607    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280609    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 19:25:27.282013 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280613    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280617    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280620    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280623    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280625    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280629    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280631    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280634    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280637    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280640    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280642    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280646    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280649    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280652    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280655    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280658    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280661    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280663    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.280667    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 19:25:27.282540 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281405    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281415    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281418    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281421    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281424    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281427    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281429    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281432    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281435    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281438    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281441    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281444    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281447    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281449    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281451    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281454    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281457    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281459    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281462    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281464    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 19:25:27.283023 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281467    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281470    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281472    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281475    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281479    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281483    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281486    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281489    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281493    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281496    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281499    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281501    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281504    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281507    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281510    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281513    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281515    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281518    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281520    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 19:25:27.283559 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281522    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281525    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281528    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281531    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281534    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281536    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281539    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281542    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281544    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281547    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281549    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281551    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281554    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281557    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281559    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281562    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281565    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281567    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281570    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 19:25:27.284052 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281573    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281575    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281577    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281580    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281582    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281585    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281588    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281591    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281593    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281596    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281598    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281601    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281603    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281606    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281608    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281610    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281613    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281617    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281620    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281622    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 19:25:27.284545 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281625    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281627    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281630    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281633    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281635    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281639    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281641    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281644    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281646    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281649    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281651    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281653    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281656    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281658    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281661    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281663    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281666    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281670    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281673    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281675    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 19:25:27.285062 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.281678    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282084    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282089    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282092    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282094    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282097    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282099    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282102    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282104    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282109    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282111    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282114    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282116    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282119    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282121    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282124    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282127    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282129    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282132    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282134    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 19:25:27.285544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282136    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282139    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282142    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282144    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282146    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282149    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282151    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282154    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282157    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282159    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282162    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282164    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282167    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282169    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282172    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282174    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282176    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282179    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282181    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282184    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 19:25:27.286042 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282186    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282190    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282193    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282195    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282198    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282200    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282203    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282207    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282209    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282212    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282214    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282217    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282219    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282222    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282224    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282227    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282229    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282231    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282235    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282239    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 19:25:27.286556 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282242    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282246    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282249    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282252    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282254    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282256    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282259    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282261    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282264    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282266    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282269    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282272    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282274    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282277    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282280    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282283    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282286    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282288    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282290    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282296    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 19:25:27.287048 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282299    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282301    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282304    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282307    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282310    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282312    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282314    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282317    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282319    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282322    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282324    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282328    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282331    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282334    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282337    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282340    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282344    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282347    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282350    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 19:25:27.287544 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.282353    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282428    2550 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282435    2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282441    2550 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282446    2550 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282450    2550 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282457    2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282461    2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282465    2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282469    2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282472    2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282475    2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282479    2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282482    2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282485    2550 flags.go:64] FLAG: --cgroup-root=""
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282488    2550 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282491    2550 flags.go:64] FLAG: --client-ca-file=""
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282494    2550 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282497    2550 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282501    2550 flags.go:64] FLAG: --cluster-domain=""
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282504    2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282507    2550 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282510    2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282513    2550 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 19:25:27.288027 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282517    2550 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282520    2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282524    2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282527    2550 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282530    2550 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282533    2550 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282536    2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282540    2550 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282543    2550 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282547    2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282550    2550 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282553    2550 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282556    2550 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282559    2550 flags.go:64] FLAG: --enable-server="true"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282563    2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282567    2550 flags.go:64] FLAG: --event-burst="100"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282570    2550 flags.go:64] FLAG: --event-qps="50"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282573    2550 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282577    2550 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282580    2550 flags.go:64] FLAG: --eviction-hard=""
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282585    2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282588    2550 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282591    2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282593    2550 flags.go:64] FLAG: --eviction-soft=""
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282596    2550 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 19:25:27.288602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282599    2550 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282602    2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282604    2550 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282607    2550 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282610    2550 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282612    2550 flags.go:64] FLAG: --feature-gates=""
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282616    2550 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282619    2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282621    2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282624    2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282627    2550 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282630    2550 flags.go:64] FLAG: --help="false"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282633    2550 flags.go:64] FLAG: --hostname-override="ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282636    2550 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282639    2550 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282641    2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282645    2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282648    2550 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282650    2550 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282653    2550 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282656    2550 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282659    2550 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282662    2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282665    2550 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 19:25:27.289267 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282668    2550 flags.go:64] FLAG: --kube-reserved=""
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282671    2550 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282674    2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282679    2550 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282681    2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282684    2550 flags.go:64] FLAG: --lock-file=""
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282687    2550 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282690    2550 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282693    2550 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282698    2550 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282700    2550 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282703    2550 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282706    2550 flags.go:64] FLAG: --logging-format="text"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282708    2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282712    2550 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282714    2550 flags.go:64] FLAG: --manifest-url=""
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282717    2550 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282725    2550 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282727    2550 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282731    2550 flags.go:64] FLAG: --max-pods="110"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282734    2550 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282737    2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282740    2550 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282743    2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282746    2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 19:25:27.289990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282749    2550 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282752    2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282759    2550 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282762    2550 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282765    2550 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282768    2550 flags.go:64] FLAG: --pod-cidr=""
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282771    2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282777    2550 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282780    2550 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282783    2550 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282787    2550 flags.go:64] FLAG: --port="10250"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282790    2550 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282793    2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a446e5360e069f42"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282796    2550 flags.go:64] FLAG: --qos-reserved=""
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282799    2550 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282816    2550 flags.go:64] FLAG: --register-node="true"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282819    2550 flags.go:64] FLAG: --register-with-taints=""
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282822    2550 flags.go:64] FLAG: --registry-burst="10"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282825    2550 flags.go:64] FLAG: --registry-qps="5"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282829    2550 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282832    2550 flags.go:64] FLAG: --reserved-memory=""
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282836    2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282839    2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282842    2550 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282844    2550 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 19:25:27.290922 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282847    2550 flags.go:64] FLAG: --runonce="false"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282850    2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282853    2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282856    2550 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282858    2550 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282861    2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282864    2550 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282867    2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282870    2550 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282873    2550 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282876    2550 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282878    2550 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282881    2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282884    2550 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282887    2550 flags.go:64] FLAG: --system-cgroups=""
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282889    2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282895    2550 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282898    2550 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282902    2550 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282906    2550 flags.go:64] FLAG: --tls-min-version=""
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282909    2550 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282912    2550 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282914    2550 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282917    2550 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282920    2550 flags.go:64] FLAG: --v="2"
Jul 13 19:25:27.291551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282924    2550 flags.go:64] FLAG: --version="false"
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282927    2550 flags.go:64] FLAG: --vmodule=""
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282932    2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.282934    2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283056    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283060    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283063    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283066    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283069    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283071    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283074    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283077    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283079    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283081    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283084    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283086    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283089    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283093    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283095    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283098    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283100    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 19:25:27.292180 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283103    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283105    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283108    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283112    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283115    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283119    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283121    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283123    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283126    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283128    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283131    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283133    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283137    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283140    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283144    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283146    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283149    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283152    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283154    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 19:25:27.292780 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283156    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283159    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283161    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283164    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283166    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283169    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283172    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283174    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283176    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283180    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283182    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283185    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283187    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283190    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283192    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283195    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283199    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283201    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283204    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 19:25:27.293288 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283208    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283211    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283214    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283217    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283219    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283222    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283224    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283227    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283229    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283231    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283234    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283236    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283238    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283241    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283243    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283246    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283248    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283251    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283253    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 19:25:27.293752 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283257    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283260    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283263    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283267    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283270    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283273    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283275    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283278    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283281    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283283    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283286    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283289    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283291    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283294    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283297    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283299    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283302    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283304    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283307    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283309    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 19:25:27.294332 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283312    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283314    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283317    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283319    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.283321    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.283860    2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.292299    2550 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.292319    2550 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.293057    2550 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.293066    2550 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293131    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293136    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293140    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293144    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293148    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 19:25:27.294827 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293151    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293154    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293157    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293160    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293163    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293165    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293168    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293170    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293173    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293175    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293178    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293181    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293183    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293186    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293189    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293191    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293194    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293196    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293200    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293202    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 19:25:27.295199 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293205    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293208    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293211    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293214    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293217    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293219    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293222    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293225    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293227    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293230    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293233    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293235    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293238    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293240    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293243    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293245    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293248    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293251    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293253    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293256    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 19:25:27.295691 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293259    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293261    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293264    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293267    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293269    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293272    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293274    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293277    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293279    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293282    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293284    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293287    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293289    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293292    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293295    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293298    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293301    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293304    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293306    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293310    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 19:25:27.296185 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293314    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293317    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293320    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293323    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293326    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293329    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293332    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293335    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293338    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293342    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293346    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293349    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293351    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293354    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293358    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293360    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293363    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293365    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293367    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 19:25:27.296685 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293370    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293372    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293375    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293377    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293380    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293382    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293385    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293388    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293391    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293394    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293396    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293399    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293401    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293404    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293406    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 19:25:27.297176 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.293411    2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293536    2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293543    2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293546    2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293548    2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293551    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293554    2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293558    2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293561    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293563    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293567    2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293571    2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293574    2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293577    2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293580    2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293583    2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293586    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293588    2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293591    2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 19:25:27.297546 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293593    2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293596    2550 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293599    2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293601    2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293604    2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293606    2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293609    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293612    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293614    2550 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293617    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293619    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293622    2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293624    2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293627    2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293629    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293631    2550 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293634    2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293636    2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293638    2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293641    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 19:25:27.298132 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293643    2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293646    2550 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293648    2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293651    2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293653    2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293657    2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293660    2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293664    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293667    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293669    2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293672    2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293675    2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293677    2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293680    2550 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293683    2550 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293686    2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293689    2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293691    2550 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293695    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 19:25:27.298622 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293698    2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293701    2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293703    2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293706    2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293708    2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293711    2550 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293713    2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293716    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293719    2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293722    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293725    2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293728    2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293730    2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293733    2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293735    2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293737    2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293740    2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293742    2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293745    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 19:25:27.299110 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293747    2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293750    2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293754    2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293757    2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293760    2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293762    2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293765    2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293767    2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293770    2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293772    2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293775    2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293777    2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293780    2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293783    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293785    2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293788    2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293790    2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293792    2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293795    2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293798    2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 19:25:27.299574 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293819    2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 19:25:27.300133 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293822    2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 19:25:27.300133 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:27.293825    2550 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 19:25:27.300133 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.293830    2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 19:25:27.300133 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.293961    2550 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 19:25:27.300133 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.297620    2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 19:25:27.300133 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.298905    2550 server.go:1019] "Starting client certificate rotation"
Jul 13 19:25:27.300133 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.299013    2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 19:25:27.300133 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.299053    2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 19:25:27.301263 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.301247    2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 19:25:27.306198 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.306180    2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 19:25:27.317835 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.317799    2550 log.go:25] "Validated CRI v1 runtime API"
Jul 13 19:25:27.319931 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.319915    2550 log.go:25] "Validated CRI v1 image API"
Jul 13 19:25:27.320764 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.320744    2550 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 19:25:27.323032 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.323010    2550 fs.go:135] Filesystem UUIDs: map[54f02fc0-9488-4fcf-a7fe-10cfc2237eac:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d8652c89-e7fa-4231-bdd8-686c5e661a88:/dev/nvme0n1p4]
Jul 13 19:25:27.323105 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.323031    2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 19:25:27.327305 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.327277    2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 19:25:27.330598 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.330478    2550 manager.go:216] Machine: {Timestamp:2026-07-13 19:25:27.32917949 +0000 UTC m=+0.329670042 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108927 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28e18b1c05ca83c4caf0caf1820a7c SystemUUID:ec28e18b-1c05-ca83-c4ca-f0caf1820a7c BootID:e4935bf4-5e23-429a-9a98-73f4b33337c0 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2f:f0:aa:20:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2f:f0:aa:20:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:2a:23:57:6e:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 19:25:27.330598 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.330589    2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 19:25:27.330719 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.330685    2550 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 19:25:27.333812 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.333773    2550 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 19:25:27.333967 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.333821    2550 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-201.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 19:25:27.334465 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.334455    2550 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 19:25:27.334495 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.334468    2550 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 19:25:27.334495 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.334476    2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 19:25:27.335015 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.335004    2550 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 19:25:27.336206 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.336195    2550 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 19:25:27.338912 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.338899    2550 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 19:25:27.339055 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.339045    2550 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 19:25:27.339087 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.339080    2550 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 19:25:27.339114 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.339094    2550 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 19:25:27.339140 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.339120    2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 19:25:27.339140 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.339133    2550 kubelet.go:398] "Adding apiserver pod source"
Jul 13 19:25:27.339200 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.339146    2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 19:25:27.339651 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.339634    2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 19:25:27.339719 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.339661    2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 19:25:27.342119 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.342103    2550 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 19:25:27.343933 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.343919    2550 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 19:25:27.343995 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.343960    2550 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 19:25:27.344137 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344127    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 19:25:27.344166 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344144    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 19:25:27.344166 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344150    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 19:25:27.344166 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344155    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 19:25:27.344166 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344163    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 19:25:27.344260 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344169    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 19:25:27.344674 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344666    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 19:25:27.344709 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344675    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 19:25:27.344709 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344682    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 19:25:27.344709 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344687    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 19:25:27.344709 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344696    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 19:25:27.344709 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.344704    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 19:25:27.345508 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.345495    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 19:25:27.345508 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.345507    2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 19:25:27.349035 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.349022    2550 server.go:1268] "Started kubelet"
Jul 13 19:25:27.349134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.349106    2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 19:25:27.349134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.349094    2550 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 19:25:27.349221 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.349197    2550 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 19:25:27.350185 ip-10-0-143-201 systemd[1]: Started Kubernetes Kubelet.
Jul 13 19:25:27.350332 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.350315    2550 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 19:25:27.350916 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.350895    2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 19:25:27.350982 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.350908    2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 19:25:27.351126 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.351079    2550 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-201.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 19:25:27.352208 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.352193    2550 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 19:25:27.353731 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.353714    2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zs6qh"
Jul 13 19:25:27.355283 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.355269    2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 19:25:27.355347 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.355281    2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 19:25:27.355896 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.355652    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:27.356013 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.354876    2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-201.ec2.internal.18c1efecb555033f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-201.ec2.internal,UID:ip-10-0-143-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-201.ec2.internal,},FirstTimestamp:2026-07-13 19:25:27.348994879 +0000 UTC m=+0.349485430,LastTimestamp:2026-07-13 19:25:27.348994879 +0000 UTC m=+0.349485430,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-201.ec2.internal,}"
Jul 13 19:25:27.356110 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356002    2550 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 19:25:27.356181 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356173    2550 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 19:25:27.356273 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356175    2550 factory.go:55] Registering systemd factory
Jul 13 19:25:27.356381 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356296    2550 factory.go:223] Registration of the systemd container factory successfully
Jul 13 19:25:27.356435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356407    2550 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 19:25:27.356435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356415    2550 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 19:25:27.356521 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356467    2550 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 19:25:27.356521 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356493    2550 factory.go:153] Registering CRI-O factory
Jul 13 19:25:27.356521 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356505    2550 factory.go:223] Registration of the crio container factory successfully
Jul 13 19:25:27.356669 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356567    2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 19:25:27.356669 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356599    2550 factory.go:103] Registering Raw factory
Jul 13 19:25:27.356669 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.356615    2550 manager.go:1196] Started watching for new ooms in manager
Jul 13 19:25:27.357771 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.357749    2550 manager.go:349] Starting recovery of all containers
Jul 13 19:25:27.358415 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.358389    2550 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 19:25:27.361435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.361412    2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zs6qh"
Jul 13 19:25:27.363574 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.363545    2550 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 19:25:27.363672 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.363557    2550 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 19:25:27.370248 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.370087    2550 manager.go:354] Recovery completed
Jul 13 19:25:27.372181 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.372158    2550 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 13 19:25:27.375763 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.375748    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 19:25:27.377791 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.377776    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 19:25:27.377868 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.377825    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 19:25:27.377868 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.377840    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientPID"
Jul 13 19:25:27.378362 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.378349    2550 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 19:25:27.378362 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.378360    2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 19:25:27.378453 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.378375    2550 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 19:25:27.378453 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.378360    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 19:25:27.379564 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.379547    2550 policy_none.go:49] "None policy: Start"
Jul 13 19:25:27.379648 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.379571    2550 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 19:25:27.379648 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.379584    2550 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 19:25:27.380349 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.380059    2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-201.ec2.internal.18c1efecb70c6aff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-201.ec2.internal,UID:ip-10-0-143-201.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-201.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-201.ec2.internal,},FirstTimestamp:2026-07-13 19:25:27.377791743 +0000 UTC m=+0.378282294,LastTimestamp:2026-07-13 19:25:27.377791743 +0000 UTC m=+0.378282294,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-201.ec2.internal,}"
Jul 13 19:25:27.380910 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.380796    2550 policy_none.go:47] "Start"
Jul 13 19:25:27.380910 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.380890    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 19:25:27.381095 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.380920    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 19:25:27.381095 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.380936    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientPID"
Jul 13 19:25:27.428566 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.428543    2550 manager.go:337] "Starting Device Plugin manager"
Jul 13 19:25:27.428685 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.428602    2550 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 19:25:27.428685 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.428616    2550 server.go:87] "Starting device plugin registration server"
Jul 13 19:25:27.428964 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.428951    2550 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 19:25:27.429004 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.428968    2550 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 19:25:27.429093 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.429064    2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 19:25:27.429163 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.429147    2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 19:25:27.429163 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.429153    2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 19:25:27.429700 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.429677    2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 19:25:27.429784 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.429728    2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:27.529353 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.529266    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 19:25:27.530697 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.530534    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 19:25:27.530697 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.530570    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 19:25:27.530697 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.530580    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientPID"
Jul 13 19:25:27.530697 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.530613    2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.537022 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.536992    2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 19:25:27.538443 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.538413    2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 19:25:27.538536 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.538467    2550 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 19:25:27.538536 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.538495    2550 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 19:25:27.538611 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.538536    2550 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 19:25:27.539829 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.539793    2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.539918 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.539840    2550 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-201.ec2.internal\": node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:27.540901 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.540882    2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 19:25:27.606208 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.606171    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:27.639293 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.639241    2550 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal"]
Jul 13 19:25:27.639376 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.639340    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 19:25:27.640306 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.640289    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 19:25:27.640398 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.640320    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 19:25:27.640398 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.640335    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientPID"
Jul 13 19:25:27.641960 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.641947    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 19:25:27.642085 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.642072    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.642131 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.642101    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 19:25:27.642744 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.642729    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 19:25:27.642744 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.642739    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 19:25:27.642873 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.642759    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 19:25:27.642873 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.642761    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 19:25:27.642873 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.642769    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientPID"
Jul 13 19:25:27.642873 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.642775    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientPID"
Jul 13 19:25:27.644096 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.644077    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.644179 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.644101    2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 19:25:27.644841 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.644825    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 19:25:27.644935 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.644849    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 19:25:27.644935 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.644859    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeHasSufficientPID"
Jul 13 19:25:27.657412 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.657389    2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-201.ec2.internal\" not found" node="ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.658162 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.658139    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03a3666c340159a37456eb8a4ee4db64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal\" (UID: \"03a3666c340159a37456eb8a4ee4db64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.658260 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.658189    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03a3666c340159a37456eb8a4ee4db64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal\" (UID: \"03a3666c340159a37456eb8a4ee4db64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.658260 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.658218    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1979fb683e265419a7ecbcfd0f890be8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-201.ec2.internal\" (UID: \"1979fb683e265419a7ecbcfd0f890be8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.663607 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.663586    2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-201.ec2.internal\" not found" node="ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.706515 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.706483    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:27.758606 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.758577    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03a3666c340159a37456eb8a4ee4db64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal\" (UID: \"03a3666c340159a37456eb8a4ee4db64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.758780 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.758612    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03a3666c340159a37456eb8a4ee4db64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal\" (UID: \"03a3666c340159a37456eb8a4ee4db64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.758780 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.758634    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1979fb683e265419a7ecbcfd0f890be8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-201.ec2.internal\" (UID: \"1979fb683e265419a7ecbcfd0f890be8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.758780 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.758671    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1979fb683e265419a7ecbcfd0f890be8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-201.ec2.internal\" (UID: \"1979fb683e265419a7ecbcfd0f890be8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.758780 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.758692    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/03a3666c340159a37456eb8a4ee4db64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal\" (UID: \"03a3666c340159a37456eb8a4ee4db64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.758780 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.758698    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03a3666c340159a37456eb8a4ee4db64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal\" (UID: \"03a3666c340159a37456eb8a4ee4db64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.807491 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.807381    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:27.908174 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:27.908133    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:27.959570 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.959533    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:27.966371 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:27.966350    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:28.008698 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:28.008660    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:28.112563 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:28.112470    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:28.215388 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:28.215348    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:28.298865 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.298830    2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 19:25:28.299420 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.299007    2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 19:25:28.316404 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:28.316370    2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-201.ec2.internal\" not found"
Jul 13 19:25:28.364797 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.364702    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 19:20:27 +0000 UTC" deadline="2028-04-10 07:09:19.087587684 +0000 UTC"
Jul 13 19:25:28.364797 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.364734    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15275h43m50.72285675s"
Jul 13 19:25:28.396461 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.396431    2550 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 19:25:28.409689 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.409657    2550 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 19:25:28.456828 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.456779    2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:28.469978 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.469954    2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 19:25:28.471200 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.471183    2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal"
Jul 13 19:25:28.478674 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.478654    2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 19:25:28.613416 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:28.613375    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a3666c340159a37456eb8a4ee4db64.slice/crio-dc66a772a168dd2fefe35d09ecdb339eda429a3f0236a0cbe5740f136e05f7a8 WatchSource:0}: Error finding container dc66a772a168dd2fefe35d09ecdb339eda429a3f0236a0cbe5740f136e05f7a8: Status 404 returned error can't find the container with id dc66a772a168dd2fefe35d09ecdb339eda429a3f0236a0cbe5740f136e05f7a8
Jul 13 19:25:28.616478 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:28.616414    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1979fb683e265419a7ecbcfd0f890be8.slice/crio-981deb7011e30e07f6068a2d7a5240b5980858c548ac60182e1b3157cdcb26a3 WatchSource:0}: Error finding container 981deb7011e30e07f6068a2d7a5240b5980858c548ac60182e1b3157cdcb26a3: Status 404 returned error can't find the container with id 981deb7011e30e07f6068a2d7a5240b5980858c548ac60182e1b3157cdcb26a3
Jul 13 19:25:28.621307 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.621081    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:25:28.719526 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:28.719484    2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 19:25:29.340583 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.340552    2550 apiserver.go:52] "Watching apiserver"
Jul 13 19:25:29.350791 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.350751    2550 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 19:25:29.351347 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.351317    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-bdszm","openshift-cluster-node-tuning-operator/tuned-ph99p","openshift-image-registry/node-ca-9wdt5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal","openshift-multus/multus-cf2jg","openshift-network-operator/iptables-alerter-w5hkz","openshift-ovn-kubernetes/ovnkube-node-lhqhc","kube-system/global-pull-secret-syncer-tpwr5","kube-system/konnectivity-agent-t4vkw","kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p","openshift-dns/node-resolver-5t7xt","openshift-multus/multus-additional-cni-plugins-5ndh6","openshift-multus/network-metrics-daemon-4lsrh"]
Jul 13 19:25:29.353200 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.353179    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:29.353339 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.353304    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:29.354382 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.354361    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.355980 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.355953    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.356474 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.356458    2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 19:25:29.357210 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.357102    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.357300 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.357219    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8xmwg\""
Jul 13 19:25:29.357541 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.357410    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 19:25:29.357780 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.357725    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 19:25:29.359207 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.359183    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hwpk8\""
Jul 13 19:25:29.363680 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.359976    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 19:25:29.363680 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.360137    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.363680 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.361776    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 19:25:29.363680 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.362252    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 19:25:29.363680 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.362472    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 19:25:29.363680 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.362703    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5mptp\""
Jul 13 19:25:29.363680 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.362954    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 19:25:29.363680 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.363037    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 19:25:29.363680 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.363218    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 19:25:29.364526 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.364500    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.365402 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.365382    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 19:25:29.365470 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.365433    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 19:25:29.365637 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.365616    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 19:25:29.365711 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.365686    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ckp9l\""
Jul 13 19:25:29.367014 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.366985    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:29.367014 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367010    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 19:25:29.367164 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.367063    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:29.367164 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367138    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-cnibin\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367273 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367185    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-daemon-config\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367273 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367215    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-run\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.367273 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367258    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-tuned\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.367429 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367286    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t4gm\" (UniqueName: \"kubernetes.io/projected/e9146574-0c5d-4830-9bfe-80972c84aa3c-kube-api-access-8t4gm\") pod \"node-ca-9wdt5\" (UID: \"e9146574-0c5d-4830-9bfe-80972c84aa3c\") " pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.367429 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367313    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-systemd\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.367429 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367354    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-modprobe-d\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.367429 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367373    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zc5c\" (UniqueName: \"kubernetes.io/projected/ab3fc703-f07d-4028-bb65-3f88fcee9a95-kube-api-access-6zc5c\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367429 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367405    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-host\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.367429 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367429    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-cni-dir\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367451    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-os-release\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367492    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab3fc703-f07d-4028-bb65-3f88fcee9a95-cni-binary-copy\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367531    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-run-k8s-cni-cncf-io\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367581    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367596    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367579    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-var-lib-cni-bin\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367642    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prbtx\" (UniqueName: \"kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx\") pod \"network-check-target-bdszm\" (UID: \"647488c6-f12a-49f0-9523-c2bec7706fdd\") " pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367666    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-sysctl-d\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367690    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9146574-0c5d-4830-9bfe-80972c84aa3c-serviceca\") pod \"node-ca-9wdt5\" (UID: \"e9146574-0c5d-4830-9bfe-80972c84aa3c\") " pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367711    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-system-cni-dir\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367732    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-socket-dir-parent\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367755    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-sysctl-conf\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367778    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-var-lib-kubelet\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.367808 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367799    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-var-lib-cni-multus\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367893    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-etc-kubernetes\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367919    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-sysconfig\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.367994    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-kubernetes\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368024    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-sys\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368051    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-lib-modules\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368075    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9146574-0c5d-4830-9bfe-80972c84aa3c-host\") pod \"node-ca-9wdt5\" (UID: \"e9146574-0c5d-4830-9bfe-80972c84aa3c\") " pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368100    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-run-netns\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368122    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46dd50b0-0455-4a03-9dda-4e34fddb93ac-tmp\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368144    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-hostroot\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368168    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-conf-dir\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368217    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-run-multus-certs\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368258    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-var-lib-kubelet\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.368534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368287    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgxpb\" (UniqueName: \"kubernetes.io/projected/46dd50b0-0455-4a03-9dda-4e34fddb93ac-kube-api-access-lgxpb\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.369182 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368760    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 19:25:29.369182 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368775    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 19:25:29.369182 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.368998    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:29.369182 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.369061    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9g4cz\""
Jul 13 19:25:29.369379 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.369011    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 19:25:29.370539 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.370525    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.372650 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.372611    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.372744 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.372681    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 19:25:29.372744 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.372726    2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 19:25:29.373212 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.372940    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-67wxc\""
Jul 13 19:25:29.373212 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.373086    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 19:25:29.373212 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.373088    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 19:25:29.373212 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.373181    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 19:25:29.373529 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.373232    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 19:25:29.374460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.373995    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.374750 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.374665    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-f8nv8\""
Jul 13 19:25:29.375304 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.375284    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 19:25:29.375399 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.375334    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:29.375462 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.375398    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:29.375462 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.375446    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ldd2f\""
Jul 13 19:25:29.376786 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.376068    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 19:25:29.377140 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.377117    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 19:25:29.377322 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.377304    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 19:25:29.377401 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.377346    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vntvl\""
Jul 13 19:25:29.398550 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.398504    2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vtszr"
Jul 13 19:25:29.407724 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.407702    2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vtszr"
Jul 13 19:25:29.458852 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.458817    2550 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468538    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-run-netns\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468582    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468616    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-cni-dir\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468643    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-os-release\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468669    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab3fc703-f07d-4028-bb65-3f88fcee9a95-cni-binary-copy\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468696    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbtx\" (UniqueName: \"kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx\") pod \"network-check-target-bdszm\" (UID: \"647488c6-f12a-49f0-9523-c2bec7706fdd\") " pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468720    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-sysctl-d\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468744    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-node-log\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468767    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468775    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-cni-dir\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468793    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468797    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-os-release\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468821    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-system-cni-dir\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.468956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468896    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-system-cni-dir\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.468987    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-sysctl-d\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469026    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-socket-dir-parent\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469052    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-socket-dir-parent\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469060    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9893cb72-e627-47a8-9ae6-7d1e5d2ebc72-iptables-alerter-script\") pod \"iptables-alerter-w5hkz\" (UID: \"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72\") " pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469090    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-run-openvswitch\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469117    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t482c\" (UniqueName: \"kubernetes.io/projected/e06de7bc-83db-43e5-9ac2-aea07b78ca90-kube-api-access-t482c\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469143    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d62f8808-e36a-481e-957c-197de3e85cf9-konnectivity-ca\") pod \"konnectivity-agent-t4vkw\" (UID: \"d62f8808-e36a-481e-957c-197de3e85cf9\") " pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469169    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5971a943-83fc-4fc6-8e13-02231e431039-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469197    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-var-lib-kubelet\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469222    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-var-lib-cni-multus\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469247    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-sysconfig\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469257    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-var-lib-kubelet\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469271    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-kubernetes\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469285    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-var-lib-cni-multus\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469306    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-run-systemd\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469320    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-kubernetes\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.469778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469337    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5971a943-83fc-4fc6-8e13-02231e431039-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469353    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-sysconfig\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469366    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46dd50b0-0455-4a03-9dda-4e34fddb93ac-tmp\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469396    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-systemd-units\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469403    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab3fc703-f07d-4028-bb65-3f88fcee9a95-cni-binary-copy\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469419    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-slash\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469448    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f004726-0178-4641-a8bc-435b7858296d-kubelet-config\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469477    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-conf-dir\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469500    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgxpb\" (UniqueName: \"kubernetes.io/projected/46dd50b0-0455-4a03-9dda-4e34fddb93ac-kube-api-access-lgxpb\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469525    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-cni-bin\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469548    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469552    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-conf-dir\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469572    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469598    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-cnibin\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469638    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-daemon-config\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469733    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-cnibin\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469712    2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.469771    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-tuned\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.470681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470006    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-cni-netd\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470035    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa-tmp-dir\") pod \"node-resolver-5t7xt\" (UID: \"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa\") " pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470063    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-systemd\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470123    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-modprobe-d\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470144    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-systemd\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470156    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-kubelet\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470183    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab3fc703-f07d-4028-bb65-3f88fcee9a95-multus-daemon-config\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470184    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvhjb\" (UniqueName: \"kubernetes.io/projected/1a004020-e409-46a4-8bab-8e560b477812-kube-api-access-rvhjb\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470237    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9893cb72-e627-47a8-9ae6-7d1e5d2ebc72-host-slash\") pod \"iptables-alerter-w5hkz\" (UID: \"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72\") " pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470255    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-modprobe-d\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470264    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f004726-0178-4641-a8bc-435b7858296d-dbus\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470292    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-sys-fs\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470318    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5971a943-83fc-4fc6-8e13-02231e431039-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470357    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-run-k8s-cni-cncf-io\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470388    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-var-lib-cni-bin\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470409    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9146574-0c5d-4830-9bfe-80972c84aa3c-serviceca\") pod \"node-ca-9wdt5\" (UID: \"e9146574-0c5d-4830-9bfe-80972c84aa3c\") " pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470441    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e06de7bc-83db-43e5-9ac2-aea07b78ca90-ovnkube-script-lib\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.471589 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470464    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-device-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470463    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-var-lib-cni-bin\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470487    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4gjh\" (UniqueName: \"kubernetes.io/projected/41a0c782-9353-43b1-83ad-df689ac23bf7-kube-api-access-z4gjh\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470510    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-system-cni-dir\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470555    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-cnibin\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470577    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-sysctl-conf\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470599    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-var-lib-openvswitch\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470621    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e06de7bc-83db-43e5-9ac2-aea07b78ca90-env-overrides\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470642    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa-hosts-file\") pod \"node-resolver-5t7xt\" (UID: \"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa\") " pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470662    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-etc-kubernetes\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470683    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-sys\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470705    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-lib-modules\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470731    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9146574-0c5d-4830-9bfe-80972c84aa3c-host\") pod \"node-ca-9wdt5\" (UID: \"e9146574-0c5d-4830-9bfe-80972c84aa3c\") " pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470758    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s7bd\" (UniqueName: \"kubernetes.io/projected/e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa-kube-api-access-4s7bd\") pod \"node-resolver-5t7xt\" (UID: \"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa\") " pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470784    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-run-netns\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470809    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nft4v\" (UniqueName: \"kubernetes.io/projected/9893cb72-e627-47a8-9ae6-7d1e5d2ebc72-kube-api-access-nft4v\") pod \"iptables-alerter-w5hkz\" (UID: \"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72\") " pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470836    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-log-socket\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.472460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470893    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e06de7bc-83db-43e5-9ac2-aea07b78ca90-ovn-node-metrics-cert\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470920    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-os-release\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470946    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-hostroot\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470975    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e9146574-0c5d-4830-9bfe-80972c84aa3c-serviceca\") pod \"node-ca-9wdt5\" (UID: \"e9146574-0c5d-4830-9bfe-80972c84aa3c\") " pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.470977    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-run-multus-certs\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471027    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-run-multus-certs\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471031    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-var-lib-kubelet\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471067    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-etc-openvswitch\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471080    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-var-lib-kubelet\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471097    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471128    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d62f8808-e36a-481e-957c-197de3e85cf9-agent-certs\") pod \"konnectivity-agent-t4vkw\" (UID: \"d62f8808-e36a-481e-957c-197de3e85cf9\") " pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471135    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-sys\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471165    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n22qt\" (UniqueName: \"kubernetes.io/projected/5971a943-83fc-4fc6-8e13-02231e431039-kube-api-access-n22qt\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471194    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-run\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471220    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t4gm\" (UniqueName: \"kubernetes.io/projected/e9146574-0c5d-4830-9bfe-80972c84aa3c-kube-api-access-8t4gm\") pod \"node-ca-9wdt5\" (UID: \"e9146574-0c5d-4830-9bfe-80972c84aa3c\") " pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471248    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-run-ovn\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471254    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-lib-modules\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.473336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471273    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e06de7bc-83db-43e5-9ac2-aea07b78ca90-ovnkube-config\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471299    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471304    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9146574-0c5d-4830-9bfe-80972c84aa3c-host\") pod \"node-ca-9wdt5\" (UID: \"e9146574-0c5d-4830-9bfe-80972c84aa3c\") " pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471326    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-socket-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471353    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-registration-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471362    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-run-netns\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471381    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zc5c\" (UniqueName: \"kubernetes.io/projected/ab3fc703-f07d-4028-bb65-3f88fcee9a95-kube-api-access-6zc5c\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471408    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-host\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471447    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-hostroot\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471497    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-host\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471654    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-sysctl-conf\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471783    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-etc-kubernetes\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471853    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46dd50b0-0455-4a03-9dda-4e34fddb93ac-run\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.471943    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab3fc703-f07d-4028-bb65-3f88fcee9a95-host-run-k8s-cni-cncf-io\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.474138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.473775    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46dd50b0-0455-4a03-9dda-4e34fddb93ac-etc-tuned\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.474947 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.474410    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46dd50b0-0455-4a03-9dda-4e34fddb93ac-tmp\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.489702 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.489671    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t4gm\" (UniqueName: \"kubernetes.io/projected/e9146574-0c5d-4830-9bfe-80972c84aa3c-kube-api-access-8t4gm\") pod \"node-ca-9wdt5\" (UID: \"e9146574-0c5d-4830-9bfe-80972c84aa3c\") " pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.490619 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.490560    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 19:25:29.490619 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.490593    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 19:25:29.490619 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.490607    2550 projected.go:196] Error preparing data for projected volume kube-api-access-prbtx for pod openshift-network-diagnostics/network-check-target-bdszm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:29.490851 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.490697    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx podName:647488c6-f12a-49f0-9523-c2bec7706fdd nodeName:}" failed. No retries permitted until 2026-07-13 19:25:29.990660593 +0000 UTC m=+2.991151132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-prbtx" (UniqueName: "kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx") pod "network-check-target-bdszm" (UID: "647488c6-f12a-49f0-9523-c2bec7706fdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:29.494337 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.494287    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zc5c\" (UniqueName: \"kubernetes.io/projected/ab3fc703-f07d-4028-bb65-3f88fcee9a95-kube-api-access-6zc5c\") pod \"multus-cf2jg\" (UID: \"ab3fc703-f07d-4028-bb65-3f88fcee9a95\") " pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.496474 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.496232    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgxpb\" (UniqueName: \"kubernetes.io/projected/46dd50b0-0455-4a03-9dda-4e34fddb93ac-kube-api-access-lgxpb\") pod \"tuned-ph99p\" (UID: \"46dd50b0-0455-4a03-9dda-4e34fddb93ac\") " pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.496474 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.496342    2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 19:25:29.547363 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.547295    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal" event={"ID":"1979fb683e265419a7ecbcfd0f890be8","Type":"ContainerStarted","Data":"981deb7011e30e07f6068a2d7a5240b5980858c548ac60182e1b3157cdcb26a3"}
Jul 13 19:25:29.549349 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.549311    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal" event={"ID":"03a3666c340159a37456eb8a4ee4db64","Type":"ContainerStarted","Data":"dc66a772a168dd2fefe35d09ecdb339eda429a3f0236a0cbe5740f136e05f7a8"}
Jul 13 19:25:29.571870 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.571835    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-etc-openvswitch\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.572037 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.571886    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.572037 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.571945    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d62f8808-e36a-481e-957c-197de3e85cf9-agent-certs\") pod \"konnectivity-agent-t4vkw\" (UID: \"d62f8808-e36a-481e-957c-197de3e85cf9\") " pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:29.572037 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.571958    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.572037 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.571988    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n22qt\" (UniqueName: \"kubernetes.io/projected/5971a943-83fc-4fc6-8e13-02231e431039-kube-api-access-n22qt\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.572037 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572012    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-etc-openvswitch\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.572037 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572019    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-run-ovn\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572049    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e06de7bc-83db-43e5-9ac2-aea07b78ca90-ovnkube-config\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572077    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572104    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-socket-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572129    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-registration-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572157    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-run-netns\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572183    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572227    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-node-log\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572254    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572281    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572313    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9893cb72-e627-47a8-9ae6-7d1e5d2ebc72-iptables-alerter-script\") pod \"iptables-alerter-w5hkz\" (UID: \"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72\") " pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572339    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-run-openvswitch\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.572378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572364    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t482c\" (UniqueName: \"kubernetes.io/projected/e06de7bc-83db-43e5-9ac2-aea07b78ca90-kube-api-access-t482c\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572388    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d62f8808-e36a-481e-957c-197de3e85cf9-konnectivity-ca\") pod \"konnectivity-agent-t4vkw\" (UID: \"d62f8808-e36a-481e-957c-197de3e85cf9\") " pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572414    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5971a943-83fc-4fc6-8e13-02231e431039-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572443    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-run-systemd\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572469    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5971a943-83fc-4fc6-8e13-02231e431039-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572498    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-systemd-units\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572522    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-slash\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572547    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f004726-0178-4641-a8bc-435b7858296d-kubelet-config\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572574    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-cni-bin\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572599    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572622    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572660    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-cni-netd\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572682    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa-tmp-dir\") pod \"node-resolver-5t7xt\" (UID: \"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa\") " pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572712    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-kubelet\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572738    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvhjb\" (UniqueName: \"kubernetes.io/projected/1a004020-e409-46a4-8bab-8e560b477812-kube-api-access-rvhjb\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572767    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9893cb72-e627-47a8-9ae6-7d1e5d2ebc72-host-slash\") pod \"iptables-alerter-w5hkz\" (UID: \"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72\") " pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572790    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f004726-0178-4641-a8bc-435b7858296d-dbus\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:29.573000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572814    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-sys-fs\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572839    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5971a943-83fc-4fc6-8e13-02231e431039-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572873    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e06de7bc-83db-43e5-9ac2-aea07b78ca90-ovnkube-script-lib\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572921    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-device-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572947    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4gjh\" (UniqueName: \"kubernetes.io/projected/41a0c782-9353-43b1-83ad-df689ac23bf7-kube-api-access-z4gjh\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.572972    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-system-cni-dir\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573003    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-cnibin\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573032    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-var-lib-openvswitch\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.573040    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573058    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e06de7bc-83db-43e5-9ac2-aea07b78ca90-env-overrides\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573085    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa-hosts-file\") pod \"node-resolver-5t7xt\" (UID: \"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa\") " pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.573122    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs podName:1a004020-e409-46a4-8bab-8e560b477812 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:30.073100326 +0000 UTC m=+3.073590871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs") pod "network-metrics-daemon-4lsrh" (UID: "1a004020-e409-46a4-8bab-8e560b477812") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573156    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s7bd\" (UniqueName: \"kubernetes.io/projected/e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa-kube-api-access-4s7bd\") pod \"node-resolver-5t7xt\" (UID: \"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa\") " pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573186    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nft4v\" (UniqueName: \"kubernetes.io/projected/9893cb72-e627-47a8-9ae6-7d1e5d2ebc72-kube-api-access-nft4v\") pod \"iptables-alerter-w5hkz\" (UID: \"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72\") " pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573214    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-log-socket\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573246    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e06de7bc-83db-43e5-9ac2-aea07b78ca90-ovn-node-metrics-cert\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.573751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573271    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-os-release\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573386    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-os-release\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573438    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-run-ovn\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.573454    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:29.573496    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret podName:1f004726-0178-4641-a8bc-435b7858296d nodeName:}" failed. No retries permitted until 2026-07-13 19:25:30.073482646 +0000 UTC m=+3.073973186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret") pod "global-pull-secret-syncer-tpwr5" (UID: "1f004726-0178-4641-a8bc-435b7858296d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573513    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5971a943-83fc-4fc6-8e13-02231e431039-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573573    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-node-log\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573595    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-socket-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573620    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573637    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-registration-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573666    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-run-netns\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573675    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573769    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1f004726-0178-4641-a8bc-435b7858296d-dbus\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.573798    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-run-systemd\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574002    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e06de7bc-83db-43e5-9ac2-aea07b78ca90-ovnkube-config\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574075    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-sys-fs\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574162    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5971a943-83fc-4fc6-8e13-02231e431039-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.574309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574203    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-systemd-units\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574246    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-slash\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574267    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9893cb72-e627-47a8-9ae6-7d1e5d2ebc72-iptables-alerter-script\") pod \"iptables-alerter-w5hkz\" (UID: \"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72\") " pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574297    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1f004726-0178-4641-a8bc-435b7858296d-kubelet-config\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574327    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-run-openvswitch\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574359    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-device-dir\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574393    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-system-cni-dir\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574405    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-cni-bin\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574406    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41a0c782-9353-43b1-83ad-df689ac23bf7-etc-selinux\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574463    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-cnibin\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574501    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-kubelet\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574536    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5971a943-83fc-4fc6-8e13-02231e431039-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574539    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-host-cni-netd\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574585    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5971a943-83fc-4fc6-8e13-02231e431039-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574609    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa-hosts-file\") pod \"node-resolver-5t7xt\" (UID: \"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa\") " pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574646    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9893cb72-e627-47a8-9ae6-7d1e5d2ebc72-host-slash\") pod \"iptables-alerter-w5hkz\" (UID: \"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72\") " pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574658    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-log-socket\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.575161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574661    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e06de7bc-83db-43e5-9ac2-aea07b78ca90-var-lib-openvswitch\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.576110 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.574865    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d62f8808-e36a-481e-957c-197de3e85cf9-konnectivity-ca\") pod \"konnectivity-agent-t4vkw\" (UID: \"d62f8808-e36a-481e-957c-197de3e85cf9\") " pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:29.576110 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.575143    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e06de7bc-83db-43e5-9ac2-aea07b78ca90-env-overrides\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.576110 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.575236    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d62f8808-e36a-481e-957c-197de3e85cf9-agent-certs\") pod \"konnectivity-agent-t4vkw\" (UID: \"d62f8808-e36a-481e-957c-197de3e85cf9\") " pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:29.576110 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.575361    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e06de7bc-83db-43e5-9ac2-aea07b78ca90-ovnkube-script-lib\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.576311 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.576137    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa-tmp-dir\") pod \"node-resolver-5t7xt\" (UID: \"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa\") " pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.577580 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.577559    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e06de7bc-83db-43e5-9ac2-aea07b78ca90-ovn-node-metrics-cert\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.593186 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.593108    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nft4v\" (UniqueName: \"kubernetes.io/projected/9893cb72-e627-47a8-9ae6-7d1e5d2ebc72-kube-api-access-nft4v\") pod \"iptables-alerter-w5hkz\" (UID: \"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72\") " pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.593606 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.593530    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t482c\" (UniqueName: \"kubernetes.io/projected/e06de7bc-83db-43e5-9ac2-aea07b78ca90-kube-api-access-t482c\") pod \"ovnkube-node-lhqhc\" (UID: \"e06de7bc-83db-43e5-9ac2-aea07b78ca90\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.593900 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.593845    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n22qt\" (UniqueName: \"kubernetes.io/projected/5971a943-83fc-4fc6-8e13-02231e431039-kube-api-access-n22qt\") pod \"multus-additional-cni-plugins-5ndh6\" (UID: \"5971a943-83fc-4fc6-8e13-02231e431039\") " pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:29.597682 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.597436    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvhjb\" (UniqueName: \"kubernetes.io/projected/1a004020-e409-46a4-8bab-8e560b477812-kube-api-access-rvhjb\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:29.597682 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.597642    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s7bd\" (UniqueName: \"kubernetes.io/projected/e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa-kube-api-access-4s7bd\") pod \"node-resolver-5t7xt\" (UID: \"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa\") " pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.599791 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.599771    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4gjh\" (UniqueName: \"kubernetes.io/projected/41a0c782-9353-43b1-83ad-df689ac23bf7-kube-api-access-z4gjh\") pod \"aws-ebs-csi-driver-node-ph99p\" (UID: \"41a0c782-9353-43b1-83ad-df689ac23bf7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.669862 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.669831    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ph99p"
Jul 13 19:25:29.679909 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.679879    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9wdt5"
Jul 13 19:25:29.690734 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.690705    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cf2jg"
Jul 13 19:25:29.699678 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.699650    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w5hkz"
Jul 13 19:25:29.710261 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.710224    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:29.719102 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.719072    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:29.729146 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.729110    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p"
Jul 13 19:25:29.738033 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.738009    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5t7xt"
Jul 13 19:25:29.745230 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:29.745210    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5ndh6"
Jul 13 19:25:30.077835 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:30.077744    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:30.077835 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:30.077792    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:30.077835 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:30.077817    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbtx\" (UniqueName: \"kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx\") pod \"network-check-target-bdszm\" (UID: \"647488c6-f12a-49f0-9523-c2bec7706fdd\") " pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:30.078154 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:30.077901    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:30.078154 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:30.077944    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:30.078154 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:30.077963    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 19:25:30.078154 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:30.077979    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 19:25:30.078154 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:30.077982    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret podName:1f004726-0178-4641-a8bc-435b7858296d nodeName:}" failed. No retries permitted until 2026-07-13 19:25:31.07796264 +0000 UTC m=+4.078453182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret") pod "global-pull-secret-syncer-tpwr5" (UID: "1f004726-0178-4641-a8bc-435b7858296d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:30.078154 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:30.077988    2550 projected.go:196] Error preparing data for projected volume kube-api-access-prbtx for pod openshift-network-diagnostics/network-check-target-bdszm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:30.078154 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:30.078012    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs podName:1a004020-e409-46a4-8bab-8e560b477812 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:31.07799203 +0000 UTC m=+4.078482583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs") pod "network-metrics-daemon-4lsrh" (UID: "1a004020-e409-46a4-8bab-8e560b477812") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:30.078154 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:30.078036    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx podName:647488c6-f12a-49f0-9523-c2bec7706fdd nodeName:}" failed. No retries permitted until 2026-07-13 19:25:31.078020975 +0000 UTC m=+4.078511522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-prbtx" (UniqueName: "kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx") pod "network-check-target-bdszm" (UID: "647488c6-f12a-49f0-9523-c2bec7706fdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:30.411780 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:30.411713    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 19:20:29 +0000 UTC" deadline="2028-03-28 19:52:10.980860876 +0000 UTC"
Jul 13 19:25:30.411780 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:30.411771    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14976h26m40.569092992s"
Jul 13 19:25:30.538904 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:30.538868    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:30.539074 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:30.538979    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:30.691007 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:30.690972    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62f8808_e36a_481e_957c_197de3e85cf9.slice/crio-1701eaf7aa23bd95c11afb250d8bad7ed567cf4882a2ab3d0d01bf7c642f257b WatchSource:0}: Error finding container 1701eaf7aa23bd95c11afb250d8bad7ed567cf4882a2ab3d0d01bf7c642f257b: Status 404 returned error can't find the container with id 1701eaf7aa23bd95c11afb250d8bad7ed567cf4882a2ab3d0d01bf7c642f257b
Jul 13 19:25:30.694759 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:30.693772    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41a0c782_9353_43b1_83ad_df689ac23bf7.slice/crio-f4672604a18eea4f202ab03cd51c9458943c5571ee87e2a45d38075ac9899a6b WatchSource:0}: Error finding container f4672604a18eea4f202ab03cd51c9458943c5571ee87e2a45d38075ac9899a6b: Status 404 returned error can't find the container with id f4672604a18eea4f202ab03cd51c9458943c5571ee87e2a45d38075ac9899a6b
Jul 13 19:25:30.694759 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:30.694462    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e04b4b_28d6_4a1a_b2ad_6e9a136430aa.slice/crio-49fdad79e72534f63d79c70125b60b318364ad127edba5d309943484ea70d3fa WatchSource:0}: Error finding container 49fdad79e72534f63d79c70125b60b318364ad127edba5d309943484ea70d3fa: Status 404 returned error can't find the container with id 49fdad79e72534f63d79c70125b60b318364ad127edba5d309943484ea70d3fa
Jul 13 19:25:30.699716 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:30.699610    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode06de7bc_83db_43e5_9ac2_aea07b78ca90.slice/crio-ca2478395742d936a76323be85a4e123e6161fd12e833cf511d38247a241571e WatchSource:0}: Error finding container ca2478395742d936a76323be85a4e123e6161fd12e833cf511d38247a241571e: Status 404 returned error can't find the container with id ca2478395742d936a76323be85a4e123e6161fd12e833cf511d38247a241571e
Jul 13 19:25:30.701526 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:30.701492    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9893cb72_e627_47a8_9ae6_7d1e5d2ebc72.slice/crio-fb342da05f134427c55abc111bb8c24c1dbc01511c2e90cfbf00a021f52f1486 WatchSource:0}: Error finding container fb342da05f134427c55abc111bb8c24c1dbc01511c2e90cfbf00a021f52f1486: Status 404 returned error can't find the container with id fb342da05f134427c55abc111bb8c24c1dbc01511c2e90cfbf00a021f52f1486
Jul 13 19:25:30.704459 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:30.704436    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5971a943_83fc_4fc6_8e13_02231e431039.slice/crio-d8b0d0140aa47d4ff85f3d0385dc54a1e62a0917c5e345cf3ab598609b03f675 WatchSource:0}: Error finding container d8b0d0140aa47d4ff85f3d0385dc54a1e62a0917c5e345cf3ab598609b03f675: Status 404 returned error can't find the container with id d8b0d0140aa47d4ff85f3d0385dc54a1e62a0917c5e345cf3ab598609b03f675
Jul 13 19:25:30.709106 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:30.707982    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3fc703_f07d_4028_bb65_3f88fcee9a95.slice/crio-2d667bfd081da7eb3fd991df779f15db69dba40cd04a7c7c0a88bc5dd62730c2 WatchSource:0}: Error finding container 2d667bfd081da7eb3fd991df779f15db69dba40cd04a7c7c0a88bc5dd62730c2: Status 404 returned error can't find the container with id 2d667bfd081da7eb3fd991df779f15db69dba40cd04a7c7c0a88bc5dd62730c2
Jul 13 19:25:30.712380 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:25:30.712356    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9146574_0c5d_4830_9bfe_80972c84aa3c.slice/crio-630d714ad1fb18d667a1600e3688f8c53d917dee4aee85c714d129f72558f1b9 WatchSource:0}: Error finding container 630d714ad1fb18d667a1600e3688f8c53d917dee4aee85c714d129f72558f1b9: Status 404 returned error can't find the container with id 630d714ad1fb18d667a1600e3688f8c53d917dee4aee85c714d129f72558f1b9
Jul 13 19:25:31.087260 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.086966    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:31.087463 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.087304    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:31.087463 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:31.087121    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:31.087463 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.087340    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbtx\" (UniqueName: \"kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx\") pod \"network-check-target-bdszm\" (UID: \"647488c6-f12a-49f0-9523-c2bec7706fdd\") " pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:31.087463 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:31.087401    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret podName:1f004726-0178-4641-a8bc-435b7858296d nodeName:}" failed. No retries permitted until 2026-07-13 19:25:33.087383405 +0000 UTC m=+6.087873944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret") pod "global-pull-secret-syncer-tpwr5" (UID: "1f004726-0178-4641-a8bc-435b7858296d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:31.087463 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:31.087441    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:31.087718 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:31.087489    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 19:25:31.087718 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:31.087502    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs podName:1a004020-e409-46a4-8bab-8e560b477812 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:33.087488949 +0000 UTC m=+6.087979489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs") pod "network-metrics-daemon-4lsrh" (UID: "1a004020-e409-46a4-8bab-8e560b477812") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:31.087718 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:31.087506    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 19:25:31.087718 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:31.087516    2550 projected.go:196] Error preparing data for projected volume kube-api-access-prbtx for pod openshift-network-diagnostics/network-check-target-bdszm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:31.087718 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:31.087552    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx podName:647488c6-f12a-49f0-9523-c2bec7706fdd nodeName:}" failed. No retries permitted until 2026-07-13 19:25:33.087539176 +0000 UTC m=+6.088029715 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-prbtx" (UniqueName: "kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx") pod "network-check-target-bdszm" (UID: "647488c6-f12a-49f0-9523-c2bec7706fdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:31.413055 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.412952    2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 19:20:29 +0000 UTC" deadline="2028-04-03 21:34:52.220409098 +0000 UTC"
Jul 13 19:25:31.413055 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.412996    2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15122h9m20.807418506s"
Jul 13 19:25:31.540540 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.539985    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:31.540540 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:31.540128    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:31.541118 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.540928    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:31.541118 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:31.541062    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:31.556481 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.556436    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5t7xt" event={"ID":"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa","Type":"ContainerStarted","Data":"49fdad79e72534f63d79c70125b60b318364ad127edba5d309943484ea70d3fa"}
Jul 13 19:25:31.560006 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.559968    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4vkw" event={"ID":"d62f8808-e36a-481e-957c-197de3e85cf9","Type":"ContainerStarted","Data":"1701eaf7aa23bd95c11afb250d8bad7ed567cf4882a2ab3d0d01bf7c642f257b"}
Jul 13 19:25:31.566637 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.566590    2550 generic.go:356] "Generic (PLEG): container finished" podID="03a3666c340159a37456eb8a4ee4db64" containerID="2ec696aadcef408e55e88928418ac02974593dc6125616670d7059be9841b542" exitCode=0
Jul 13 19:25:31.566791 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.566722    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal" event={"ID":"03a3666c340159a37456eb8a4ee4db64","Type":"ContainerDied","Data":"2ec696aadcef408e55e88928418ac02974593dc6125616670d7059be9841b542"}
Jul 13 19:25:31.571349 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.571269    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cf2jg" event={"ID":"ab3fc703-f07d-4028-bb65-3f88fcee9a95","Type":"ContainerStarted","Data":"2d667bfd081da7eb3fd991df779f15db69dba40cd04a7c7c0a88bc5dd62730c2"}
Jul 13 19:25:31.576171 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.576142    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ndh6" event={"ID":"5971a943-83fc-4fc6-8e13-02231e431039","Type":"ContainerStarted","Data":"d8b0d0140aa47d4ff85f3d0385dc54a1e62a0917c5e345cf3ab598609b03f675"}
Jul 13 19:25:31.580058 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.580031    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc" event={"ID":"e06de7bc-83db-43e5-9ac2-aea07b78ca90","Type":"ContainerStarted","Data":"ca2478395742d936a76323be85a4e123e6161fd12e833cf511d38247a241571e"}
Jul 13 19:25:31.592083 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.592052    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p" event={"ID":"41a0c782-9353-43b1-83ad-df689ac23bf7","Type":"ContainerStarted","Data":"f4672604a18eea4f202ab03cd51c9458943c5571ee87e2a45d38075ac9899a6b"}
Jul 13 19:25:31.596687 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.596650    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal" event={"ID":"1979fb683e265419a7ecbcfd0f890be8","Type":"ContainerStarted","Data":"0d7f816a4e2158dcc0a93dd0194eedb2daa33272f50a4de21375bf1c34b5f842"}
Jul 13 19:25:31.607961 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.607918    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9wdt5" event={"ID":"e9146574-0c5d-4830-9bfe-80972c84aa3c","Type":"ContainerStarted","Data":"630d714ad1fb18d667a1600e3688f8c53d917dee4aee85c714d129f72558f1b9"}
Jul 13 19:25:31.610163 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.610131    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ph99p" event={"ID":"46dd50b0-0455-4a03-9dda-4e34fddb93ac","Type":"ContainerStarted","Data":"28d5b4c8d3a48579f6b42cb9a3e7e26b145335bce9d8af25d821e837a6d6fb85"}
Jul 13 19:25:31.614687 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.614624    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-201.ec2.internal" podStartSLOduration=3.614464186 podStartE2EDuration="3.614464186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:31.612090803 +0000 UTC m=+4.612581396" watchObservedRunningTime="2026-07-13 19:25:31.614464186 +0000 UTC m=+4.614954751"
Jul 13 19:25:31.624673 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:31.624640    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w5hkz" event={"ID":"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72","Type":"ContainerStarted","Data":"fb342da05f134427c55abc111bb8c24c1dbc01511c2e90cfbf00a021f52f1486"}
Jul 13 19:25:32.539797 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:32.539756    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:32.540308 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:32.539931    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:32.635665 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:32.635627    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal" event={"ID":"03a3666c340159a37456eb8a4ee4db64","Type":"ContainerStarted","Data":"f93d1e47f2ffa3901f0a763544ad37ad154e66cbac21886cc711298813197194"}
Jul 13 19:25:33.108239 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:33.108202    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:33.108239 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:33.108252    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:33.108526 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:33.108284    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbtx\" (UniqueName: \"kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx\") pod \"network-check-target-bdszm\" (UID: \"647488c6-f12a-49f0-9523-c2bec7706fdd\") " pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:33.108526 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:33.108447    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 19:25:33.108526 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:33.108469    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 19:25:33.108526 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:33.108482    2550 projected.go:196] Error preparing data for projected volume kube-api-access-prbtx for pod openshift-network-diagnostics/network-check-target-bdszm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:33.108746 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:33.108592    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx podName:647488c6-f12a-49f0-9523-c2bec7706fdd nodeName:}" failed. No retries permitted until 2026-07-13 19:25:37.108571791 +0000 UTC m=+10.109062333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-prbtx" (UniqueName: "kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx") pod "network-check-target-bdszm" (UID: "647488c6-f12a-49f0-9523-c2bec7706fdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:33.109094 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:33.109071    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:33.109194 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:33.109137    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret podName:1f004726-0178-4641-a8bc-435b7858296d nodeName:}" failed. No retries permitted until 2026-07-13 19:25:37.109119087 +0000 UTC m=+10.109609630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret") pod "global-pull-secret-syncer-tpwr5" (UID: "1f004726-0178-4641-a8bc-435b7858296d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:33.109262 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:33.109201    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:33.109321 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:33.109261    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs podName:1a004020-e409-46a4-8bab-8e560b477812 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:37.10922994 +0000 UTC m=+10.109720482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs") pod "network-metrics-daemon-4lsrh" (UID: "1a004020-e409-46a4-8bab-8e560b477812") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:33.542513 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:33.542429    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:33.543020 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:33.542576    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:33.543096 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:33.543059    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:33.543326 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:33.543171    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:34.539282 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:34.539246    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:34.539450 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:34.539391    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:35.538852 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:35.538818    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:35.539317 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:35.538963    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:35.539448 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:35.539428    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:35.539574 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:35.539549    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:36.539414 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:36.539378    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:36.539873 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:36.539550    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:37.143727 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:37.143679    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:37.143727 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:37.143731    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:37.143990 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:37.143754    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbtx\" (UniqueName: \"kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx\") pod \"network-check-target-bdszm\" (UID: \"647488c6-f12a-49f0-9523-c2bec7706fdd\") " pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:37.143990 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:37.143888    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 19:25:37.143990 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:37.143908    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 19:25:37.143990 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:37.143921    2550 projected.go:196] Error preparing data for projected volume kube-api-access-prbtx for pod openshift-network-diagnostics/network-check-target-bdszm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:37.143990 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:37.143967    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx podName:647488c6-f12a-49f0-9523-c2bec7706fdd nodeName:}" failed. No retries permitted until 2026-07-13 19:25:45.143954378 +0000 UTC m=+18.144444916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-prbtx" (UniqueName: "kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx") pod "network-check-target-bdszm" (UID: "647488c6-f12a-49f0-9523-c2bec7706fdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:37.144302 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:37.144286    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:37.144361 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:37.144336    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret podName:1f004726-0178-4641-a8bc-435b7858296d nodeName:}" failed. No retries permitted until 2026-07-13 19:25:45.144321842 +0000 UTC m=+18.144812385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret") pod "global-pull-secret-syncer-tpwr5" (UID: "1f004726-0178-4641-a8bc-435b7858296d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:37.144416 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:37.144379    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:37.144416 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:37.144407    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs podName:1a004020-e409-46a4-8bab-8e560b477812 nodeName:}" failed. No retries permitted until 2026-07-13 19:25:45.144395788 +0000 UTC m=+18.144886326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs") pod "network-metrics-daemon-4lsrh" (UID: "1a004020-e409-46a4-8bab-8e560b477812") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:37.539791 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:37.539705    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:37.540222 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:37.539792    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:37.540222 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:37.539795    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:37.540222 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:37.539938    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:38.538759 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:38.538722    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:38.538957 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:38.538874    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:39.538789 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:39.538759    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:39.539222 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:39.538767    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:39.539222 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:39.538919    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:39.539399 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:39.539370    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:40.538966 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:40.538923    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:40.539426 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:40.539056    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:41.539541 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:41.539495    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:41.540036 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:41.539546    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:41.540036 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:41.539637    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:41.540036 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:41.539775    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:42.539513 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:42.539481    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:42.539691 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:42.539597    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:43.539260 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:43.539224    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:43.539426 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:43.539342    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:43.539560 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:43.539533    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:43.539694 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:43.539647    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:44.539617 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:44.539579    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:44.539867 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:44.539717    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:45.209999 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:45.209953    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:45.209999 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:45.210005    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:45.210297 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:45.210024    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbtx\" (UniqueName: \"kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx\") pod \"network-check-target-bdszm\" (UID: \"647488c6-f12a-49f0-9523-c2bec7706fdd\") " pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:45.210297 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:45.210156    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 19:25:45.210297 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:45.210175    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 19:25:45.210297 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:45.210187    2550 projected.go:196] Error preparing data for projected volume kube-api-access-prbtx for pod openshift-network-diagnostics/network-check-target-bdszm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:45.210297 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:45.210232    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx podName:647488c6-f12a-49f0-9523-c2bec7706fdd nodeName:}" failed. No retries permitted until 2026-07-13 19:26:01.21021973 +0000 UTC m=+34.210710268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-prbtx" (UniqueName: "kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx") pod "network-check-target-bdszm" (UID: "647488c6-f12a-49f0-9523-c2bec7706fdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:25:45.210659 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:45.210639    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:45.210737 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:45.210689    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret podName:1f004726-0178-4641-a8bc-435b7858296d nodeName:}" failed. No retries permitted until 2026-07-13 19:26:01.210678237 +0000 UTC m=+34.211168775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret") pod "global-pull-secret-syncer-tpwr5" (UID: "1f004726-0178-4641-a8bc-435b7858296d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 19:25:45.210737 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:45.210730    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:45.210867 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:45.210751    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs podName:1a004020-e409-46a4-8bab-8e560b477812 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:01.210743864 +0000 UTC m=+34.211234403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs") pod "network-metrics-daemon-4lsrh" (UID: "1a004020-e409-46a4-8bab-8e560b477812") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:25:45.539596 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:45.539514    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:45.539770 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:45.539521    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:45.539770 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:45.539627    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:45.539770 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:45.539736    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:46.539422 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:46.539384    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:46.539619 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:46.539521    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:47.539667 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:47.539630    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:47.540104 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:47.539727    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:47.540164 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:47.540114    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:47.540282 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:47.540219    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:48.539438 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:48.539401    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:48.539617 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:48.539520    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:49.539522 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:49.539477    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:49.540005 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:49.539477    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:49.540005 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:49.539641    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:49.540005 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:49.539669    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:50.540055 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.539622    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:50.540697 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:50.540184    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:50.673263 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.673145    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p" event={"ID":"41a0c782-9353-43b1-83ad-df689ac23bf7","Type":"ContainerStarted","Data":"9e0513ef6a619d673d2e41a6b6d2427099b38f40ab1e2832473791eb86f84a3e"}
Jul 13 19:25:50.674661 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.674634    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9wdt5" event={"ID":"e9146574-0c5d-4830-9bfe-80972c84aa3c","Type":"ContainerStarted","Data":"80ddf8c78a4095b8595b9efed34179e864cf320fcf9c980a8c10158eadc21290"}
Jul 13 19:25:50.678928 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.678885    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ph99p" event={"ID":"46dd50b0-0455-4a03-9dda-4e34fddb93ac","Type":"ContainerStarted","Data":"1dc4c8893fd44a05b436bdeab4e0f3d2690345cad672b1f23945bfc468ec3419"}
Jul 13 19:25:50.680489 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.680461    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5t7xt" event={"ID":"e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa","Type":"ContainerStarted","Data":"d2826a72d6a0c01107a149d7bc5cc088e130775e94f949c9cabc3424c74e2955"}
Jul 13 19:25:50.681851 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.681827    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t4vkw" event={"ID":"d62f8808-e36a-481e-957c-197de3e85cf9","Type":"ContainerStarted","Data":"48cb89d5c6c8667c2ba3466df73bb8ac802fb9619cf796f53e077102d3b76240"}
Jul 13 19:25:50.683588 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.683558    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cf2jg" event={"ID":"ab3fc703-f07d-4028-bb65-3f88fcee9a95","Type":"ContainerStarted","Data":"88b8dd7f12b08ef69b58d2f5a87404d269c2056856be3f79c716525781c736e4"}
Jul 13 19:25:50.685199 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.685172    2550 generic.go:356] "Generic (PLEG): container finished" podID="5971a943-83fc-4fc6-8e13-02231e431039" containerID="1ad1e77da27cb1455ce4c1ade342a083c73e499627e9cc382f3a4f808df6321a" exitCode=0
Jul 13 19:25:50.685297 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.685217    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ndh6" event={"ID":"5971a943-83fc-4fc6-8e13-02231e431039","Type":"ContainerDied","Data":"1ad1e77da27cb1455ce4c1ade342a083c73e499627e9cc382f3a4f808df6321a"}
Jul 13 19:25:50.687718 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.687699    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc" event={"ID":"e06de7bc-83db-43e5-9ac2-aea07b78ca90","Type":"ContainerStarted","Data":"1dc937f0c76774efc63ad97f88910cd821f049d58c085d671ef0e435f44cbd8f"}
Jul 13 19:25:50.687826 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.687761    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc" event={"ID":"e06de7bc-83db-43e5-9ac2-aea07b78ca90","Type":"ContainerStarted","Data":"d9171a56e567561aee7c219b1bdfd0c4f7f14a6e7e7b4c716503be5d974ffa7d"}
Jul 13 19:25:50.687826 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.687791    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc" event={"ID":"e06de7bc-83db-43e5-9ac2-aea07b78ca90","Type":"ContainerStarted","Data":"5f306e3523a5ec5d3c44608a0a7492e9883fd1b4841dc6c33ed3c5978df5fabb"}
Jul 13 19:25:50.698005 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.697952    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-201.ec2.internal" podStartSLOduration=22.697938999 podStartE2EDuration="22.697938999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:32.659917041 +0000 UTC m=+5.660407606" watchObservedRunningTime="2026-07-13 19:25:50.697938999 +0000 UTC m=+23.698429559"
Jul 13 19:25:50.719434 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.719390    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5t7xt" podStartSLOduration=3.255566946 podStartE2EDuration="22.719375138s" totalImagesPullingTime="19.463808192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:50.719087169 +0000 UTC m=+23.719577730" watchObservedRunningTime="2026-07-13 19:25:50.719375138 +0000 UTC m=+23.719865698"
Jul 13 19:25:50.719650 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.719630    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9wdt5" podStartSLOduration=3.274085481 podStartE2EDuration="22.719624962s" totalImagesPullingTime="19.445539481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:50.698394594 +0000 UTC m=+23.698885154" watchObservedRunningTime="2026-07-13 19:25:50.719624962 +0000 UTC m=+23.720115541"
Jul 13 19:25:50.768350 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.768303    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ph99p" podStartSLOduration=3.322699276 podStartE2EDuration="22.768280971s" totalImagesPullingTime="19.445581695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:50.768088048 +0000 UTC m=+23.768578611" watchObservedRunningTime="2026-07-13 19:25:50.768280971 +0000 UTC m=+23.768771532"
Jul 13 19:25:50.795656 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.795609    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cf2jg" podStartSLOduration=3.281613623 podStartE2EDuration="22.795592091s" totalImagesPullingTime="19.513978468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:50.795362733 +0000 UTC m=+23.795853293" watchObservedRunningTime="2026-07-13 19:25:50.795592091 +0000 UTC m=+23.796082652"
Jul 13 19:25:50.813246 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:50.813194    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t4vkw" podStartSLOduration=3.348606667 podStartE2EDuration="22.81317786s" totalImagesPullingTime="19.464571193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:50.812976331 +0000 UTC m=+23.813466891" watchObservedRunningTime="2026-07-13 19:25:50.81317786 +0000 UTC m=+23.813668419"
Jul 13 19:25:51.538930 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:51.538902    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:51.539087 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:51.538910    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:51.539087 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:51.539016    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:51.539209 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:51.539180    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:51.670334 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:51.670293    2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 19:25:51.695039 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:51.694999    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc" event={"ID":"e06de7bc-83db-43e5-9ac2-aea07b78ca90","Type":"ContainerStarted","Data":"d7fc56954876fec7fbdfb6ab22acee2e467cac5076490b4856e1ee5eb34b2b87"}
Jul 13 19:25:51.695206 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:51.695091    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc" event={"ID":"e06de7bc-83db-43e5-9ac2-aea07b78ca90","Type":"ContainerStarted","Data":"1f44107e92d7f4757e252ee719bdd8a0b63930d1ae27066092da2698f394c81b"}
Jul 13 19:25:51.695206 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:51.695144    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc" event={"ID":"e06de7bc-83db-43e5-9ac2-aea07b78ca90","Type":"ContainerStarted","Data":"37c8c450000ebcac65c2093e9c821199da4329076086d00448bb737c3d46326b"}
Jul 13 19:25:51.697060 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:51.697033    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p" event={"ID":"41a0c782-9353-43b1-83ad-df689ac23bf7","Type":"ContainerStarted","Data":"06af72f03657c1d4f6a2a860ef8c1b1651293f42813295be5417450d506fe024"}
Jul 13 19:25:51.698574 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:51.698537    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w5hkz" event={"ID":"9893cb72-e627-47a8-9ae6-7d1e5d2ebc72","Type":"ContainerStarted","Data":"9e9383668a1b8f38ef3a342ba74bfc569d35c8fb7bf0b43e7784eff7fc4a9d0c"}
Jul 13 19:25:51.715742 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:51.715639    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w5hkz" podStartSLOduration=4.256765862 podStartE2EDuration="23.715592907s" totalImagesPullingTime="19.458827045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:51.715213602 +0000 UTC m=+24.715704164" watchObservedRunningTime="2026-07-13 19:25:51.715592907 +0000 UTC m=+24.716083471"
Jul 13 19:25:52.443487 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:52.443368    2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T19:25:51.670312327Z","UUID":"01952c8e-4d0c-48df-be7b-d5e193c53a2e","Handler":null,"Name":"","Endpoint":""}
Jul 13 19:25:52.444999 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:52.444977    2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 19:25:52.445115 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:52.445021    2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 19:25:52.539269 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:52.539236    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:52.539455 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:52.539368    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:53.303130 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:53.302865    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:53.303679 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:53.303655    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:53.542513 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:53.542483    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:53.542713 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:53.542518    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:53.542713 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:53.542659    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:53.542838 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:53.542779    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:53.707486 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:53.707400    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc" event={"ID":"e06de7bc-83db-43e5-9ac2-aea07b78ca90","Type":"ContainerStarted","Data":"9378c409eb9ecdf1dfc98f7a4ec35ee864932fb6caf9b4e79d315d7b53cc3778"}
Jul 13 19:25:53.709817 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:53.709766    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p" event={"ID":"41a0c782-9353-43b1-83ad-df689ac23bf7","Type":"ContainerStarted","Data":"c1e9e1b5aaa3e9a396aadd1e52e5a689551b62ae6d107b8f1c9309d969238de4"}
Jul 13 19:25:53.727684 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:53.727622    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ph99p" podStartSLOduration=3.985409727 podStartE2EDuration="25.727598447s" totalImagesPullingTime="21.74218872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:53.727538014 +0000 UTC m=+26.728028575" watchObservedRunningTime="2026-07-13 19:25:53.727598447 +0000 UTC m=+26.728089008"
Jul 13 19:25:54.538856 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:54.538824    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:54.539417 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:54.538951    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:55.539558 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:55.539520    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:55.540120 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:55.539674    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:55.540120 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:55.539725    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:55.540120 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:55.539855    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:56.539490 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:56.539301    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:56.539665 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:56.539557    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:56.719411 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:56.719371    2550 generic.go:356] "Generic (PLEG): container finished" podID="5971a943-83fc-4fc6-8e13-02231e431039" containerID="876da6fccf16503ba121969d05b722722b99192a777bfff946b92eb88115eaa3" exitCode=0
Jul 13 19:25:56.719585 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:56.719459    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ndh6" event={"ID":"5971a943-83fc-4fc6-8e13-02231e431039","Type":"ContainerDied","Data":"876da6fccf16503ba121969d05b722722b99192a777bfff946b92eb88115eaa3"}
Jul 13 19:25:56.723390 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:56.723365    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc" event={"ID":"e06de7bc-83db-43e5-9ac2-aea07b78ca90","Type":"ContainerStarted","Data":"5714e69c237a370acfdd69cfdc65cbc66170f7a960ff652b2b26a86c0745c750"}
Jul 13 19:25:56.723657 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:56.723634    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:56.723751 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:56.723709    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:56.723833 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:56.723757    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:56.740079 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:56.740052    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:56.740250 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:56.740187    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:25:56.770614 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:56.770562    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc" podStartSLOduration=9.234844273 podStartE2EDuration="28.770545878s" totalImagesPullingTime="19.535701605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:25:56.768506079 +0000 UTC m=+29.768996642" watchObservedRunningTime="2026-07-13 19:25:56.770545878 +0000 UTC m=+29.771036437"
Jul 13 19:25:57.540263 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:57.540228    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:57.540691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:57.540314    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:57.540691 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:57.540345    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:57.540691 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:57.540452    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:57.691601 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:57.691567    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdszm"]
Jul 13 19:25:57.691773 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:57.691693    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:57.691840 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:57.691774    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:57.694515 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:57.694486    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4lsrh"]
Jul 13 19:25:57.695081 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:57.695052    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tpwr5"]
Jul 13 19:25:57.725704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:57.725630    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:57.725704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:57.725642    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:57.725958 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:57.725735    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:25:57.726248 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:57.726211    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:58.077000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:58.076718    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:58.077182 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:58.077074    2550 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 13 19:25:58.077465 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:58.077444    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t4vkw"
Jul 13 19:25:58.730370 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:58.730335    2550 generic.go:356] "Generic (PLEG): container finished" podID="5971a943-83fc-4fc6-8e13-02231e431039" containerID="1dfbe9e929236e254ca7ad6e809d39ac581b17341cc9ae6c79be8286c801caeb" exitCode=0
Jul 13 19:25:58.730934 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:58.730421    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ndh6" event={"ID":"5971a943-83fc-4fc6-8e13-02231e431039","Type":"ContainerDied","Data":"1dfbe9e929236e254ca7ad6e809d39ac581b17341cc9ae6c79be8286c801caeb"}
Jul 13 19:25:59.542338 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:59.542308    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:25:59.542338 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:59.542342    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:25:59.542569 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:25:59.542313    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:25:59.542569 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:59.542408    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:25:59.542569 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:59.542492    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:25:59.542569 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:25:59.542555    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:26:00.737015 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:00.736978    2550 generic.go:356] "Generic (PLEG): container finished" podID="5971a943-83fc-4fc6-8e13-02231e431039" containerID="75df92af67109ccd70ad06f228f5849a14b10ae4bd679dfa7756156f16fe3590" exitCode=0
Jul 13 19:26:00.737655 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:00.737040    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ndh6" event={"ID":"5971a943-83fc-4fc6-8e13-02231e431039","Type":"ContainerDied","Data":"75df92af67109ccd70ad06f228f5849a14b10ae4bd679dfa7756156f16fe3590"}
Jul 13 19:26:01.235864 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:01.235827    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:26:01.235864 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:01.235870    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:26:01.236079 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:01.235888    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbtx\" (UniqueName: \"kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx\") pod \"network-check-target-bdszm\" (UID: \"647488c6-f12a-49f0-9523-c2bec7706fdd\") " pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:26:01.236079 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.235978    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:26:01.236079 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.236000    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 19:26:01.236079 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.236020    2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 19:26:01.236079 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.236031    2550 projected.go:196] Error preparing data for projected volume kube-api-access-prbtx for pod openshift-network-diagnostics/network-check-target-bdszm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:26:01.236079 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.236041    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs podName:1a004020-e409-46a4-8bab-8e560b477812 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:33.236026115 +0000 UTC m=+66.236516652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs") pod "network-metrics-daemon-4lsrh" (UID: "1a004020-e409-46a4-8bab-8e560b477812") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 19:26:01.236079 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.236066    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx podName:647488c6-f12a-49f0-9523-c2bec7706fdd nodeName:}" failed. No retries permitted until 2026-07-13 19:26:33.236054969 +0000 UTC m=+66.236545507 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-prbtx" (UniqueName: "kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx") pod "network-check-target-bdszm" (UID: "647488c6-f12a-49f0-9523-c2bec7706fdd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 19:26:01.236079 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.235977    2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 19:26:01.236316 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.236120    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret podName:1f004726-0178-4641-a8bc-435b7858296d nodeName:}" failed. No retries permitted until 2026-07-13 19:26:33.236105581 +0000 UTC m=+66.236596130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret") pod "global-pull-secret-syncer-tpwr5" (UID: "1f004726-0178-4641-a8bc-435b7858296d") : object "kube-system"/"original-pull-secret" not registered
Jul 13 19:26:01.539834 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:01.539784    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:26:01.540032 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:01.539784    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:26:01.540032 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.539931    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tpwr5" podUID="1f004726-0178-4641-a8bc-435b7858296d"
Jul 13 19:26:01.540148 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.540021    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bdszm" podUID="647488c6-f12a-49f0-9523-c2bec7706fdd"
Jul 13 19:26:01.540148 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:01.539785    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:26:01.540256 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:01.540155    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:26:02.850573 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.850544    2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-201.ec2.internal" event="NodeReady"
Jul 13 19:26:02.851089 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.850698    2550 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 19:26:02.885843 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.885789    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d687d458-vcxsw"]
Jul 13 19:26:02.887979 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.887943    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:02.890986 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.890961    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 19:26:02.891109 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.891041    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jwfmb\""
Jul 13 19:26:02.891109 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.891092    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 19:26:02.891378 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.891358    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 19:26:02.900852 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.900777    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 19:26:02.901007 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.900992    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-52dqm"]
Jul 13 19:26:02.903975 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.903218    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-x2m4m"]
Jul 13 19:26:02.903975 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.903318    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:02.905561 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.905527    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d687d458-vcxsw"]
Jul 13 19:26:02.905662 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.905622    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2m4m"
Jul 13 19:26:02.906434 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.906415    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nf5fn\""
Jul 13 19:26:02.906514 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.906466    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 19:26:02.906577 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.906417    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 19:26:02.908301 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.908279    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-52dqm"]
Jul 13 19:26:02.908625 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.908607    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 19:26:02.908708 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.908638    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 19:26:02.908907 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.908892    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9jjnz\""
Jul 13 19:26:02.909025 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.909009    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 19:26:02.912503 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:02.912479    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2m4m"]
Jul 13 19:26:03.047846 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.047794    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-image-registry-private-configuration\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.047846 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.047849    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05b8244-83b1-4ece-b238-212ece39fc9f-cert\") pod \"ingress-canary-x2m4m\" (UID: \"a05b8244-83b1-4ece-b238-212ece39fc9f\") " pod="openshift-ingress-canary/ingress-canary-x2m4m"
Jul 13 19:26:03.048057 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.047948    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-certificates\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.048057 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.047992    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r8mx\" (UniqueName: \"kubernetes.io/projected/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-kube-api-access-4r8mx\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.048057 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.048031    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-config-volume\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.048183 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.048060    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3ce4676-c643-4b40-adee-58a5ee96c3bf-ca-trust-extracted\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.048183 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.048090    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-installation-pull-secrets\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.048183 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.048117    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-bound-sa-token\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.048183 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.048157    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-tmp-dir\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.048183 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.048179    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.048369 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.048202    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-trusted-ca\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.048369 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.048231    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqrmr\" (UniqueName: \"kubernetes.io/projected/a05b8244-83b1-4ece-b238-212ece39fc9f-kube-api-access-fqrmr\") pod \"ingress-canary-x2m4m\" (UID: \"a05b8244-83b1-4ece-b238-212ece39fc9f\") " pod="openshift-ingress-canary/ingress-canary-x2m4m"
Jul 13 19:26:03.048369 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.048311    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.048369 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.048340    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96hcx\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-kube-api-access-96hcx\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.149133 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149088    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-image-registry-private-configuration\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.149133 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149132    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05b8244-83b1-4ece-b238-212ece39fc9f-cert\") pod \"ingress-canary-x2m4m\" (UID: \"a05b8244-83b1-4ece-b238-212ece39fc9f\") " pod="openshift-ingress-canary/ingress-canary-x2m4m"
Jul 13 19:26:03.149335 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149190    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-certificates\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.149335 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149218    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r8mx\" (UniqueName: \"kubernetes.io/projected/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-kube-api-access-4r8mx\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.149335 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149244    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-config-volume\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.149335 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149273    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3ce4676-c643-4b40-adee-58a5ee96c3bf-ca-trust-extracted\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.149335 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149297    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-installation-pull-secrets\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.149335 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149321    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-bound-sa-token\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.149588 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149357    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-tmp-dir\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.149588 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149382    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.149588 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149404    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-trusted-ca\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.149588 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149429    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqrmr\" (UniqueName: \"kubernetes.io/projected/a05b8244-83b1-4ece-b238-212ece39fc9f-kube-api-access-fqrmr\") pod \"ingress-canary-x2m4m\" (UID: \"a05b8244-83b1-4ece-b238-212ece39fc9f\") " pod="openshift-ingress-canary/ingress-canary-x2m4m"
Jul 13 19:26:03.149781 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149601    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.149781 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149637    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96hcx\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-kube-api-access-96hcx\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.149781 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:03.149765    2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 19:26:03.149781 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:03.149782    2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d687d458-vcxsw: secret "image-registry-tls" not found
Jul 13 19:26:03.149998 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149779    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-tmp-dir\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.149998 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.149831    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3ce4676-c643-4b40-adee-58a5ee96c3bf-ca-trust-extracted\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.149998 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:03.149867    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls podName:f3ce4676-c643-4b40-adee-58a5ee96c3bf nodeName:}" failed. No retries permitted until 2026-07-13 19:26:03.649847075 +0000 UTC m=+36.650337613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls") pod "image-registry-d687d458-vcxsw" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf") : secret "image-registry-tls" not found
Jul 13 19:26:03.149998 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:03.149917    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 19:26:03.149998 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:03.149968    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls podName:7768e8b8-d5bd-461a-8fbb-694332e9c6a5 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:03.649952709 +0000 UTC m=+36.650443264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls") pod "dns-default-52dqm" (UID: "7768e8b8-d5bd-461a-8fbb-694332e9c6a5") : secret "dns-default-metrics-tls" not found
Jul 13 19:26:03.150309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.150286    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-config-volume\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.150574 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.150556    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-certificates\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.150944 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.150890    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-trusted-ca\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.154699 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.154673    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-image-registry-private-configuration\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.154699 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.154692    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-installation-pull-secrets\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.154907 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.154836    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05b8244-83b1-4ece-b238-212ece39fc9f-cert\") pod \"ingress-canary-x2m4m\" (UID: \"a05b8244-83b1-4ece-b238-212ece39fc9f\") " pod="openshift-ingress-canary/ingress-canary-x2m4m"
Jul 13 19:26:03.161643 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.161573    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r8mx\" (UniqueName: \"kubernetes.io/projected/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-kube-api-access-4r8mx\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.161846 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.161778    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-bound-sa-token\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.161846 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.161831    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96hcx\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-kube-api-access-96hcx\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.162037 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.162019    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqrmr\" (UniqueName: \"kubernetes.io/projected/a05b8244-83b1-4ece-b238-212ece39fc9f-kube-api-access-fqrmr\") pod \"ingress-canary-x2m4m\" (UID: \"a05b8244-83b1-4ece-b238-212ece39fc9f\") " pod="openshift-ingress-canary/ingress-canary-x2m4m"
Jul 13 19:26:03.222938 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.222895    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-x2m4m"
Jul 13 19:26:03.377486 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.377227    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-x2m4m"]
Jul 13 19:26:03.539192 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.539153    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:26:03.539192 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.539170    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:26:03.539408 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.539153    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:26:03.543293 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.543254    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n645d\""
Jul 13 19:26:03.543441 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.543312    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 19:26:03.543441 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.543259    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 19:26:03.543441 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.543331    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 19:26:03.543441 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.543312    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dzrsk\""
Jul 13 19:26:03.543441 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.543254    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 19:26:03.653123 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.653086    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:03.653311 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:03.653150    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:03.653311 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:03.653202    2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 19:26:03.653311 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:03.653226    2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d687d458-vcxsw: secret "image-registry-tls" not found
Jul 13 19:26:03.653311 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:03.653313    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls podName:f3ce4676-c643-4b40-adee-58a5ee96c3bf nodeName:}" failed. No retries permitted until 2026-07-13 19:26:04.653292758 +0000 UTC m=+37.653783296 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls") pod "image-registry-d687d458-vcxsw" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf") : secret "image-registry-tls" not found
Jul 13 19:26:03.653490 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:03.653316    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 19:26:03.653490 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:03.653367    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls podName:7768e8b8-d5bd-461a-8fbb-694332e9c6a5 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:04.653351421 +0000 UTC m=+37.653841958 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls") pod "dns-default-52dqm" (UID: "7768e8b8-d5bd-461a-8fbb-694332e9c6a5") : secret "dns-default-metrics-tls" not found
Jul 13 19:26:04.662775 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:04.662736    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:04.663197 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:04.662785    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:04.663197 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:04.662924    2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 19:26:04.663197 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:04.662950    2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d687d458-vcxsw: secret "image-registry-tls" not found
Jul 13 19:26:04.663197 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:04.663011    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls podName:f3ce4676-c643-4b40-adee-58a5ee96c3bf nodeName:}" failed. No retries permitted until 2026-07-13 19:26:06.662994776 +0000 UTC m=+39.663485314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls") pod "image-registry-d687d458-vcxsw" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf") : secret "image-registry-tls" not found
Jul 13 19:26:04.663197 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:04.663018    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 19:26:04.663197 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:04.663085    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls podName:7768e8b8-d5bd-461a-8fbb-694332e9c6a5 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:06.663066619 +0000 UTC m=+39.663557163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls") pod "dns-default-52dqm" (UID: "7768e8b8-d5bd-461a-8fbb-694332e9c6a5") : secret "dns-default-metrics-tls" not found
Jul 13 19:26:04.824320 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:26:04.824285    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05b8244_83b1_4ece_b238_212ece39fc9f.slice/crio-80aeb85d966b62a79aa66f24a7bb637696a36d8ea072b1bf7b58680f88ee72e1 WatchSource:0}: Error finding container 80aeb85d966b62a79aa66f24a7bb637696a36d8ea072b1bf7b58680f88ee72e1: Status 404 returned error can't find the container with id 80aeb85d966b62a79aa66f24a7bb637696a36d8ea072b1bf7b58680f88ee72e1
Jul 13 19:26:05.754880 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:05.754781    2550 generic.go:356] "Generic (PLEG): container finished" podID="5971a943-83fc-4fc6-8e13-02231e431039" containerID="8b5baa50371574ec9004385d75e460440b9bd7c1da58d57b9067c8301bd7ac58" exitCode=0
Jul 13 19:26:05.755222 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:05.754889    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ndh6" event={"ID":"5971a943-83fc-4fc6-8e13-02231e431039","Type":"ContainerDied","Data":"8b5baa50371574ec9004385d75e460440b9bd7c1da58d57b9067c8301bd7ac58"}
Jul 13 19:26:05.756412 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:05.756378    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2m4m" event={"ID":"a05b8244-83b1-4ece-b238-212ece39fc9f","Type":"ContainerStarted","Data":"80aeb85d966b62a79aa66f24a7bb637696a36d8ea072b1bf7b58680f88ee72e1"}
Jul 13 19:26:06.681331 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:06.681278    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:06.681331 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:06.681340    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:06.681566 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:06.681437    2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 19:26:06.681566 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:06.681459    2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d687d458-vcxsw: secret "image-registry-tls" not found
Jul 13 19:26:06.681566 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:06.681496    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 19:26:06.681566 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:06.681513    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls podName:f3ce4676-c643-4b40-adee-58a5ee96c3bf nodeName:}" failed. No retries permitted until 2026-07-13 19:26:10.681498929 +0000 UTC m=+43.681989467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls") pod "image-registry-d687d458-vcxsw" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf") : secret "image-registry-tls" not found
Jul 13 19:26:06.681566 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:06.681544    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls podName:7768e8b8-d5bd-461a-8fbb-694332e9c6a5 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:10.681532362 +0000 UTC m=+43.682022900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls") pod "dns-default-52dqm" (UID: "7768e8b8-d5bd-461a-8fbb-694332e9c6a5") : secret "dns-default-metrics-tls" not found
Jul 13 19:26:06.762420 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:06.762346    2550 generic.go:356] "Generic (PLEG): container finished" podID="5971a943-83fc-4fc6-8e13-02231e431039" containerID="209ee1104ecc67587fb1970fbda2dc0a9b3eab3d4c137a8067cfd492d20a9a27" exitCode=0
Jul 13 19:26:06.762420 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:06.762396    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ndh6" event={"ID":"5971a943-83fc-4fc6-8e13-02231e431039","Type":"ContainerDied","Data":"209ee1104ecc67587fb1970fbda2dc0a9b3eab3d4c137a8067cfd492d20a9a27"}
Jul 13 19:26:07.768867 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:07.768680    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ndh6" event={"ID":"5971a943-83fc-4fc6-8e13-02231e431039","Type":"ContainerStarted","Data":"873900bb36e78f77f5df690a98bd31111b132be5274a9cf626717a1f08724f02"}
Jul 13 19:26:07.796404 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:07.796352    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5ndh6" podStartSLOduration=8.892453034999999 podStartE2EDuration="39.796338143s" totalImagesPullingTime="30.903885108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:07.795948849 +0000 UTC m=+40.796439409" watchObservedRunningTime="2026-07-13 19:26:07.796338143 +0000 UTC m=+40.796828702"
Jul 13 19:26:08.772495 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:08.772454    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-x2m4m" event={"ID":"a05b8244-83b1-4ece-b238-212ece39fc9f","Type":"ContainerStarted","Data":"5a5ee2951b4c1a0ada99c3d44054d85aba1a1ba7fb416e4c794f79bf8472e5d4"}
Jul 13 19:26:08.791641 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:08.791588    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-x2m4m" podStartSLOduration=3.68959622 podStartE2EDuration="6.791570997s" totalImagesPullingTime="3.101974777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:08.790267984 +0000 UTC m=+41.790758556" watchObservedRunningTime="2026-07-13 19:26:08.791570997 +0000 UTC m=+41.792061557"
Jul 13 19:26:10.710271 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:10.710234    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:10.710630 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:10.710280    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:10.710630 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:10.710408    2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 19:26:10.710630 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:10.710435    2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d687d458-vcxsw: secret "image-registry-tls" not found
Jul 13 19:26:10.710630 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:10.710489    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls podName:f3ce4676-c643-4b40-adee-58a5ee96c3bf nodeName:}" failed. No retries permitted until 2026-07-13 19:26:18.710473809 +0000 UTC m=+51.710964350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls") pod "image-registry-d687d458-vcxsw" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf") : secret "image-registry-tls" not found
Jul 13 19:26:10.710630 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:10.710414    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 19:26:10.710630 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:10.710551    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls podName:7768e8b8-d5bd-461a-8fbb-694332e9c6a5 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:18.710540632 +0000 UTC m=+51.711031171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls") pod "dns-default-52dqm" (UID: "7768e8b8-d5bd-461a-8fbb-694332e9c6a5") : secret "dns-default-metrics-tls" not found
Jul 13 19:26:18.767329 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:18.767286    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:18.767777 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:18.767379    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:18.767777 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:18.767447    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 19:26:18.767777 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:18.767456    2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 19:26:18.767777 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:18.767469    2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d687d458-vcxsw: secret "image-registry-tls" not found
Jul 13 19:26:18.767777 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:18.767512    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls podName:7768e8b8-d5bd-461a-8fbb-694332e9c6a5 nodeName:}" failed. No retries permitted until 2026-07-13 19:26:34.767495419 +0000 UTC m=+67.767985956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls") pod "dns-default-52dqm" (UID: "7768e8b8-d5bd-461a-8fbb-694332e9c6a5") : secret "dns-default-metrics-tls" not found
Jul 13 19:26:18.767777 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:18.767526    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls podName:f3ce4676-c643-4b40-adee-58a5ee96c3bf nodeName:}" failed. No retries permitted until 2026-07-13 19:26:34.76751971 +0000 UTC m=+67.768010248 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls") pod "image-registry-d687d458-vcxsw" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf") : secret "image-registry-tls" not found
Jul 13 19:26:28.741247 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:28.741218    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhqhc"
Jul 13 19:26:33.275773 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.275709    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:26:33.275773 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.275780    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:26:33.276334 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.275829    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbtx\" (UniqueName: \"kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx\") pod \"network-check-target-bdszm\" (UID: \"647488c6-f12a-49f0-9523-c2bec7706fdd\") " pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:26:33.279195 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.279172    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 19:26:33.279316 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.279194    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 19:26:33.279316 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.279257    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 19:26:33.286584 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:33.286556    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 19:26:33.286668 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:33.286654    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs podName:1a004020-e409-46a4-8bab-8e560b477812 nodeName:}" failed. No retries permitted until 2026-07-13 19:27:37.286630901 +0000 UTC m=+130.287121440 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs") pod "network-metrics-daemon-4lsrh" (UID: "1a004020-e409-46a4-8bab-8e560b477812") : secret "metrics-daemon-secret" not found
Jul 13 19:26:33.289060 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.289039    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 19:26:33.290674 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.290653    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1f004726-0178-4641-a8bc-435b7858296d-original-pull-secret\") pod \"global-pull-secret-syncer-tpwr5\" (UID: \"1f004726-0178-4641-a8bc-435b7858296d\") " pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:26:33.299891 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.299867    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prbtx\" (UniqueName: \"kubernetes.io/projected/647488c6-f12a-49f0-9523-c2bec7706fdd-kube-api-access-prbtx\") pod \"network-check-target-bdszm\" (UID: \"647488c6-f12a-49f0-9523-c2bec7706fdd\") " pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:26:33.559581 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.559479    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tpwr5"
Jul 13 19:26:33.567181 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.567156    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n645d\""
Jul 13 19:26:33.574576 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.574547    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:26:33.696877 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.696844    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tpwr5"]
Jul 13 19:26:33.700006 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:26:33.699978    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f004726_0178_4641_a8bc_435b7858296d.slice/crio-46b819908aec0147dbce9de98b1db39d6bec5368d05f2907522d4d8f491ec68a WatchSource:0}: Error finding container 46b819908aec0147dbce9de98b1db39d6bec5368d05f2907522d4d8f491ec68a: Status 404 returned error can't find the container with id 46b819908aec0147dbce9de98b1db39d6bec5368d05f2907522d4d8f491ec68a
Jul 13 19:26:33.712874 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.712848    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bdszm"]
Jul 13 19:26:33.715137 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:26:33.715110    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647488c6_f12a_49f0_9523_c2bec7706fdd.slice/crio-a936bc9f64078e15c5df1645f5921e0e83c858fd7615517a31ba612795c3f7b9 WatchSource:0}: Error finding container a936bc9f64078e15c5df1645f5921e0e83c858fd7615517a31ba612795c3f7b9: Status 404 returned error can't find the container with id a936bc9f64078e15c5df1645f5921e0e83c858fd7615517a31ba612795c3f7b9
Jul 13 19:26:33.830963 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.830862    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdszm" event={"ID":"647488c6-f12a-49f0-9523-c2bec7706fdd","Type":"ContainerStarted","Data":"a936bc9f64078e15c5df1645f5921e0e83c858fd7615517a31ba612795c3f7b9"}
Jul 13 19:26:33.832097 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:33.832074    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tpwr5" event={"ID":"1f004726-0178-4641-a8bc-435b7858296d","Type":"ContainerStarted","Data":"46b819908aec0147dbce9de98b1db39d6bec5368d05f2907522d4d8f491ec68a"}
Jul 13 19:26:34.786985 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:34.786351    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:26:34.786985 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:34.786406    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:26:34.786985 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:34.786563    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 19:26:34.786985 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:34.786626    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls podName:7768e8b8-d5bd-461a-8fbb-694332e9c6a5 nodeName:}" failed. No retries permitted until 2026-07-13 19:27:06.78660748 +0000 UTC m=+99.787098023 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls") pod "dns-default-52dqm" (UID: "7768e8b8-d5bd-461a-8fbb-694332e9c6a5") : secret "dns-default-metrics-tls" not found
Jul 13 19:26:34.786985 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:34.786953    2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 19:26:34.786985 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:34.786978    2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d687d458-vcxsw: secret "image-registry-tls" not found
Jul 13 19:26:34.787706 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:26:34.787039    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls podName:f3ce4676-c643-4b40-adee-58a5ee96c3bf nodeName:}" failed. No retries permitted until 2026-07-13 19:27:06.787021179 +0000 UTC m=+99.787511721 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls") pod "image-registry-d687d458-vcxsw" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf") : secret "image-registry-tls" not found
Jul 13 19:26:39.848086 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:39.848047    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bdszm" event={"ID":"647488c6-f12a-49f0-9523-c2bec7706fdd","Type":"ContainerStarted","Data":"9d548c68f26e69060ccd0f69d38e9737bf87d8c89fc87b90588c38c3520e77b3"}
Jul 13 19:26:39.848620 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:39.848174    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:26:39.849562 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:39.849539    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tpwr5" event={"ID":"1f004726-0178-4641-a8bc-435b7858296d","Type":"ContainerStarted","Data":"0f2099b6d18c7241a47e8e0ccfa2528fe95d951f6d7cf42556ac76a855a4de71"}
Jul 13 19:26:39.866142 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:39.866090    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bdszm" podStartSLOduration=66.695228388 podStartE2EDuration="1m11.866075132s" totalImagesPullingTime="5.170846744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:39.864705948 +0000 UTC m=+72.865196507" watchObservedRunningTime="2026-07-13 19:26:39.866075132 +0000 UTC m=+72.866565747"
Jul 13 19:26:39.880114 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:39.880063    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tpwr5" podStartSLOduration=66.682294735 podStartE2EDuration="1m11.880045495s" totalImagesPullingTime="5.19775076s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:39.879403986 +0000 UTC m=+72.879894545" watchObservedRunningTime="2026-07-13 19:26:39.880045495 +0000 UTC m=+72.880536055"
Jul 13 19:26:43.942822 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:43.942770    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"]
Jul 13 19:26:43.944777 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:43.944762    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:43.947578 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:43.947552    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 19:26:43.949043 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:43.949025    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 19:26:43.949153 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:43.949004    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 19:26:43.949153 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:43.949026    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 13 19:26:43.954096 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:43.954073    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"]
Jul 13 19:26:44.058318 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.058281    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8932024f-4b7a-44fc-a255-3e392f91d3d8-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c5cb8bd95-9r4tk\" (UID: \"8932024f-4b7a-44fc-a255-3e392f91d3d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:44.058318 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.058331    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8932024f-4b7a-44fc-a255-3e392f91d3d8-tmp\") pod \"klusterlet-addon-workmgr-5c5cb8bd95-9r4tk\" (UID: \"8932024f-4b7a-44fc-a255-3e392f91d3d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:44.058573 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.058369    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52tpw\" (UniqueName: \"kubernetes.io/projected/8932024f-4b7a-44fc-a255-3e392f91d3d8-kube-api-access-52tpw\") pod \"klusterlet-addon-workmgr-5c5cb8bd95-9r4tk\" (UID: \"8932024f-4b7a-44fc-a255-3e392f91d3d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:44.159342 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.159298    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8932024f-4b7a-44fc-a255-3e392f91d3d8-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c5cb8bd95-9r4tk\" (UID: \"8932024f-4b7a-44fc-a255-3e392f91d3d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:44.159342 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.159346    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8932024f-4b7a-44fc-a255-3e392f91d3d8-tmp\") pod \"klusterlet-addon-workmgr-5c5cb8bd95-9r4tk\" (UID: \"8932024f-4b7a-44fc-a255-3e392f91d3d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:44.159594 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.159379    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52tpw\" (UniqueName: \"kubernetes.io/projected/8932024f-4b7a-44fc-a255-3e392f91d3d8-kube-api-access-52tpw\") pod \"klusterlet-addon-workmgr-5c5cb8bd95-9r4tk\" (UID: \"8932024f-4b7a-44fc-a255-3e392f91d3d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:44.159720 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.159699    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8932024f-4b7a-44fc-a255-3e392f91d3d8-tmp\") pod \"klusterlet-addon-workmgr-5c5cb8bd95-9r4tk\" (UID: \"8932024f-4b7a-44fc-a255-3e392f91d3d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:44.162034 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.162005    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8932024f-4b7a-44fc-a255-3e392f91d3d8-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c5cb8bd95-9r4tk\" (UID: \"8932024f-4b7a-44fc-a255-3e392f91d3d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:44.168322 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.168294    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52tpw\" (UniqueName: \"kubernetes.io/projected/8932024f-4b7a-44fc-a255-3e392f91d3d8-kube-api-access-52tpw\") pod \"klusterlet-addon-workmgr-5c5cb8bd95-9r4tk\" (UID: \"8932024f-4b7a-44fc-a255-3e392f91d3d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:44.254016 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.253925    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:44.378327 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.378291    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"]
Jul 13 19:26:44.381487 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:26:44.381460    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8932024f_4b7a_44fc_a255_3e392f91d3d8.slice/crio-96efeb40adcf4ec0b02101fe322c0c978cd0453fa6f38897305b6e018f1cbed1 WatchSource:0}: Error finding container 96efeb40adcf4ec0b02101fe322c0c978cd0453fa6f38897305b6e018f1cbed1: Status 404 returned error can't find the container with id 96efeb40adcf4ec0b02101fe322c0c978cd0453fa6f38897305b6e018f1cbed1
Jul 13 19:26:44.863788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:44.863750    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk" event={"ID":"8932024f-4b7a-44fc-a255-3e392f91d3d8","Type":"ContainerStarted","Data":"96efeb40adcf4ec0b02101fe322c0c978cd0453fa6f38897305b6e018f1cbed1"}
Jul 13 19:26:51.882559 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:51.882505    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk" event={"ID":"8932024f-4b7a-44fc-a255-3e392f91d3d8","Type":"ContainerStarted","Data":"2a3bea4ced42584d66cae58c02f4c1bff20079b0152426109f29acf14c38a991"}
Jul 13 19:26:51.883057 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:51.882678    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:51.884346 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:51.884327    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:26:51.899401 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:26:51.899349    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk" podStartSLOduration=2.11777621 podStartE2EDuration="8.899333309s" totalImagesPullingTime="6.781557099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:26:51.898928291 +0000 UTC m=+84.899418863" watchObservedRunningTime="2026-07-13 19:26:51.899333309 +0000 UTC m=+84.899823868"
Jul 13 19:27:06.823340 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:27:06.823294    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:27:06.823717 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:27:06.823377    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:27:06.823717 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:27:06.823444    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 19:27:06.823717 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:27:06.823463    2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 19:27:06.823717 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:27:06.823475    2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d687d458-vcxsw: secret "image-registry-tls" not found
Jul 13 19:27:06.823717 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:27:06.823511    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls podName:7768e8b8-d5bd-461a-8fbb-694332e9c6a5 nodeName:}" failed. No retries permitted until 2026-07-13 19:28:10.823495834 +0000 UTC m=+163.823986374 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls") pod "dns-default-52dqm" (UID: "7768e8b8-d5bd-461a-8fbb-694332e9c6a5") : secret "dns-default-metrics-tls" not found
Jul 13 19:27:06.823717 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:27:06.823528    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls podName:f3ce4676-c643-4b40-adee-58a5ee96c3bf nodeName:}" failed. No retries permitted until 2026-07-13 19:28:10.823517519 +0000 UTC m=+163.824008057 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls") pod "image-registry-d687d458-vcxsw" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf") : secret "image-registry-tls" not found
Jul 13 19:27:10.854694 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:27:10.854661    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bdszm"
Jul 13 19:27:37.342154 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:27:37.342115    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:27:37.342725 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:27:37.342296    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 19:27:37.342725 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:27:37.342390    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs podName:1a004020-e409-46a4-8bab-8e560b477812 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:39.342368405 +0000 UTC m=+252.342858956 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs") pod "network-metrics-daemon-4lsrh" (UID: "1a004020-e409-46a4-8bab-8e560b477812") : secret "metrics-daemon-secret" not found
Jul 13 19:28:05.903059 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:28:05.903008    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-d687d458-vcxsw" podUID="f3ce4676-c643-4b40-adee-58a5ee96c3bf"
Jul 13 19:28:05.917189 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:28:05.917157    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-52dqm" podUID="7768e8b8-d5bd-461a-8fbb-694332e9c6a5"
Jul 13 19:28:06.061965 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:06.061938    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-52dqm"
Jul 13 19:28:06.062100 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:06.061940    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:28:06.552792 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:28:06.552740    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:28:10.881005 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:10.880951    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:28:10.881405 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:10.881048    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") pod \"image-registry-d687d458-vcxsw\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") " pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:28:10.881405 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:28:10.881111    2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 19:28:10.881405 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:28:10.881140    2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 19:28:10.881405 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:28:10.881151    2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d687d458-vcxsw: secret "image-registry-tls" not found
Jul 13 19:28:10.881405 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:28:10.881184    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls podName:7768e8b8-d5bd-461a-8fbb-694332e9c6a5 nodeName:}" failed. No retries permitted until 2026-07-13 19:30:12.881165436 +0000 UTC m=+285.881655982 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls") pod "dns-default-52dqm" (UID: "7768e8b8-d5bd-461a-8fbb-694332e9c6a5") : secret "dns-default-metrics-tls" not found
Jul 13 19:28:10.881405 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:28:10.881203    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls podName:f3ce4676-c643-4b40-adee-58a5ee96c3bf nodeName:}" failed. No retries permitted until 2026-07-13 19:30:12.88119085 +0000 UTC m=+285.881681388 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls") pod "image-registry-d687d458-vcxsw" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf") : secret "image-registry-tls" not found
Jul 13 19:28:21.538929 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:21.538850    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:28:51.883650 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:51.883594    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk" podUID="8932024f-4b7a-44fc-a255-3e392f91d3d8" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused"
Jul 13 19:28:52.172480 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:52.172451    2550 generic.go:356] "Generic (PLEG): container finished" podID="8932024f-4b7a-44fc-a255-3e392f91d3d8" containerID="2a3bea4ced42584d66cae58c02f4c1bff20079b0152426109f29acf14c38a991" exitCode=1
Jul 13 19:28:52.172659 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:52.172489    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk" event={"ID":"8932024f-4b7a-44fc-a255-3e392f91d3d8","Type":"ContainerDied","Data":"2a3bea4ced42584d66cae58c02f4c1bff20079b0152426109f29acf14c38a991"}
Jul 13 19:28:52.172822 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:52.172787    2550 scope.go:117] "RemoveContainer" containerID="2a3bea4ced42584d66cae58c02f4c1bff20079b0152426109f29acf14c38a991"
Jul 13 19:28:53.177038 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:53.177000    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk" event={"ID":"8932024f-4b7a-44fc-a255-3e392f91d3d8","Type":"ContainerStarted","Data":"1c2fc53ec6266911e16ed9e6714fe4dcf820672c157b364aacf1469185f8dc53"}
Jul 13 19:28:53.177411 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:53.177313    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:28:53.177907 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:28:53.177892    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5cb8bd95-9r4tk"
Jul 13 19:29:32.666746 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.666705    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"]
Jul 13 19:29:32.668693 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.668669    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.671610 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.671588    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-cgddw"]
Jul 13 19:29:32.672392 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.672375    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 13 19:29:32.672708 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.672693    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4md9f\""
Jul 13 19:29:32.672993 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.672976    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 13 19:29:32.673083 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.673068    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb"]
Jul 13 19:29:32.673166 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.673150    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.673740 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.673724    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 13 19:29:32.673854 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.673759    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 13 19:29:32.674738 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.674722    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb"
Jul 13 19:29:32.675875 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.675854    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 13 19:29:32.676051 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.676035    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 13 19:29:32.676457 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.676340    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 13 19:29:32.676457 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.676353    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 13 19:29:32.676898 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.676883    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8g4b4\""
Jul 13 19:29:32.677487 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.677415    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wvqlp\""
Jul 13 19:29:32.677754 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.677737    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 13 19:29:32.677848 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.677741    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 13 19:29:32.682463 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.682442    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 13 19:29:32.686595 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.686569    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"]
Jul 13 19:29:32.687528 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.687506    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb"]
Jul 13 19:29:32.689540 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.689521    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-cgddw"]
Jul 13 19:29:32.762135 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.762095    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-config\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.762309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.762145    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nhdp\" (UniqueName: \"kubernetes.io/projected/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-kube-api-access-2nhdp\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.762309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.762217    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxblc\" (UniqueName: \"kubernetes.io/projected/9ed17614-e3b8-4d1f-b8af-08c2f61f6348-kube-api-access-jxblc\") pod \"volume-data-source-validator-78495597f6-c4pxb\" (UID: \"9ed17614-e3b8-4d1f-b8af-08c2f61f6348\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb"
Jul 13 19:29:32.762309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.762248    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05a15578-9262-4a21-9845-36c6773e7214-config\") pod \"service-ca-operator-7695fc6c8c-hgtvm\" (UID: \"05a15578-9262-4a21-9845-36c6773e7214\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.762309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.762270    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05a15578-9262-4a21-9845-36c6773e7214-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hgtvm\" (UID: \"05a15578-9262-4a21-9845-36c6773e7214\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.762309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.762296    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-serving-cert\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.762495 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.762340    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-trusted-ca\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.762495 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.762385    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgqmf\" (UniqueName: \"kubernetes.io/projected/05a15578-9262-4a21-9845-36c6773e7214-kube-api-access-pgqmf\") pod \"service-ca-operator-7695fc6c8c-hgtvm\" (UID: \"05a15578-9262-4a21-9845-36c6773e7214\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.863134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.863089    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-serving-cert\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.863134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.863128    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-trusted-ca\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.863352 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.863145    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgqmf\" (UniqueName: \"kubernetes.io/projected/05a15578-9262-4a21-9845-36c6773e7214-kube-api-access-pgqmf\") pod \"service-ca-operator-7695fc6c8c-hgtvm\" (UID: \"05a15578-9262-4a21-9845-36c6773e7214\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.863352 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.863181    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-config\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.863352 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.863240    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nhdp\" (UniqueName: \"kubernetes.io/projected/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-kube-api-access-2nhdp\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.863352 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.863301    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxblc\" (UniqueName: \"kubernetes.io/projected/9ed17614-e3b8-4d1f-b8af-08c2f61f6348-kube-api-access-jxblc\") pod \"volume-data-source-validator-78495597f6-c4pxb\" (UID: \"9ed17614-e3b8-4d1f-b8af-08c2f61f6348\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb"
Jul 13 19:29:32.863352 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.863319    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05a15578-9262-4a21-9845-36c6773e7214-config\") pod \"service-ca-operator-7695fc6c8c-hgtvm\" (UID: \"05a15578-9262-4a21-9845-36c6773e7214\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.863352 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.863339    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05a15578-9262-4a21-9845-36c6773e7214-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hgtvm\" (UID: \"05a15578-9262-4a21-9845-36c6773e7214\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.863983 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.863959    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05a15578-9262-4a21-9845-36c6773e7214-config\") pod \"service-ca-operator-7695fc6c8c-hgtvm\" (UID: \"05a15578-9262-4a21-9845-36c6773e7214\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.864090 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.864037    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-trusted-ca\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.864090 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.864015    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-config\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.865570 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.865552    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-serving-cert\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.865650 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.865618    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05a15578-9262-4a21-9845-36c6773e7214-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hgtvm\" (UID: \"05a15578-9262-4a21-9845-36c6773e7214\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.872537 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.872508    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nhdp\" (UniqueName: \"kubernetes.io/projected/c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a-kube-api-access-2nhdp\") pod \"console-operator-7866497494-cgddw\" (UID: \"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a\") " pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.872652 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.872553    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxblc\" (UniqueName: \"kubernetes.io/projected/9ed17614-e3b8-4d1f-b8af-08c2f61f6348-kube-api-access-jxblc\") pod \"volume-data-source-validator-78495597f6-c4pxb\" (UID: \"9ed17614-e3b8-4d1f-b8af-08c2f61f6348\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb"
Jul 13 19:29:32.872719 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.872670    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgqmf\" (UniqueName: \"kubernetes.io/projected/05a15578-9262-4a21-9845-36c6773e7214-kube-api-access-pgqmf\") pod \"service-ca-operator-7695fc6c8c-hgtvm\" (UID: \"05a15578-9262-4a21-9845-36c6773e7214\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.979982 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.979892    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"
Jul 13 19:29:32.988593 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.988561    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:32.995511 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:32.995486    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb"
Jul 13 19:29:33.127138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:33.127110    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm"]
Jul 13 19:29:33.130195 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:29:33.130172    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a15578_9262_4a21_9845_36c6773e7214.slice/crio-edabfad1da648ac500c28fe93b2c8fc2936508046c519497918c5cc2ce7babdb WatchSource:0}: Error finding container edabfad1da648ac500c28fe93b2c8fc2936508046c519497918c5cc2ce7babdb: Status 404 returned error can't find the container with id edabfad1da648ac500c28fe93b2c8fc2936508046c519497918c5cc2ce7babdb
Jul 13 19:29:33.280535 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:33.280455    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm" event={"ID":"05a15578-9262-4a21-9845-36c6773e7214","Type":"ContainerStarted","Data":"edabfad1da648ac500c28fe93b2c8fc2936508046c519497918c5cc2ce7babdb"}
Jul 13 19:29:33.347424 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:33.347395    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb"]
Jul 13 19:29:33.350526 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:29:33.350499    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ed17614_e3b8_4d1f_b8af_08c2f61f6348.slice/crio-2f419d9bc9150e90e2e19245b1835ec1a7fb32f6ce21c0d782fa0720bc0cc564 WatchSource:0}: Error finding container 2f419d9bc9150e90e2e19245b1835ec1a7fb32f6ce21c0d782fa0720bc0cc564: Status 404 returned error can't find the container with id 2f419d9bc9150e90e2e19245b1835ec1a7fb32f6ce21c0d782fa0720bc0cc564
Jul 13 19:29:33.351118 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:33.351001    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-cgddw"]
Jul 13 19:29:33.354526 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:29:33.354416    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5fbbc82_5e10_45c2_91fd_6aa286ce7a8a.slice/crio-c605fd60732a2f52393d81cb90df25decab4904182d54397440d14c405d2a137 WatchSource:0}: Error finding container c605fd60732a2f52393d81cb90df25decab4904182d54397440d14c405d2a137: Status 404 returned error can't find the container with id c605fd60732a2f52393d81cb90df25decab4904182d54397440d14c405d2a137
Jul 13 19:29:34.285934 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:34.285857    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cgddw" event={"ID":"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a","Type":"ContainerStarted","Data":"c605fd60732a2f52393d81cb90df25decab4904182d54397440d14c405d2a137"}
Jul 13 19:29:34.287413 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:34.287355    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb" event={"ID":"9ed17614-e3b8-4d1f-b8af-08c2f61f6348","Type":"ContainerStarted","Data":"2f419d9bc9150e90e2e19245b1835ec1a7fb32f6ce21c0d782fa0720bc0cc564"}
Jul 13 19:29:35.292711 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:35.292667    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb" event={"ID":"9ed17614-e3b8-4d1f-b8af-08c2f61f6348","Type":"ContainerStarted","Data":"b5de23ef39ad527ceaa5b6b681f78a05d27a817718b9f3e4107b0100f7f1a686"}
Jul 13 19:29:35.309290 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:35.309224    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4pxb" podStartSLOduration=2.057895766 podStartE2EDuration="3.30920504s" totalImagesPullingTime="1.251309274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:29:35.308246064 +0000 UTC m=+248.308736631" watchObservedRunningTime="2026-07-13 19:29:35.30920504 +0000 UTC m=+248.309695607"
Jul 13 19:29:36.297493 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.297449    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm" event={"ID":"05a15578-9262-4a21-9845-36c6773e7214","Type":"ContainerStarted","Data":"b3475069bc321767b491a7a87f1bec7e62e082a5814d4b00b0f872f3bc78e4c6"}
Jul 13 19:29:36.299075 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.299054    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/0.log"
Jul 13 19:29:36.299189 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.299089    2550 generic.go:356] "Generic (PLEG): container finished" podID="c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a" containerID="3166fe14d3df7775f541a091153e67f7de7215862047cc8246864f6e4d1bf908" exitCode=255
Jul 13 19:29:36.299189 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.299173    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cgddw" event={"ID":"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a","Type":"ContainerDied","Data":"3166fe14d3df7775f541a091153e67f7de7215862047cc8246864f6e4d1bf908"}
Jul 13 19:29:36.299362 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.299345    2550 scope.go:117] "RemoveContainer" containerID="3166fe14d3df7775f541a091153e67f7de7215862047cc8246864f6e4d1bf908"
Jul 13 19:29:36.313832 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.313770    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm" podStartSLOduration=1.563395485 podStartE2EDuration="4.313750009s" totalImagesPullingTime="2.750354524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:29:36.313213865 +0000 UTC m=+249.313704426" watchObservedRunningTime="2026-07-13 19:29:36.313750009 +0000 UTC m=+249.314240569"
Jul 13 19:29:36.570220 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.570149    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2"]
Jul 13 19:29:36.572063 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.572047    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2"
Jul 13 19:29:36.574681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.574651    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-f6vj6\""
Jul 13 19:29:36.574681 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.574672    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 13 19:29:36.574875 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.574681    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 13 19:29:36.582561 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.582533    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2"]
Jul 13 19:29:36.593025 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.592993    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvl9z\" (UniqueName: \"kubernetes.io/projected/f70f1fa9-d850-458e-9e69-bad1e3acc107-kube-api-access-cvl9z\") pod \"migrator-7f59b54f6c-shsp2\" (UID: \"f70f1fa9-d850-458e-9e69-bad1e3acc107\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2"
Jul 13 19:29:36.694075 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.694035    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvl9z\" (UniqueName: \"kubernetes.io/projected/f70f1fa9-d850-458e-9e69-bad1e3acc107-kube-api-access-cvl9z\") pod \"migrator-7f59b54f6c-shsp2\" (UID: \"f70f1fa9-d850-458e-9e69-bad1e3acc107\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2"
Jul 13 19:29:36.702591 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.702547    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvl9z\" (UniqueName: \"kubernetes.io/projected/f70f1fa9-d850-458e-9e69-bad1e3acc107-kube-api-access-cvl9z\") pod \"migrator-7f59b54f6c-shsp2\" (UID: \"f70f1fa9-d850-458e-9e69-bad1e3acc107\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2"
Jul 13 19:29:36.881171 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:36.881085    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2"
Jul 13 19:29:37.029670 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:37.029612    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2"]
Jul 13 19:29:37.033445 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:29:37.033399    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf70f1fa9_d850_458e_9e69_bad1e3acc107.slice/crio-bd02ff1ec63677ae51384187d3238a8807e2f9b4b4e22be8d9a70d422d5877a4 WatchSource:0}: Error finding container bd02ff1ec63677ae51384187d3238a8807e2f9b4b4e22be8d9a70d422d5877a4: Status 404 returned error can't find the container with id bd02ff1ec63677ae51384187d3238a8807e2f9b4b4e22be8d9a70d422d5877a4
Jul 13 19:29:37.303949 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:37.303920    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:29:37.304401 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:37.304382    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/0.log"
Jul 13 19:29:37.304544 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:37.304427    2550 generic.go:356] "Generic (PLEG): container finished" podID="c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a" containerID="41900a9a79c431c0af5a7e6c2fd6e44d2356a64d0a424b50d7029944b032a91d" exitCode=255
Jul 13 19:29:37.304544 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:37.304507    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cgddw" event={"ID":"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a","Type":"ContainerDied","Data":"41900a9a79c431c0af5a7e6c2fd6e44d2356a64d0a424b50d7029944b032a91d"}
Jul 13 19:29:37.304636 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:37.304558    2550 scope.go:117] "RemoveContainer" containerID="3166fe14d3df7775f541a091153e67f7de7215862047cc8246864f6e4d1bf908"
Jul 13 19:29:37.304770 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:37.304751    2550 scope.go:117] "RemoveContainer" containerID="41900a9a79c431c0af5a7e6c2fd6e44d2356a64d0a424b50d7029944b032a91d"
Jul 13 19:29:37.304993 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:37.304966    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-cgddw_openshift-console-operator(c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a)\"" pod="openshift-console-operator/console-operator-7866497494-cgddw" podUID="c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a"
Jul 13 19:29:37.305621 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:37.305569    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2" event={"ID":"f70f1fa9-d850-458e-9e69-bad1e3acc107","Type":"ContainerStarted","Data":"bd02ff1ec63677ae51384187d3238a8807e2f9b4b4e22be8d9a70d422d5877a4"}
Jul 13 19:29:38.310314 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.310288    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:29:38.310852 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.310614    2550 scope.go:117] "RemoveContainer" containerID="41900a9a79c431c0af5a7e6c2fd6e44d2356a64d0a424b50d7029944b032a91d"
Jul 13 19:29:38.310852 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:38.310756    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-cgddw_openshift-console-operator(c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a)\"" pod="openshift-console-operator/console-operator-7866497494-cgddw" podUID="c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a"
Jul 13 19:29:38.408022 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.407993    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nzv9n"]
Jul 13 19:29:38.410482 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.410466    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.413670 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.413648    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qtwnk\""
Jul 13 19:29:38.413797 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.413687    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 19:29:38.413797 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.413743    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 19:29:38.413797 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.413757    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 19:29:38.413797 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.413767    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 19:29:38.422704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.422682    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nzv9n"]
Jul 13 19:29:38.507565 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.507527    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4vf6\" (UniqueName: \"kubernetes.io/projected/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-api-access-n4vf6\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.507766 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.507581    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef79a2a0-c323-4350-8807-bb6ffe252c05-data-volume\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.507863 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.507758    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.507863 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.507787    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.507863 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.507840    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef79a2a0-c323-4350-8807-bb6ffe252c05-crio-socket\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.608447 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.608360    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.608447 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.608400    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.608447 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.608422    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef79a2a0-c323-4350-8807-bb6ffe252c05-crio-socket\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.608447 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.608444    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4vf6\" (UniqueName: \"kubernetes.io/projected/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-api-access-n4vf6\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.608724 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:38.608514    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 19:29:38.608724 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:38.608530    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:38.608724 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.608543    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef79a2a0-c323-4350-8807-bb6ffe252c05-data-volume\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.608724 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.608524    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef79a2a0-c323-4350-8807-bb6ffe252c05-crio-socket\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.608724 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:38.608586    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:39.108570917 +0000 UTC m=+252.109061459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:38.608724 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:38.608655    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:39.108647452 +0000 UTC m=+252.109137994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : configmap "kube-rbac-proxy" not found
Jul 13 19:29:38.609050 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.608888    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef79a2a0-c323-4350-8807-bb6ffe252c05-data-volume\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:38.617198 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:38.617169    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4vf6\" (UniqueName: \"kubernetes.io/projected/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-api-access-n4vf6\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:39.114216 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:39.114166    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:39.114216 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:39.114223    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:39.114484 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:39.114343    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:39.114484 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:39.114370    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 19:29:39.114484 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:39.114428    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:40.114404678 +0000 UTC m=+253.114895218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:39.114484 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:39.114454    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:40.114442702 +0000 UTC m=+253.114933244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : configmap "kube-rbac-proxy" not found
Jul 13 19:29:39.319291 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:39.319254    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2" event={"ID":"f70f1fa9-d850-458e-9e69-bad1e3acc107","Type":"ContainerStarted","Data":"5a8618dd9af5f1b50bea537be21b6e7ad3e74d8734bf13b40594d275fe086423"}
Jul 13 19:29:39.319755 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:39.319346    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2" event={"ID":"f70f1fa9-d850-458e-9e69-bad1e3acc107","Type":"ContainerStarted","Data":"ed09bad0760d32326600864ff56bdf2300cd30cfdcb20c5ef63551455a7a0367"}
Jul 13 19:29:39.340442 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:39.340392    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-shsp2" podStartSLOduration=1.200216168 podStartE2EDuration="3.340376174s" totalImagesPullingTime="2.140160006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:29:39.338493968 +0000 UTC m=+252.338984530" watchObservedRunningTime="2026-07-13 19:29:39.340376174 +0000 UTC m=+252.340866779"
Jul 13 19:29:39.416998 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:39.416963    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:29:39.417182 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:39.417099    2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 19:29:39.417182 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:39.417167    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs podName:1a004020-e409-46a4-8bab-8e560b477812 nodeName:}" failed. No retries permitted until 2026-07-13 19:31:41.417151897 +0000 UTC m=+374.417642438 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs") pod "network-metrics-daemon-4lsrh" (UID: "1a004020-e409-46a4-8bab-8e560b477812") : secret "metrics-daemon-secret" not found
Jul 13 19:29:40.123481 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:40.123440    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:40.123481 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:40.123477    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:40.123720 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:40.123550    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 19:29:40.123720 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:40.123591    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:40.123720 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:40.123601    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:42.123588101 +0000 UTC m=+255.124078639 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : configmap "kube-rbac-proxy" not found
Jul 13 19:29:40.123720 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:40.123656    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:42.123643463 +0000 UTC m=+255.124134000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:40.978445 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:40.978419    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5t7xt_e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa/dns-node-resolver/0.log"
Jul 13 19:29:41.976440 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:41.976413    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9wdt5_e9146574-0c5d-4830-9bfe-80972c84aa3c/node-ca/0.log"
Jul 13 19:29:42.136970 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:42.136938    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:42.136970 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:42.136972    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:42.137366 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:42.137048    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 19:29:42.137366 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:42.137089    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:42.137366 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:42.137099    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:46.137084962 +0000 UTC m=+259.137575499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : configmap "kube-rbac-proxy" not found
Jul 13 19:29:42.137366 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:42.137158    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:46.137137056 +0000 UTC m=+259.137627605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:42.988956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:42.988868    2550 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:42.988956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:42.988924    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:42.989269 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:42.989257    2550 scope.go:117] "RemoveContainer" containerID="41900a9a79c431c0af5a7e6c2fd6e44d2356a64d0a424b50d7029944b032a91d"
Jul 13 19:29:42.989414 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:42.989397    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-cgddw_openshift-console-operator(c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a)\"" pod="openshift-console-operator/console-operator-7866497494-cgddw" podUID="c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a"
Jul 13 19:29:43.176494 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:43.176468    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2m4m_a05b8244-83b1-4ece-b238-212ece39fc9f/serve-healthcheck-canary/0.log"
Jul 13 19:29:43.378100 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:43.378018    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-shsp2_f70f1fa9-d850-458e-9e69-bad1e3acc107/migrator/0.log"
Jul 13 19:29:43.576208 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:43.576177    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-shsp2_f70f1fa9-d850-458e-9e69-bad1e3acc107/graceful-termination/0.log"
Jul 13 19:29:46.167022 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:46.166982    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:46.167022 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:46.167020    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:46.167441 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:46.167100    2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 19:29:46.167441 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:46.167136    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:46.167441 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:46.167156    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:54.167142977 +0000 UTC m=+267.167633518 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : configmap "kube-rbac-proxy" not found
Jul 13 19:29:46.167441 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:46.167187    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:29:54.167175142 +0000 UTC m=+267.167665680 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:53.539776 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:53.539692    2550 scope.go:117] "RemoveContainer" containerID="41900a9a79c431c0af5a7e6c2fd6e44d2356a64d0a424b50d7029944b032a91d"
Jul 13 19:29:54.229528 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:54.229475    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:54.229528 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:54.229512    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:54.229768 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:54.229637    2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:54.229768 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:29:54.229705    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls podName:ef79a2a0-c323-4350-8807-bb6ffe252c05 nodeName:}" failed. No retries permitted until 2026-07-13 19:30:10.229688733 +0000 UTC m=+283.230179273 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nzv9n" (UID: "ef79a2a0-c323-4350-8807-bb6ffe252c05") : secret "insights-runtime-extractor-tls" not found
Jul 13 19:29:54.230035 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:54.230017    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef79a2a0-c323-4350-8807-bb6ffe252c05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:29:54.366549 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:54.366519    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:29:54.366725 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:54.366587    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-cgddw" event={"ID":"c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a","Type":"ContainerStarted","Data":"49ad91a0f10efb8a4cda71a12adc28e880206f7b0141651c7c0309b4d36b9f8d"}
Jul 13 19:29:54.366877 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:54.366857    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:54.371580 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:54.371556    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-cgddw"
Jul 13 19:29:54.384878 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:29:54.384828    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-cgddw" podStartSLOduration=19.858953088 podStartE2EDuration="22.384789903s" totalImagesPullingTime="2.525836815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:29:54.384262132 +0000 UTC m=+267.384752692" watchObservedRunningTime="2026-07-13 19:29:54.384789903 +0000 UTC m=+267.385280463"
Jul 13 19:30:00.003298 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.003265    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d687d458-vcxsw"]
Jul 13 19:30:00.003729 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:00.003541    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-d687d458-vcxsw" podUID="f3ce4676-c643-4b40-adee-58a5ee96c3bf"
Jul 13 19:30:00.121021 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.120986    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d7c594c84-pk6jl"]
Jul 13 19:30:00.123131 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.123103    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.138223 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.138193    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d7c594c84-pk6jl"]
Jul 13 19:30:00.178939 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.178903    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/506310dc-395f-4a2e-94b3-037160fc4003-ca-trust-extracted\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.178939 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.178939    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/506310dc-395f-4a2e-94b3-037160fc4003-trusted-ca\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.179143 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.179029    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506310dc-395f-4a2e-94b3-037160fc4003-registry-tls\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.179143 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.179083    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/506310dc-395f-4a2e-94b3-037160fc4003-bound-sa-token\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.179143 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.179106    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/506310dc-395f-4a2e-94b3-037160fc4003-image-registry-private-configuration\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.179143 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.179124    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/506310dc-395f-4a2e-94b3-037160fc4003-registry-certificates\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.179143 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.179139    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/506310dc-395f-4a2e-94b3-037160fc4003-installation-pull-secrets\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.179290 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.179161    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl96c\" (UniqueName: \"kubernetes.io/projected/506310dc-395f-4a2e-94b3-037160fc4003-kube-api-access-zl96c\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.280487 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.280404    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506310dc-395f-4a2e-94b3-037160fc4003-registry-tls\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.280487 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.280452    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/506310dc-395f-4a2e-94b3-037160fc4003-bound-sa-token\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.280487 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.280481    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/506310dc-395f-4a2e-94b3-037160fc4003-image-registry-private-configuration\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.280778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.280499    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/506310dc-395f-4a2e-94b3-037160fc4003-registry-certificates\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.280778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.280513    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/506310dc-395f-4a2e-94b3-037160fc4003-installation-pull-secrets\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.280778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.280539    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl96c\" (UniqueName: \"kubernetes.io/projected/506310dc-395f-4a2e-94b3-037160fc4003-kube-api-access-zl96c\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.280778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.280602    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/506310dc-395f-4a2e-94b3-037160fc4003-ca-trust-extracted\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.280778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.280625    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/506310dc-395f-4a2e-94b3-037160fc4003-trusted-ca\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.281215 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.281189    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/506310dc-395f-4a2e-94b3-037160fc4003-ca-trust-extracted\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.281565 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.281542    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/506310dc-395f-4a2e-94b3-037160fc4003-registry-certificates\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.281840 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.281800    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/506310dc-395f-4a2e-94b3-037160fc4003-trusted-ca\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.283664 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.283639    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/506310dc-395f-4a2e-94b3-037160fc4003-installation-pull-secrets\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.283845 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.283826    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/506310dc-395f-4a2e-94b3-037160fc4003-registry-tls\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.284200 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.284175    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/506310dc-395f-4a2e-94b3-037160fc4003-image-registry-private-configuration\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.289374 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.289352    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/506310dc-395f-4a2e-94b3-037160fc4003-bound-sa-token\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.290177 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.290154    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl96c\" (UniqueName: \"kubernetes.io/projected/506310dc-395f-4a2e-94b3-037160fc4003-kube-api-access-zl96c\") pod \"image-registry-7d7c594c84-pk6jl\" (UID: \"506310dc-395f-4a2e-94b3-037160fc4003\") " pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.385555 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.385529    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:30:00.391731 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.391708    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:30:00.434523 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.434493    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jwfmb\""
Jul 13 19:30:00.442773 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.442749    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:00.482489 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.482461    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3ce4676-c643-4b40-adee-58a5ee96c3bf-ca-trust-extracted\") pod \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") "
Jul 13 19:30:00.482674 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.482520    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96hcx\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-kube-api-access-96hcx\") pod \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") "
Jul 13 19:30:00.482674 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.482572    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-image-registry-private-configuration\") pod \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") "
Jul 13 19:30:00.482674 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.482605    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-trusted-ca\") pod \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") "
Jul 13 19:30:00.482674 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.482628    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-bound-sa-token\") pod \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") "
Jul 13 19:30:00.482674 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.482658    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-certificates\") pod \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") "
Jul 13 19:30:00.482944 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.482692    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-installation-pull-secrets\") pod \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\" (UID: \"f3ce4676-c643-4b40-adee-58a5ee96c3bf\") "
Jul 13 19:30:00.482944 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.482793    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3ce4676-c643-4b40-adee-58a5ee96c3bf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f3ce4676-c643-4b40-adee-58a5ee96c3bf" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:30:00.483052 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.483007    2550 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3ce4676-c643-4b40-adee-58a5ee96c3bf-ca-trust-extracted\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:30:00.483112 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.483050    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f3ce4676-c643-4b40-adee-58a5ee96c3bf" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:30:00.483333 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.483269    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f3ce4676-c643-4b40-adee-58a5ee96c3bf" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:30:00.485021 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.484998    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f3ce4676-c643-4b40-adee-58a5ee96c3bf" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:30:00.485139 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.485046    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f3ce4676-c643-4b40-adee-58a5ee96c3bf" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:30:00.485417 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.485392    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f3ce4676-c643-4b40-adee-58a5ee96c3bf" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:30:00.485508 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.485474    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-kube-api-access-96hcx" (OuterVolumeSpecName: "kube-api-access-96hcx") pod "f3ce4676-c643-4b40-adee-58a5ee96c3bf" (UID: "f3ce4676-c643-4b40-adee-58a5ee96c3bf"). InnerVolumeSpecName "kube-api-access-96hcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:30:00.581093 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.581033    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d7c594c84-pk6jl"]
Jul 13 19:30:00.583536 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.583512    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96hcx\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-kube-api-access-96hcx\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:30:00.583536 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:30:00.583525    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506310dc_395f_4a2e_94b3_037160fc4003.slice/crio-a47a9949aeb7c2162c9a2118185c7785377af404ad3eb90627c2d3d42842be35 WatchSource:0}: Error finding container a47a9949aeb7c2162c9a2118185c7785377af404ad3eb90627c2d3d42842be35: Status 404 returned error can't find the container with id a47a9949aeb7c2162c9a2118185c7785377af404ad3eb90627c2d3d42842be35
Jul 13 19:30:00.583702 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.583534    2550 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-image-registry-private-configuration\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:30:00.583702 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.583565    2550 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-trusted-ca\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:30:00.583702 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.583579    2550 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-bound-sa-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:30:00.583702 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.583592    2550 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-certificates\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:30:00.583702 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:00.583604    2550 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3ce4676-c643-4b40-adee-58a5ee96c3bf-installation-pull-secrets\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:30:01.390369 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:01.390338    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d687d458-vcxsw"
Jul 13 19:30:01.390369 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:01.390355    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl" event={"ID":"506310dc-395f-4a2e-94b3-037160fc4003","Type":"ContainerStarted","Data":"a9c010f123fccf4fbc533cef1dfaf26e4aa2c9f8670fe3ee7c0f6819f68e92a5"}
Jul 13 19:30:01.390927 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:01.390400    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl" event={"ID":"506310dc-395f-4a2e-94b3-037160fc4003","Type":"ContainerStarted","Data":"a47a9949aeb7c2162c9a2118185c7785377af404ad3eb90627c2d3d42842be35"}
Jul 13 19:30:01.390927 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:01.390431    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:01.414316 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:01.414263    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl" podStartSLOduration=1.414246731 podStartE2EDuration="1.414246731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:01.413314283 +0000 UTC m=+274.413804844" watchObservedRunningTime="2026-07-13 19:30:01.414246731 +0000 UTC m=+274.414737290"
Jul 13 19:30:01.443240 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:01.443209    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d687d458-vcxsw"]
Jul 13 19:30:01.447112 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:01.447084    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d687d458-vcxsw"]
Jul 13 19:30:01.491212 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:01.491175    2550 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3ce4676-c643-4b40-adee-58a5ee96c3bf-registry-tls\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:30:01.543031 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:01.542990    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3ce4676-c643-4b40-adee-58a5ee96c3bf" path="/var/lib/kubelet/pods/f3ce4676-c643-4b40-adee-58a5ee96c3bf/volumes"
Jul 13 19:30:08.034854 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:08.034817    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"]
Jul 13 19:30:08.037670 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:08.037653    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"
Jul 13 19:30:08.040295 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:08.040268    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 13 19:30:08.040402 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:08.040276    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9hwc7\""
Jul 13 19:30:08.049001 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:08.048980    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"]
Jul 13 19:30:08.149692 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:08.149650    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/41784ef4-2240-4fa9-8a42-aa3d22af202b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-b6s5w\" (UID: \"41784ef4-2240-4fa9-8a42-aa3d22af202b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"
Jul 13 19:30:08.250776 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:08.250739    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/41784ef4-2240-4fa9-8a42-aa3d22af202b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-b6s5w\" (UID: \"41784ef4-2240-4fa9-8a42-aa3d22af202b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"
Jul 13 19:30:08.250965 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:08.250925    2550 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 13 19:30:08.251011 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:08.250996    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41784ef4-2240-4fa9-8a42-aa3d22af202b-tls-certificates podName:41784ef4-2240-4fa9-8a42-aa3d22af202b nodeName:}" failed. No retries permitted until 2026-07-13 19:30:08.750976184 +0000 UTC m=+281.751466722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/41784ef4-2240-4fa9-8a42-aa3d22af202b-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-b6s5w" (UID: "41784ef4-2240-4fa9-8a42-aa3d22af202b") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 13 19:30:08.755295 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:08.755254    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/41784ef4-2240-4fa9-8a42-aa3d22af202b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-b6s5w\" (UID: \"41784ef4-2240-4fa9-8a42-aa3d22af202b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"
Jul 13 19:30:08.755471 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:08.755414    2550 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 13 19:30:08.755513 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:08.755479    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41784ef4-2240-4fa9-8a42-aa3d22af202b-tls-certificates podName:41784ef4-2240-4fa9-8a42-aa3d22af202b nodeName:}" failed. No retries permitted until 2026-07-13 19:30:09.755460245 +0000 UTC m=+282.755950795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/41784ef4-2240-4fa9-8a42-aa3d22af202b-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-b6s5w" (UID: "41784ef4-2240-4fa9-8a42-aa3d22af202b") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 13 19:30:09.063425 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:09.063322    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-52dqm" podUID="7768e8b8-d5bd-461a-8fbb-694332e9c6a5"
Jul 13 19:30:09.415364 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:09.415286    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-52dqm"
Jul 13 19:30:09.764875 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:09.764844    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/41784ef4-2240-4fa9-8a42-aa3d22af202b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-b6s5w\" (UID: \"41784ef4-2240-4fa9-8a42-aa3d22af202b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"
Jul 13 19:30:09.766662 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:09.766642    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/41784ef4-2240-4fa9-8a42-aa3d22af202b-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-b6s5w\" (UID: \"41784ef4-2240-4fa9-8a42-aa3d22af202b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"
Jul 13 19:30:09.847297 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:09.847254    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"
Jul 13 19:30:09.988218 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:09.988187    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"]
Jul 13 19:30:09.991771 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:30:09.991736    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41784ef4_2240_4fa9_8a42_aa3d22af202b.slice/crio-78b225cfe75aa45039ec25720751225d24d0fa77ebff39282f16956775d2f7a3 WatchSource:0}: Error finding container 78b225cfe75aa45039ec25720751225d24d0fa77ebff39282f16956775d2f7a3: Status 404 returned error can't find the container with id 78b225cfe75aa45039ec25720751225d24d0fa77ebff39282f16956775d2f7a3
Jul 13 19:30:10.267743 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:10.267709    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:30:10.270149 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:10.270125    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef79a2a0-c323-4350-8807-bb6ffe252c05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nzv9n\" (UID: \"ef79a2a0-c323-4350-8807-bb6ffe252c05\") " pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:30:10.419666 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:10.419626    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w" event={"ID":"41784ef4-2240-4fa9-8a42-aa3d22af202b","Type":"ContainerStarted","Data":"78b225cfe75aa45039ec25720751225d24d0fa77ebff39282f16956775d2f7a3"}
Jul 13 19:30:10.519642 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:10.519552    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nzv9n"
Jul 13 19:30:10.685670 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:10.685638    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nzv9n"]
Jul 13 19:30:10.688709 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:30:10.688684    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef79a2a0_c323_4350_8807_bb6ffe252c05.slice/crio-52c327d034b8be1a5b85009346bc16b8ac34c365c744943a716980bb21d184a1 WatchSource:0}: Error finding container 52c327d034b8be1a5b85009346bc16b8ac34c365c744943a716980bb21d184a1: Status 404 returned error can't find the container with id 52c327d034b8be1a5b85009346bc16b8ac34c365c744943a716980bb21d184a1
Jul 13 19:30:11.423925 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:11.423838    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w" event={"ID":"41784ef4-2240-4fa9-8a42-aa3d22af202b","Type":"ContainerStarted","Data":"6191dfa98c60977e95f911119a9044d92c75d3980d77571793e766f8aef8c2bf"}
Jul 13 19:30:11.423925 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:11.423908    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"
Jul 13 19:30:11.425062 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:11.425035    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzv9n" event={"ID":"ef79a2a0-c323-4350-8807-bb6ffe252c05","Type":"ContainerStarted","Data":"52c327d034b8be1a5b85009346bc16b8ac34c365c744943a716980bb21d184a1"}
Jul 13 19:30:11.428753 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:11.428733    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w"
Jul 13 19:30:11.440607 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:11.440556    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-b6s5w" podStartSLOduration=2.116467187 podStartE2EDuration="3.440543175s" totalImagesPullingTime="1.324075988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:30:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:11.439578372 +0000 UTC m=+284.440068932" watchObservedRunningTime="2026-07-13 19:30:11.440543175 +0000 UTC m=+284.441033735"
Jul 13 19:30:12.893369 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:12.893324    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:30:12.895910 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:12.895890    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7768e8b8-d5bd-461a-8fbb-694332e9c6a5-metrics-tls\") pod \"dns-default-52dqm\" (UID: \"7768e8b8-d5bd-461a-8fbb-694332e9c6a5\") " pod="openshift-dns/dns-default-52dqm"
Jul 13 19:30:13.018637 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:13.018607    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nf5fn\""
Jul 13 19:30:13.027042 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:13.027018    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-52dqm"
Jul 13 19:30:13.170771 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:13.170736    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-52dqm"]
Jul 13 19:30:13.173858 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:30:13.173829    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7768e8b8_d5bd_461a_8fbb_694332e9c6a5.slice/crio-7bc932446c73baf61a248adef3cf871b527c0e5bb42997f03233ab18735e6082 WatchSource:0}: Error finding container 7bc932446c73baf61a248adef3cf871b527c0e5bb42997f03233ab18735e6082: Status 404 returned error can't find the container with id 7bc932446c73baf61a248adef3cf871b527c0e5bb42997f03233ab18735e6082
Jul 13 19:30:13.432789 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:13.432701    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-52dqm" event={"ID":"7768e8b8-d5bd-461a-8fbb-694332e9c6a5","Type":"ContainerStarted","Data":"7bc932446c73baf61a248adef3cf871b527c0e5bb42997f03233ab18735e6082"}
Jul 13 19:30:18.453970 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:18.453930    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-52dqm" event={"ID":"7768e8b8-d5bd-461a-8fbb-694332e9c6a5","Type":"ContainerStarted","Data":"9bb2c99c5d647ba05ad7e02eaee2f7439fdbf361688cb6c87400d76c06c84031"}
Jul 13 19:30:18.454364 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:18.454092    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-52dqm"
Jul 13 19:30:18.454364 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:18.454140    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-52dqm" event={"ID":"7768e8b8-d5bd-461a-8fbb-694332e9c6a5","Type":"ContainerStarted","Data":"91d21a008b33ff1261f5c290fd048675e218a68a66fbf10ab007b184c517cc4a"}
Jul 13 19:30:18.455256 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:18.455236    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzv9n" event={"ID":"ef79a2a0-c323-4350-8807-bb6ffe252c05","Type":"ContainerStarted","Data":"f70b04fd957afb74fd122b1c38a751cdea5725ff3aa8a30828adb90ed895ee79"}
Jul 13 19:30:18.471716 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:18.471658    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-52dqm" podStartSLOduration=251.943825547 podStartE2EDuration="4m16.47163687s" totalImagesPullingTime="4.527811323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:18.471122548 +0000 UTC m=+291.471613108" watchObservedRunningTime="2026-07-13 19:30:18.47163687 +0000 UTC m=+291.472127466"
Jul 13 19:30:19.459908 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:19.459869    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzv9n" event={"ID":"ef79a2a0-c323-4350-8807-bb6ffe252c05","Type":"ContainerStarted","Data":"98e833a43ee8f1c1ea15e76ee34009802d34e496b78dbc99ccd842580935d45d"}
Jul 13 19:30:22.399236 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:22.399204    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d7c594c84-pk6jl"
Jul 13 19:30:24.478508 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:24.478469    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nzv9n" event={"ID":"ef79a2a0-c323-4350-8807-bb6ffe252c05","Type":"ContainerStarted","Data":"b35eca04b7626d00d193e4d42ede21c5bb552c5c504caffe37d864461205816d"}
Jul 13 19:30:24.495420 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:24.495367    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nzv9n" podStartSLOduration=33.631425134 podStartE2EDuration="46.495351444s" totalImagesPullingTime="12.86392631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 19:29:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:24.495114738 +0000 UTC m=+297.495605301" watchObservedRunningTime="2026-07-13 19:30:24.495351444 +0000 UTC m=+297.495842004"
Jul 13 19:30:24.539407 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:24.539368    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4lsrh" podUID="1a004020-e409-46a4-8bab-8e560b477812"
Jul 13 19:30:27.371344 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.371312    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:30:27.371872 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.371325    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:30:27.387236 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.387214    2550 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 19:30:27.459297 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.459264    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sjxw9"]
Jul 13 19:30:27.462578 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.462549    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"]
Jul 13 19:30:27.462739 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.462683    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.465572 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.465547    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.466144 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.466113    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 19:30:27.466247 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.466199    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wgvr4\""
Jul 13 19:30:27.466337 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.466318    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 19:30:27.466404 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.466389    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 19:30:27.466456 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.466389    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 19:30:27.466498 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.466460    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 19:30:27.467360 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.467344    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 19:30:27.468616 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.468595    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 13 19:30:27.468711 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.468659    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tq8jv\""
Jul 13 19:30:27.468882 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.468863    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 13 19:30:27.468986 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.468864    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 13 19:30:27.475167 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.475144    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"]
Jul 13 19:30:27.511995 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.511967    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3600f7f8-8b8d-4129-83d0-b8d24172c46c-root\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.512197 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512005    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-wtmp\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.512197 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512034    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.512197 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512058    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvjhx\" (UniqueName: \"kubernetes.io/projected/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-api-access-fvjhx\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.512197 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512078    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/400b2960-9f92-46fb-a078-e7c7b93f15d8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.512197 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512105    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-tls\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.512197 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512133    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.512419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512215    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqppv\" (UniqueName: \"kubernetes.io/projected/3600f7f8-8b8d-4129-83d0-b8d24172c46c-kube-api-access-zqppv\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.512419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512247    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.512419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512273    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/400b2960-9f92-46fb-a078-e7c7b93f15d8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.512419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512311    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3600f7f8-8b8d-4129-83d0-b8d24172c46c-metrics-client-ca\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.512419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512337    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.512419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512359    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-textfile\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.512419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512384    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.512419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.512402    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3600f7f8-8b8d-4129-83d0-b8d24172c46c-sys\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.613113 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.612960    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-tls\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.613113 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613000    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.613113 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:27.613102    2550 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 13 19:30:27.613113 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:27.613105    2550 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613128    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqppv\" (UniqueName: \"kubernetes.io/projected/3600f7f8-8b8d-4129-83d0-b8d24172c46c-kube-api-access-zqppv\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:27.613148    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-tls podName:400b2960-9f92-46fb-a078-e7c7b93f15d8 nodeName:}" failed. No retries permitted until 2026-07-13 19:30:28.113133689 +0000 UTC m=+301.113624227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-sjbxl" (UID: "400b2960-9f92-46fb-a078-e7c7b93f15d8") : secret "kube-state-metrics-tls" not found
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:27.613181    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-tls podName:3600f7f8-8b8d-4129-83d0-b8d24172c46c nodeName:}" failed. No retries permitted until 2026-07-13 19:30:28.113154901 +0000 UTC m=+301.113645440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-tls") pod "node-exporter-sjxw9" (UID: "3600f7f8-8b8d-4129-83d0-b8d24172c46c") : secret "node-exporter-tls" not found
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613218    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613239    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/400b2960-9f92-46fb-a078-e7c7b93f15d8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613264    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3600f7f8-8b8d-4129-83d0-b8d24172c46c-metrics-client-ca\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613319    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613350    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-textfile\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613385    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613412    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3600f7f8-8b8d-4129-83d0-b8d24172c46c-sys\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613444    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3600f7f8-8b8d-4129-83d0-b8d24172c46c-root\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613472    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-wtmp\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613498    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613517    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3600f7f8-8b8d-4129-83d0-b8d24172c46c-sys\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.620624 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613522    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvjhx\" (UniqueName: \"kubernetes.io/projected/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-api-access-fvjhx\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613595    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/400b2960-9f92-46fb-a078-e7c7b93f15d8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613665    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/400b2960-9f92-46fb-a078-e7c7b93f15d8-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613725    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-textfile\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613839    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-wtmp\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613889    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3600f7f8-8b8d-4129-83d0-b8d24172c46c-root\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.613945    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-accelerators-collector-config\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.614050    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3600f7f8-8b8d-4129-83d0-b8d24172c46c-metrics-client-ca\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.614059    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.614312    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/400b2960-9f92-46fb-a078-e7c7b93f15d8-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.616044    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.621281 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.616103    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:27.622278 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.622227    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqppv\" (UniqueName: \"kubernetes.io/projected/3600f7f8-8b8d-4129-83d0-b8d24172c46c-kube-api-access-zqppv\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:27.622447 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:27.622432    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvjhx\" (UniqueName: \"kubernetes.io/projected/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-api-access-fvjhx\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:28.117970 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.117931    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-tls\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:28.117970 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.117975    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:28.120431 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.120397    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3600f7f8-8b8d-4129-83d0-b8d24172c46c-node-exporter-tls\") pod \"node-exporter-sjxw9\" (UID: \"3600f7f8-8b8d-4129-83d0-b8d24172c46c\") " pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:28.120574 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.120550    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/400b2960-9f92-46fb-a078-e7c7b93f15d8-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-sjbxl\" (UID: \"400b2960-9f92-46fb-a078-e7c7b93f15d8\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:28.373000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.372917    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sjxw9"
Jul 13 19:30:28.380047 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.380014    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"
Jul 13 19:30:28.387510 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:30:28.387481    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3600f7f8_8b8d_4129_83d0_b8d24172c46c.slice/crio-acb1da8cb30a16751721c05395deb56de57a94a9b08994eea12223b72247f26f WatchSource:0}: Error finding container acb1da8cb30a16751721c05395deb56de57a94a9b08994eea12223b72247f26f: Status 404 returned error can't find the container with id acb1da8cb30a16751721c05395deb56de57a94a9b08994eea12223b72247f26f
Jul 13 19:30:28.463168 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.462611    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-52dqm"
Jul 13 19:30:28.493154 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.493125    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjxw9" event={"ID":"3600f7f8-8b8d-4129-83d0-b8d24172c46c","Type":"ContainerStarted","Data":"acb1da8cb30a16751721c05395deb56de57a94a9b08994eea12223b72247f26f"}
Jul 13 19:30:28.504852 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.504821    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 19:30:28.510135 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.510108    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.513063 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.513038    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 13 19:30:28.513530 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.513257    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 13 19:30:28.513530 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.513278    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 13 19:30:28.513530 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.513306    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 13 19:30:28.513530 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.513328    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 13 19:30:28.513530 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.513278    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 13 19:30:28.513530 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.513278    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 13 19:30:28.513530 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.513403    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 13 19:30:28.513530 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.513333    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 13 19:30:28.513530 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.513513    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-v7h4q\""
Jul 13 19:30:28.520848 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.520827    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-sjbxl"]
Jul 13 19:30:28.520923 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.520799    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.520923 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.520915    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-config-volume\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521025 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.520937    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63cef965-9f90-4862-9408-ba19b9c3f055-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521025 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.520981    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63cef965-9f90-4862-9408-ba19b9c3f055-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521025 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.521016    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521177 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.521040    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521177 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.521089    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cef965-9f90-4862-9408-ba19b9c3f055-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521177 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.521115    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521177 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.521147    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hln29\" (UniqueName: \"kubernetes.io/projected/63cef965-9f90-4862-9408-ba19b9c3f055-kube-api-access-hln29\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521496 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.521241    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-web-config\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521496 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.521296    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63cef965-9f90-4862-9408-ba19b9c3f055-config-out\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521496 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.521334    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cef965-9f90-4862-9408-ba19b9c3f055-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.521496 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.521399    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.526365 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.525753    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 19:30:28.622117 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.622082    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.622372 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.622122    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.622372 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.622143    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cef965-9f90-4862-9408-ba19b9c3f055-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.622372 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.622161    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.622372 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.622185    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hln29\" (UniqueName: \"kubernetes.io/projected/63cef965-9f90-4862-9408-ba19b9c3f055-kube-api-access-hln29\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.622372 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.622217    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-web-config\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.622668 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:30:28.622328    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63cef965-9f90-4862-9408-ba19b9c3f055-alertmanager-trusted-ca-bundle podName:63cef965-9f90-4862-9408-ba19b9c3f055 nodeName:}" failed. No retries permitted until 2026-07-13 19:30:29.122302548 +0000 UTC m=+302.122793093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/63cef965-9f90-4862-9408-ba19b9c3f055-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "63cef965-9f90-4862-9408-ba19b9c3f055") : configmap references non-existent config key: ca-bundle.crt
Jul 13 19:30:28.622668 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.622659    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63cef965-9f90-4862-9408-ba19b9c3f055-config-out\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.622820 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.622694    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cef965-9f90-4862-9408-ba19b9c3f055-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.622820 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.622742    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.623392 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.623328    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.623392 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.623381    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-config-volume\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.623547 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.623408    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63cef965-9f90-4862-9408-ba19b9c3f055-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.623547 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.623465    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63cef965-9f90-4862-9408-ba19b9c3f055-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.623547 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.623510    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63cef965-9f90-4862-9408-ba19b9c3f055-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.624311 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.623978    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63cef965-9f90-4862-9408-ba19b9c3f055-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.625361 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.625258    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.625467 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.625403    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.626106 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.626081    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.626658 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.626597    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-web-config\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.626861 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.626788    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.627026 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.627001    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63cef965-9f90-4862-9408-ba19b9c3f055-config-out\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.628123 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.628101    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.628221 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.628210    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63cef965-9f90-4862-9408-ba19b9c3f055-config-volume\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.628317 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.628283    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63cef965-9f90-4862-9408-ba19b9c3f055-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:28.630631 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:28.630611    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hln29\" (UniqueName: \"kubernetes.io/projected/63cef965-9f90-4862-9408-ba19b9c3f055-kube-api-access-hln29\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:29.128291 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:29.128248    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cef965-9f90-4862-9408-ba19b9c3f055-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:29.129190 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:29.129156    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63cef965-9f90-4862-9408-ba19b9c3f055-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63cef965-9f90-4862-9408-ba19b9c3f055\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:29.420292 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:29.420265    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 13 19:30:29.501430 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:29.501389    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjxw9" event={"ID":"3600f7f8-8b8d-4129-83d0-b8d24172c46c","Type":"ContainerStarted","Data":"1af2aa1186beecd927ab0485fcbadd7aec88e6ef6c97fbf36c3f6174cb38f1ee"}
Jul 13 19:30:29.503396 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:29.503366    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl" event={"ID":"400b2960-9f92-46fb-a078-e7c7b93f15d8","Type":"ContainerStarted","Data":"3b7789084ed2542c3167c288bad58d066fcd05d513a7dee46f45b401c3c962d4"}
Jul 13 19:30:29.575969 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:29.575939    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 13 19:30:29.577293 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:30:29.577266    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cef965_9f90_4862_9408_ba19b9c3f055.slice/crio-b0622eea749bee32b743498e332f15b5d7f2f3dcc5d8fb7c1ee65ce4ff553e84 WatchSource:0}: Error finding container b0622eea749bee32b743498e332f15b5d7f2f3dcc5d8fb7c1ee65ce4ff553e84: Status 404 returned error can't find the container with id b0622eea749bee32b743498e332f15b5d7f2f3dcc5d8fb7c1ee65ce4ff553e84
Jul 13 19:30:29.579533 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:29.579513    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:30:30.508976 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:30.508938    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63cef965-9f90-4862-9408-ba19b9c3f055","Type":"ContainerStarted","Data":"b0622eea749bee32b743498e332f15b5d7f2f3dcc5d8fb7c1ee65ce4ff553e84"}
Jul 13 19:30:30.510645 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:30.510615    2550 generic.go:356] "Generic (PLEG): container finished" podID="3600f7f8-8b8d-4129-83d0-b8d24172c46c" containerID="1af2aa1186beecd927ab0485fcbadd7aec88e6ef6c97fbf36c3f6174cb38f1ee" exitCode=0
Jul 13 19:30:30.510780 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:30.510692    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjxw9" event={"ID":"3600f7f8-8b8d-4129-83d0-b8d24172c46c","Type":"ContainerDied","Data":"1af2aa1186beecd927ab0485fcbadd7aec88e6ef6c97fbf36c3f6174cb38f1ee"}
Jul 13 19:30:30.513485 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:30.513415    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl" event={"ID":"400b2960-9f92-46fb-a078-e7c7b93f15d8","Type":"ContainerStarted","Data":"ea686e57b4817c973c5fb8b31edabb738db70386a60af09ada02905b54cb140c"}
Jul 13 19:30:30.513485 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:30.513472    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl" event={"ID":"400b2960-9f92-46fb-a078-e7c7b93f15d8","Type":"ContainerStarted","Data":"f30009803e125e9df3b47a7afa081ad8792ad0f2c9759f8f178794881827359d"}
Jul 13 19:30:30.513659 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:30.513504    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl" event={"ID":"400b2960-9f92-46fb-a078-e7c7b93f15d8","Type":"ContainerStarted","Data":"c243dd7d2609bce8711f68a6dfb51d0d95ac2ccd7c25c245d4c87863eb222fee"}
Jul 13 19:30:30.545736 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:30.545691    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-sjbxl" podStartSLOduration=1.947633985 podStartE2EDuration="3.545675754s" totalImagesPullingTime="1.598041769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:30.545043207 +0000 UTC m=+303.545533768" watchObservedRunningTime="2026-07-13 19:30:30.545675754 +0000 UTC m=+303.546166314"
Jul 13 19:30:31.518437 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:31.518407    2550 generic.go:356] "Generic (PLEG): container finished" podID="63cef965-9f90-4862-9408-ba19b9c3f055" containerID="52e359fdc373f084ea8783ced68e6fbe010ff36059e7a5a28a23b47fc680f654" exitCode=0
Jul 13 19:30:31.518930 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:31.518501    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63cef965-9f90-4862-9408-ba19b9c3f055","Type":"ContainerDied","Data":"52e359fdc373f084ea8783ced68e6fbe010ff36059e7a5a28a23b47fc680f654"}
Jul 13 19:30:31.520716 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:31.520694    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjxw9" event={"ID":"3600f7f8-8b8d-4129-83d0-b8d24172c46c","Type":"ContainerStarted","Data":"51b97772004a45b0d7c95f64a59f25def18fbb476e42c4bbc86e26937f21f0d1"}
Jul 13 19:30:31.520788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:31.520736    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sjxw9" event={"ID":"3600f7f8-8b8d-4129-83d0-b8d24172c46c","Type":"ContainerStarted","Data":"2f519465f7de23f08dc4544b0ee88ab99dd3f3e04aa74fe11def09e875d6b622"}
Jul 13 19:30:31.579715 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:31.579665    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sjxw9" podStartSLOduration=3.545017812 podStartE2EDuration="4.579646451s" totalImagesPullingTime="953.86684ms" totalInitContainerRuntime="80.761799ms" isStatefulPod=true podCreationTimestamp="2026-07-13 19:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:31.578582212 +0000 UTC m=+304.579072762" watchObservedRunningTime="2026-07-13 19:30:31.579646451 +0000 UTC m=+304.580137049"
Jul 13 19:30:32.238702 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.238665    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"]
Jul 13 19:30:32.242074 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.242046    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"
Jul 13 19:30:32.244789 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.244764    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 13 19:30:32.244926 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.244823    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hczsp\""
Jul 13 19:30:32.253179 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.253158    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"]
Jul 13 19:30:32.259334 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.259307    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npcc9\" (UniqueName: \"kubernetes.io/projected/f66364ef-e434-4389-80bf-6846db17b248-kube-api-access-npcc9\") pod \"monitoring-plugin-5f68df7f58-7tpbl\" (UID: \"f66364ef-e434-4389-80bf-6846db17b248\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"
Jul 13 19:30:32.259496 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.259369    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f66364ef-e434-4389-80bf-6846db17b248-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-7tpbl\" (UID: \"f66364ef-e434-4389-80bf-6846db17b248\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"
Jul 13 19:30:32.360005 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.359966    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f66364ef-e434-4389-80bf-6846db17b248-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-7tpbl\" (UID: \"f66364ef-e434-4389-80bf-6846db17b248\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"
Jul 13 19:30:32.360184 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.360049    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npcc9\" (UniqueName: \"kubernetes.io/projected/f66364ef-e434-4389-80bf-6846db17b248-kube-api-access-npcc9\") pod \"monitoring-plugin-5f68df7f58-7tpbl\" (UID: \"f66364ef-e434-4389-80bf-6846db17b248\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"
Jul 13 19:30:32.362979 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.362939    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f66364ef-e434-4389-80bf-6846db17b248-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-7tpbl\" (UID: \"f66364ef-e434-4389-80bf-6846db17b248\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"
Jul 13 19:30:32.369985 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.369946    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npcc9\" (UniqueName: \"kubernetes.io/projected/f66364ef-e434-4389-80bf-6846db17b248-kube-api-access-npcc9\") pod \"monitoring-plugin-5f68df7f58-7tpbl\" (UID: \"f66364ef-e434-4389-80bf-6846db17b248\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"
Jul 13 19:30:32.548755 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.548669    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"]
Jul 13 19:30:32.551329 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.551298    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"
Jul 13 19:30:32.552232 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.552211    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.555051 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.554990    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 13 19:30:32.555051 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.554990    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 13 19:30:32.555220 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.555055    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 13 19:30:32.555220 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.555225    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 13 19:30:32.555372 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.555347    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 13 19:30:32.555372 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.555367    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ngtlk\""
Jul 13 19:30:32.560086 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.560062    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 13 19:30:32.567466 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.567442    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"]
Jul 13 19:30:32.662878 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.662849    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-secret-telemeter-client\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.662878 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.662892    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e21d8f1-81a4-4f34-be01-4701818ef7a6-serving-certs-ca-bundle\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.663086 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.662924    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-federate-client-tls\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.663086 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.663000    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-telemeter-client-tls\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.663086 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.663065    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e21d8f1-81a4-4f34-be01-4701818ef7a6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.663199 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.663133    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.663199 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.663169    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e21d8f1-81a4-4f34-be01-4701818ef7a6-metrics-client-ca\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.663268 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.663249    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znjhc\" (UniqueName: \"kubernetes.io/projected/4e21d8f1-81a4-4f34-be01-4701818ef7a6-kube-api-access-znjhc\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.689914 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.689887    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"]
Jul 13 19:30:32.692958 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:30:32.692931    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf66364ef_e434_4389_80bf_6846db17b248.slice/crio-1c90e11cd774f2d4c9d752aca046a04c8b7db4b77be20c5c7930f77308c05472 WatchSource:0}: Error finding container 1c90e11cd774f2d4c9d752aca046a04c8b7db4b77be20c5c7930f77308c05472: Status 404 returned error can't find the container with id 1c90e11cd774f2d4c9d752aca046a04c8b7db4b77be20c5c7930f77308c05472
Jul 13 19:30:32.763694 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.763650    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e21d8f1-81a4-4f34-be01-4701818ef7a6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.763694 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.763699    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.763981 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.763843    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e21d8f1-81a4-4f34-be01-4701818ef7a6-metrics-client-ca\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.763981 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.763903    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znjhc\" (UniqueName: \"kubernetes.io/projected/4e21d8f1-81a4-4f34-be01-4701818ef7a6-kube-api-access-znjhc\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.763981 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.763945    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-secret-telemeter-client\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.763981 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.763971    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e21d8f1-81a4-4f34-be01-4701818ef7a6-serving-certs-ca-bundle\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.764177 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.764004    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-federate-client-tls\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.764177 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.764031    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-telemeter-client-tls\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.764598 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.764574    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e21d8f1-81a4-4f34-be01-4701818ef7a6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.764728 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.764621    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e21d8f1-81a4-4f34-be01-4701818ef7a6-metrics-client-ca\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.764728 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.764691    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e21d8f1-81a4-4f34-be01-4701818ef7a6-serving-certs-ca-bundle\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.767077 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.767048    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.767204 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.767172    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-federate-client-tls\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.767204 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.767176    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-telemeter-client-tls\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.767309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.767250    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e21d8f1-81a4-4f34-be01-4701818ef7a6-secret-telemeter-client\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.772383 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.772360    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znjhc\" (UniqueName: \"kubernetes.io/projected/4e21d8f1-81a4-4f34-be01-4701818ef7a6-kube-api-access-znjhc\") pod \"telemeter-client-7c6c8f4664-p4xnf\" (UID: \"4e21d8f1-81a4-4f34-be01-4701818ef7a6\") " pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:32.879571 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:32.879465    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"
Jul 13 19:30:33.016914 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.016882    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf"]
Jul 13 19:30:33.020421 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:30:33.020380    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e21d8f1_81a4_4f34_be01_4701818ef7a6.slice/crio-3e57d4b409e1386dcbaded0b91d030e47e19ad2f2f6cdacff06f8c4fd9034fe9 WatchSource:0}: Error finding container 3e57d4b409e1386dcbaded0b91d030e47e19ad2f2f6cdacff06f8c4fd9034fe9: Status 404 returned error can't find the container with id 3e57d4b409e1386dcbaded0b91d030e47e19ad2f2f6cdacff06f8c4fd9034fe9
Jul 13 19:30:33.531797 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.531757    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf" event={"ID":"4e21d8f1-81a4-4f34-be01-4701818ef7a6","Type":"ContainerStarted","Data":"3e57d4b409e1386dcbaded0b91d030e47e19ad2f2f6cdacff06f8c4fd9034fe9"}
Jul 13 19:30:33.533605 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.533580    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl" event={"ID":"f66364ef-e434-4389-80bf-6846db17b248","Type":"ContainerStarted","Data":"1c90e11cd774f2d4c9d752aca046a04c8b7db4b77be20c5c7930f77308c05472"}
Jul 13 19:30:33.640996 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.640941    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 19:30:33.645284 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.645256    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.648199 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.648172    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 19:30:33.650286 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.650263    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 19:30:33.650286 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.650285    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 19:30:33.650554 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.650406    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 19:30:33.650554 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.650534    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 19:30:33.651683 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.651514    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4u8fp85aq4p56\""
Jul 13 19:30:33.651923 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.651903    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 19:30:33.652011 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.651931    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qf2qf\""
Jul 13 19:30:33.652148 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.652129    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 19:30:33.652148 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.652139    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 19:30:33.652704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.652513    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 19:30:33.652704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.652570    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 19:30:33.652704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.652613    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 19:30:33.652945 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.652711    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 19:30:33.653782 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.653180    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 19:30:33.653782 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.653393    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 19:30:33.660395 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.660373    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 19:30:33.671444 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671416    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671569 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671466    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671569 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671492    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671569 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671522    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671569 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671548    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671607    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671633    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671661    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671707    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/628d8f49-e69d-48f3-895b-2612e26adf2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671741    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671759    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671773    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.671788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671788    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb7l7\" (UniqueName: \"kubernetes.io/projected/628d8f49-e69d-48f3-895b-2612e26adf2c-kube-api-access-nb7l7\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.672194 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671837    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.672194 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671887    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.672194 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671924    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/628d8f49-e69d-48f3-895b-2612e26adf2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.672194 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.671965    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.672194 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.672013    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.672194 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.672058    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.672194 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.672101    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-config\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.686944 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.684559    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 19:30:33.773217 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773177    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773232    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773261    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773285    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb7l7\" (UniqueName: \"kubernetes.io/projected/628d8f49-e69d-48f3-895b-2612e26adf2c-kube-api-access-nb7l7\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773313    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773338    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773355    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/628d8f49-e69d-48f3-895b-2612e26adf2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773378    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773401    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773419    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773436    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-config\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773464    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773487    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773502    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773518    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773536    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773559    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773583    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773602    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.773691 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.773617    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/628d8f49-e69d-48f3-895b-2612e26adf2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.774756 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.774723    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.777236 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.777203    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.777573 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.777407    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.777708 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.777666    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.778693 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.778342    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.778693 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.778407    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.778693 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.778683    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/628d8f49-e69d-48f3-895b-2612e26adf2c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.779134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.779101    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/628d8f49-e69d-48f3-895b-2612e26adf2c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.780366 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.780339    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-web-config\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.783400 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.783342    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.783952 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.783925    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.784951 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.784503    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/628d8f49-e69d-48f3-895b-2612e26adf2c-config-out\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.784951 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.784720    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.784951 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.784865    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.784951 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.784909    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-config\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.785518 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.785491    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.786664 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.786363    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.786744 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.786695    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/628d8f49-e69d-48f3-895b-2612e26adf2c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.787361 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.787319    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb7l7\" (UniqueName: \"kubernetes.io/projected/628d8f49-e69d-48f3-895b-2612e26adf2c-kube-api-access-nb7l7\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.787447 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.787391    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/628d8f49-e69d-48f3-895b-2612e26adf2c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"628d8f49-e69d-48f3-895b-2612e26adf2c\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:33.958964 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:33.958928    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:30:34.733268 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:34.733245    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 19:30:35.124784 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:30:35.124737    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628d8f49_e69d_48f3_895b_2612e26adf2c.slice/crio-ef22cd2560ab5640898dde10d75e8b839dfbed4c42c957f0ae85130a8802e4ab WatchSource:0}: Error finding container ef22cd2560ab5640898dde10d75e8b839dfbed4c42c957f0ae85130a8802e4ab: Status 404 returned error can't find the container with id ef22cd2560ab5640898dde10d75e8b839dfbed4c42c957f0ae85130a8802e4ab
Jul 13 19:30:35.544458 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.544422    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf" event={"ID":"4e21d8f1-81a4-4f34-be01-4701818ef7a6","Type":"ContainerStarted","Data":"b6a16951c25b0e2ff4d60215978590d7a6bfbf5e707cb5d530857c7938c96188"}
Jul 13 19:30:35.544620 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.544478    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf" event={"ID":"4e21d8f1-81a4-4f34-be01-4701818ef7a6","Type":"ContainerStarted","Data":"5bbc25e55aff847dd9458c4fc36f6c4f2e540c6fa9d0864c5dc16a8b42d686c0"}
Jul 13 19:30:35.544620 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.544507    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf" event={"ID":"4e21d8f1-81a4-4f34-be01-4701818ef7a6","Type":"ContainerStarted","Data":"ffac442d068a8ef672842151648c8a2abfaf6c1f3066089130cbff074a7b716b"}
Jul 13 19:30:35.545996 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.545964    2550 generic.go:356] "Generic (PLEG): container finished" podID="628d8f49-e69d-48f3-895b-2612e26adf2c" containerID="41182808f5478db380733daa1361e34e71cc0c5364983f723c00a43b970f34df" exitCode=0
Jul 13 19:30:35.546123 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.546041    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"628d8f49-e69d-48f3-895b-2612e26adf2c","Type":"ContainerDied","Data":"41182808f5478db380733daa1361e34e71cc0c5364983f723c00a43b970f34df"}
Jul 13 19:30:35.546123 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.546098    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"628d8f49-e69d-48f3-895b-2612e26adf2c","Type":"ContainerStarted","Data":"ef22cd2560ab5640898dde10d75e8b839dfbed4c42c957f0ae85130a8802e4ab"}
Jul 13 19:30:35.547561 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.547539    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl" event={"ID":"f66364ef-e434-4389-80bf-6846db17b248","Type":"ContainerStarted","Data":"0891a9f1407b4ebe70a07978ad42402e9e7ab7425c6fd69cb90934c99a0f11ea"}
Jul 13 19:30:35.547760 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.547739    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"
Jul 13 19:30:35.551390 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.551361    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63cef965-9f90-4862-9408-ba19b9c3f055","Type":"ContainerStarted","Data":"417122cfa3be42cb16a63177a605251d634c7aa2e56119a692ed71f81a4f747e"}
Jul 13 19:30:35.551478 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.551421    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63cef965-9f90-4862-9408-ba19b9c3f055","Type":"ContainerStarted","Data":"38906225e8d1a735caaba5decc9786b0eef36f9f5bc4c439f7b4cf06b74bf5af"}
Jul 13 19:30:35.551478 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.551464    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63cef965-9f90-4862-9408-ba19b9c3f055","Type":"ContainerStarted","Data":"2245cd88221131005cf2e1d8c8405d21f850c9cad37056e3860c69681991b27b"}
Jul 13 19:30:35.551579 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.551501    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63cef965-9f90-4862-9408-ba19b9c3f055","Type":"ContainerStarted","Data":"f08e9f1d3a87b67e03ac6b0ac99b727a3db6743f73d32ea701be90133934df3a"}
Jul 13 19:30:35.551579 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.551541    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63cef965-9f90-4862-9408-ba19b9c3f055","Type":"ContainerStarted","Data":"30500ebcd04cf96d80b282cab1389797651aee84b7e227a1959809c1aacb4c93"}
Jul 13 19:30:35.553292 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.553273    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl"
Jul 13 19:30:35.593854 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.593781    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c6c8f4664-p4xnf" podStartSLOduration=1.428081588 podStartE2EDuration="3.593763798s" totalImagesPullingTime="2.16568221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:35.573261015 +0000 UTC m=+308.573751576" watchObservedRunningTime="2026-07-13 19:30:35.593763798 +0000 UTC m=+308.594254357"
Jul 13 19:30:35.594125 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:35.594083    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-7tpbl" podStartSLOduration=1.70905594 podStartE2EDuration="3.594076055s" totalImagesPullingTime="1.885020115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:35.593305374 +0000 UTC m=+308.593795929" watchObservedRunningTime="2026-07-13 19:30:35.594076055 +0000 UTC m=+308.594566615"
Jul 13 19:30:38.577447 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:38.577408    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63cef965-9f90-4862-9408-ba19b9c3f055","Type":"ContainerStarted","Data":"79e104b57bf1ff667e6728fb6d1e80345200cc68d04a5bf045546c5f33ef71ef"}
Jul 13 19:30:38.604733 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:38.604665    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.06962673 podStartE2EDuration="10.60464747s" totalImagesPullingTime="6.520147223s" totalInitContainerRuntime="14.873517ms" isStatefulPod=false podCreationTimestamp="2026-07-13 19:30:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:38.603051886 +0000 UTC m=+311.603542458" watchObservedRunningTime="2026-07-13 19:30:38.60464747 +0000 UTC m=+311.605138030"
Jul 13 19:30:39.539426 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:39.539319    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:30:39.584097 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:39.584062    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"628d8f49-e69d-48f3-895b-2612e26adf2c","Type":"ContainerStarted","Data":"897e98f56fa653eac617cd517a4cccf0cbf35edac3b80e979806aa8e3945b3c2"}
Jul 13 19:30:39.584463 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:39.584145    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"628d8f49-e69d-48f3-895b-2612e26adf2c","Type":"ContainerStarted","Data":"1a3909bebe2f7567254849d4aef1c88d72c8255a0e4ef61c6499383505f728e6"}
Jul 13 19:30:41.596141 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:41.596110    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"628d8f49-e69d-48f3-895b-2612e26adf2c","Type":"ContainerStarted","Data":"b5f18dc5ce61196fadb5e060cc9c82116b92c0030bdf125d2b6fbf3a26c1a7c7"}
Jul 13 19:30:41.596511 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:41.596169    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"628d8f49-e69d-48f3-895b-2612e26adf2c","Type":"ContainerStarted","Data":"26e43869d4a2755cd8f130395c43110f0ead635d776841ef4e3aecd92b7f91cb"}
Jul 13 19:30:41.596511 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:41.596195    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"628d8f49-e69d-48f3-895b-2612e26adf2c","Type":"ContainerStarted","Data":"36b39a2f4264b8bc39c4a8128668945b9b38050f4cdf8b15d5db9ea5c993c054"}
Jul 13 19:30:41.596511 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:41.596221    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"628d8f49-e69d-48f3-895b-2612e26adf2c","Type":"ContainerStarted","Data":"63556fe1f9ca159701f4424025e38ba4234546dd3172c4e2aaae31a0eb909ea2"}
Jul 13 19:30:41.646857 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:41.646793    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.102598752 podStartE2EDuration="8.646774992s" totalImagesPullingTime="5.518436584s" totalInitContainerRuntime="25.739656ms" isStatefulPod=false podCreationTimestamp="2026-07-13 19:30:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:30:41.645371355 +0000 UTC m=+314.645861918" watchObservedRunningTime="2026-07-13 19:30:41.646774992 +0000 UTC m=+314.647265551"
Jul 13 19:30:43.959121 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:30:43.959064    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:31:02.684380 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:02.684342    2550 generic.go:356] "Generic (PLEG): container finished" podID="05a15578-9262-4a21-9845-36c6773e7214" containerID="b3475069bc321767b491a7a87f1bec7e62e082a5814d4b00b0f872f3bc78e4c6" exitCode=0
Jul 13 19:31:02.684788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:02.684418    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm" event={"ID":"05a15578-9262-4a21-9845-36c6773e7214","Type":"ContainerDied","Data":"b3475069bc321767b491a7a87f1bec7e62e082a5814d4b00b0f872f3bc78e4c6"}
Jul 13 19:31:02.684788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:02.684750    2550 scope.go:117] "RemoveContainer" containerID="b3475069bc321767b491a7a87f1bec7e62e082a5814d4b00b0f872f3bc78e4c6"
Jul 13 19:31:03.689966 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:03.689929    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hgtvm" event={"ID":"05a15578-9262-4a21-9845-36c6773e7214","Type":"ContainerStarted","Data":"a19e3eee3bacc3da53569a6bed2c8da420828ecc669d32dbf27fa8ba5271dde1"}
Jul 13 19:31:33.959871 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:33.959780    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:31:33.980483 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:33.980458    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:31:34.838823 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:34.838776    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 19:31:41.505746 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:41.505700    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:31:41.508362 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:41.508333    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a004020-e409-46a4-8bab-8e560b477812-metrics-certs\") pod \"network-metrics-daemon-4lsrh\" (UID: \"1a004020-e409-46a4-8bab-8e560b477812\") " pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:31:41.643853 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:41.643792    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dzrsk\""
Jul 13 19:31:41.650650 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:41.650625    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lsrh"
Jul 13 19:31:41.790174 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:41.789999    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4lsrh"]
Jul 13 19:31:41.792836 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:31:41.792784    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a004020_e409_46a4_8bab_8e560b477812.slice/crio-c687c3ca4ea3212657f987a06afbe31e6b5a0ff43388ee8371d0517a14268834 WatchSource:0}: Error finding container c687c3ca4ea3212657f987a06afbe31e6b5a0ff43388ee8371d0517a14268834: Status 404 returned error can't find the container with id c687c3ca4ea3212657f987a06afbe31e6b5a0ff43388ee8371d0517a14268834
Jul 13 19:31:41.851612 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:41.851579    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lsrh" event={"ID":"1a004020-e409-46a4-8bab-8e560b477812","Type":"ContainerStarted","Data":"c687c3ca4ea3212657f987a06afbe31e6b5a0ff43388ee8371d0517a14268834"}
Jul 13 19:31:43.863141 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:43.863100    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lsrh" event={"ID":"1a004020-e409-46a4-8bab-8e560b477812","Type":"ContainerStarted","Data":"ad4d1068e7832e9d7a7d4dd0522bb73870fc88c626f0c17087a6ed40b8090c80"}
Jul 13 19:31:43.863533 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:43.863160    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lsrh" event={"ID":"1a004020-e409-46a4-8bab-8e560b477812","Type":"ContainerStarted","Data":"317aca78aa96038a00a430c4eced6174cc51df1a290df9ad670bc872ceb15fdd"}
Jul 13 19:31:43.880156 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:31:43.880106    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4lsrh" podStartSLOduration=374.637022701 podStartE2EDuration="6m15.880087219s" totalImagesPullingTime="1.243064518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:25:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:31:43.878601141 +0000 UTC m=+376.879091698" watchObservedRunningTime="2026-07-13 19:31:43.880087219 +0000 UTC m=+376.880577779"
Jul 13 19:34:04.833030 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.832995    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"]
Jul 13 19:34:04.836380 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.836354    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:04.841179 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.841154    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 19:34:04.841466 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.841446    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 19:34:04.841575 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.841524    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t9khf\""
Jul 13 19:34:04.841708 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.841663    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 19:34:04.841851 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.841750    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 19:34:04.855895 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.855865    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"]
Jul 13 19:34:04.952249 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.952214    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3481830-5625-4b05-8798-2d1267df65e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:04.952456 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.952266    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dqzj\" (UniqueName: \"kubernetes.io/projected/b3481830-5625-4b05-8798-2d1267df65e2-kube-api-access-8dqzj\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:04.952456 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.952305    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3481830-5625-4b05-8798-2d1267df65e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:04.952456 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.952342    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3481830-5625-4b05-8798-2d1267df65e2-tmp\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:04.952456 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:04.952369    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3481830-5625-4b05-8798-2d1267df65e2-manifests\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.053105 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.053069    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3481830-5625-4b05-8798-2d1267df65e2-manifests\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.053279 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.053173    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3481830-5625-4b05-8798-2d1267df65e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.053279 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.053218    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dqzj\" (UniqueName: \"kubernetes.io/projected/b3481830-5625-4b05-8798-2d1267df65e2-kube-api-access-8dqzj\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.053279 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.053264    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3481830-5625-4b05-8798-2d1267df65e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.053395 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.053286    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3481830-5625-4b05-8798-2d1267df65e2-tmp\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.053526 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.053504    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b3481830-5625-4b05-8798-2d1267df65e2-manifests\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.055815 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.055764    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3481830-5625-4b05-8798-2d1267df65e2-tmp\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.055966 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.055865    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b3481830-5625-4b05-8798-2d1267df65e2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.055966 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.055923    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3481830-5625-4b05-8798-2d1267df65e2-webhook-cert\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.064821 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.064772    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dqzj\" (UniqueName: \"kubernetes.io/projected/b3481830-5625-4b05-8798-2d1267df65e2-kube-api-access-8dqzj\") pod \"opendatahub-operator-controller-manager-699d4944b8-925qn\" (UID: \"b3481830-5625-4b05-8798-2d1267df65e2\") " pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.148659 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.148563    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:05.298551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.298524    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"]
Jul 13 19:34:05.302777 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:34:05.302752    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3481830_5625_4b05_8798_2d1267df65e2.slice/crio-b1b0e7383418ac3e634d879accacb09c7ee7435d7d4f59e4b270de398373bbf3 WatchSource:0}: Error finding container b1b0e7383418ac3e634d879accacb09c7ee7435d7d4f59e4b270de398373bbf3: Status 404 returned error can't find the container with id b1b0e7383418ac3e634d879accacb09c7ee7435d7d4f59e4b270de398373bbf3
Jul 13 19:34:05.441759 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:05.441720    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn" event={"ID":"b3481830-5625-4b05-8798-2d1267df65e2","Type":"ContainerStarted","Data":"b1b0e7383418ac3e634d879accacb09c7ee7435d7d4f59e4b270de398373bbf3"}
Jul 13 19:34:09.466633 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:09.466592    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn" event={"ID":"b3481830-5625-4b05-8798-2d1267df65e2","Type":"ContainerStarted","Data":"f149826c49e8cc139de68f8c845b6066ac00912f5f31ef6f50537bc0c1fe3ff7"}
Jul 13 19:34:10.474914 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:10.474873    2550 generic.go:356] "Generic (PLEG): container finished" podID="b3481830-5625-4b05-8798-2d1267df65e2" containerID="f149826c49e8cc139de68f8c845b6066ac00912f5f31ef6f50537bc0c1fe3ff7" exitCode=0
Jul 13 19:34:10.475332 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:10.474968    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn" event={"ID":"b3481830-5625-4b05-8798-2d1267df65e2","Type":"ContainerDied","Data":"f149826c49e8cc139de68f8c845b6066ac00912f5f31ef6f50537bc0c1fe3ff7"}
Jul 13 19:34:12.486047 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:12.486003    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn" event={"ID":"b3481830-5625-4b05-8798-2d1267df65e2","Type":"ContainerStarted","Data":"cb3974df06f9bd7e9783fde6ed7310c64c1bc1391e010ff9c4c11e638096bab1"}
Jul 13 19:34:12.486431 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:12.486130    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:12.509579 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:12.509520    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn" podStartSLOduration=2.368090409 podStartE2EDuration="8.509502414s" totalImagesPullingTime="5.022501261s" totalInitContainerRuntime="1.118910744s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:34:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:34:12.506767622 +0000 UTC m=+525.507258182" watchObservedRunningTime="2026-07-13 19:34:12.509502414 +0000 UTC m=+525.509992973"
Jul 13 19:34:23.493978 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:23.493895    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-699d4944b8-925qn"
Jul 13 19:34:35.116021 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.115981    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"]
Jul 13 19:34:35.122718 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.122697    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.126342 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.126314    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 19:34:35.127767 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.127744    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 19:34:35.127767 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.127762    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5pxxl\""
Jul 13 19:34:35.128007 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.127747    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 19:34:35.128007 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.127831    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 19:34:35.128007 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.127895    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 19:34:35.134642 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.134615    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"]
Jul 13 19:34:35.216029 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.215990    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqkpm\" (UniqueName: \"kubernetes.io/projected/ffc70d20-b203-4f33-a8ef-74c57e9c9113-kube-api-access-hqkpm\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.216029 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.216033    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffc70d20-b203-4f33-a8ef-74c57e9c9113-cert\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.216235 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.216126    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ffc70d20-b203-4f33-a8ef-74c57e9c9113-manager-config\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.216235 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.216177    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffc70d20-b203-4f33-a8ef-74c57e9c9113-metrics-cert\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.317367 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.317331    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffc70d20-b203-4f33-a8ef-74c57e9c9113-cert\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.317564 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.317390    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ffc70d20-b203-4f33-a8ef-74c57e9c9113-manager-config\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.317564 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.317447    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffc70d20-b203-4f33-a8ef-74c57e9c9113-metrics-cert\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.317564 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.317523    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqkpm\" (UniqueName: \"kubernetes.io/projected/ffc70d20-b203-4f33-a8ef-74c57e9c9113-kube-api-access-hqkpm\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.318310 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.318218    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ffc70d20-b203-4f33-a8ef-74c57e9c9113-manager-config\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.320058 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.320037    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffc70d20-b203-4f33-a8ef-74c57e9c9113-cert\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.320145 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.320121    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffc70d20-b203-4f33-a8ef-74c57e9c9113-metrics-cert\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.340257 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.340222    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqkpm\" (UniqueName: \"kubernetes.io/projected/ffc70d20-b203-4f33-a8ef-74c57e9c9113-kube-api-access-hqkpm\") pod \"lws-controller-manager-75894cfc5c-v7wvg\" (UID: \"ffc70d20-b203-4f33-a8ef-74c57e9c9113\") " pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.431842 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.431792    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:35.588754 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:35.588608    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"]
Jul 13 19:34:35.591717 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:34:35.591690    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffc70d20_b203_4f33_a8ef_74c57e9c9113.slice/crio-1318cd44151a6d1ae60858e2faa2dfd6e7abf6107a640c5ddcd1692a03674f7e WatchSource:0}: Error finding container 1318cd44151a6d1ae60858e2faa2dfd6e7abf6107a640c5ddcd1692a03674f7e: Status 404 returned error can't find the container with id 1318cd44151a6d1ae60858e2faa2dfd6e7abf6107a640c5ddcd1692a03674f7e
Jul 13 19:34:36.355066 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.354948    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"]
Jul 13 19:34:36.357731 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.357709    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.361974 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.361828    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 19:34:36.361974 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.361855    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 19:34:36.361974 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.361942    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 19:34:36.362211 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.362063    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m5s5p\""
Jul 13 19:34:36.362384 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.362302    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 19:34:36.374195 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.374126    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"]
Jul 13 19:34:36.430229 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.430192    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/803feb63-4162-41e0-8ceb-2aabdf98cc70-tmp\") pod \"kube-auth-proxy-6996ff5f69-q2gkk\" (UID: \"803feb63-4162-41e0-8ceb-2aabdf98cc70\") " pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.430534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.430270    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/803feb63-4162-41e0-8ceb-2aabdf98cc70-tls-certs\") pod \"kube-auth-proxy-6996ff5f69-q2gkk\" (UID: \"803feb63-4162-41e0-8ceb-2aabdf98cc70\") " pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.430534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.430513    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss6kk\" (UniqueName: \"kubernetes.io/projected/803feb63-4162-41e0-8ceb-2aabdf98cc70-kube-api-access-ss6kk\") pod \"kube-auth-proxy-6996ff5f69-q2gkk\" (UID: \"803feb63-4162-41e0-8ceb-2aabdf98cc70\") " pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.531855 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.531790    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss6kk\" (UniqueName: \"kubernetes.io/projected/803feb63-4162-41e0-8ceb-2aabdf98cc70-kube-api-access-ss6kk\") pod \"kube-auth-proxy-6996ff5f69-q2gkk\" (UID: \"803feb63-4162-41e0-8ceb-2aabdf98cc70\") " pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.532048 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.531885    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/803feb63-4162-41e0-8ceb-2aabdf98cc70-tmp\") pod \"kube-auth-proxy-6996ff5f69-q2gkk\" (UID: \"803feb63-4162-41e0-8ceb-2aabdf98cc70\") " pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.532048 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.531935    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/803feb63-4162-41e0-8ceb-2aabdf98cc70-tls-certs\") pod \"kube-auth-proxy-6996ff5f69-q2gkk\" (UID: \"803feb63-4162-41e0-8ceb-2aabdf98cc70\") " pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.534929 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.534880    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/803feb63-4162-41e0-8ceb-2aabdf98cc70-tmp\") pod \"kube-auth-proxy-6996ff5f69-q2gkk\" (UID: \"803feb63-4162-41e0-8ceb-2aabdf98cc70\") " pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.535074 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.535022    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/803feb63-4162-41e0-8ceb-2aabdf98cc70-tls-certs\") pod \"kube-auth-proxy-6996ff5f69-q2gkk\" (UID: \"803feb63-4162-41e0-8ceb-2aabdf98cc70\") " pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.541737 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.541698    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss6kk\" (UniqueName: \"kubernetes.io/projected/803feb63-4162-41e0-8ceb-2aabdf98cc70-kube-api-access-ss6kk\") pod \"kube-auth-proxy-6996ff5f69-q2gkk\" (UID: \"803feb63-4162-41e0-8ceb-2aabdf98cc70\") " pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.594666 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.594599    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg" event={"ID":"ffc70d20-b203-4f33-a8ef-74c57e9c9113","Type":"ContainerStarted","Data":"1318cd44151a6d1ae60858e2faa2dfd6e7abf6107a640c5ddcd1692a03674f7e"}
Jul 13 19:34:36.671529 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.671501    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"
Jul 13 19:34:36.832046 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:36.832018    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk"]
Jul 13 19:34:36.834346 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:34:36.834317    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803feb63_4162_41e0_8ceb_2aabdf98cc70.slice/crio-29a4907e0829f74268078ae4fd2ddd02d77cea1f86b8fd696cd9b204d42c6d84 WatchSource:0}: Error finding container 29a4907e0829f74268078ae4fd2ddd02d77cea1f86b8fd696cd9b204d42c6d84: Status 404 returned error can't find the container with id 29a4907e0829f74268078ae4fd2ddd02d77cea1f86b8fd696cd9b204d42c6d84
Jul 13 19:34:37.601106 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:37.601065    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk" event={"ID":"803feb63-4162-41e0-8ceb-2aabdf98cc70","Type":"ContainerStarted","Data":"29a4907e0829f74268078ae4fd2ddd02d77cea1f86b8fd696cd9b204d42c6d84"}
Jul 13 19:34:38.606739 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:38.606655    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg" event={"ID":"ffc70d20-b203-4f33-a8ef-74c57e9c9113","Type":"ContainerStarted","Data":"9a4051b07afc68148ffca9ef6a8318fd8ecf5a7af357c782853ce59e7787621d"}
Jul 13 19:34:38.607098 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:38.606756    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:34:38.636017 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:38.635962    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg" podStartSLOduration=0.930754512 podStartE2EDuration="3.63594584s" totalImagesPullingTime="2.705191328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:34:38.635273437 +0000 UTC m=+551.635763996" watchObservedRunningTime="2026-07-13 19:34:38.63594584 +0000 UTC m=+551.636436400"
Jul 13 19:34:40.618028 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:40.617928    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk" event={"ID":"803feb63-4162-41e0-8ceb-2aabdf98cc70","Type":"ContainerStarted","Data":"63bd137a419e0085a4f8fd6abc18b9f6e03a29237a0c10f7db23bf0fb37a9b61"}
Jul 13 19:34:40.639641 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:40.639586    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6996ff5f69-q2gkk" podStartSLOduration=1.151403057 podStartE2EDuration="4.63956593s" totalImagesPullingTime="3.488162873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:34:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:34:40.637041842 +0000 UTC m=+553.637532402" watchObservedRunningTime="2026-07-13 19:34:40.63956593 +0000 UTC m=+553.640056489"
Jul 13 19:34:49.614849 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:34:49.614790    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75894cfc5c-v7wvg"
Jul 13 19:35:27.404986 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:35:27.404957    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:35:27.406580 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:35:27.406559    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:36:17.016232 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.016195    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"]
Jul 13 19:36:17.019467 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.019443    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.022279 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.022258    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 13 19:36:17.022980 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.022956    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 19:36:17.023730 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.023706    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vgxbs\""
Jul 13 19:36:17.023730 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.023726    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 13 19:36:17.023983 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.023740    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 19:36:17.032546 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.032517    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"]
Jul 13 19:36:17.136235 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.136192    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5e2f441-54fd-4474-99ac-66e7614f283a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-25brp\" (UID: \"c5e2f441-54fd-4474-99ac-66e7614f283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.136235 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.136239    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llknw\" (UniqueName: \"kubernetes.io/projected/c5e2f441-54fd-4474-99ac-66e7614f283a-kube-api-access-llknw\") pod \"kuadrant-console-plugin-66b5774985-25brp\" (UID: \"c5e2f441-54fd-4474-99ac-66e7614f283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.136446 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.136383    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5e2f441-54fd-4474-99ac-66e7614f283a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-25brp\" (UID: \"c5e2f441-54fd-4474-99ac-66e7614f283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.236885 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.236849    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5e2f441-54fd-4474-99ac-66e7614f283a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-25brp\" (UID: \"c5e2f441-54fd-4474-99ac-66e7614f283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.236885 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.236885    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llknw\" (UniqueName: \"kubernetes.io/projected/c5e2f441-54fd-4474-99ac-66e7614f283a-kube-api-access-llknw\") pod \"kuadrant-console-plugin-66b5774985-25brp\" (UID: \"c5e2f441-54fd-4474-99ac-66e7614f283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.237085 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.236962    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5e2f441-54fd-4474-99ac-66e7614f283a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-25brp\" (UID: \"c5e2f441-54fd-4474-99ac-66e7614f283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.237636 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.237617    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5e2f441-54fd-4474-99ac-66e7614f283a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-25brp\" (UID: \"c5e2f441-54fd-4474-99ac-66e7614f283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.239405 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.239385    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5e2f441-54fd-4474-99ac-66e7614f283a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-25brp\" (UID: \"c5e2f441-54fd-4474-99ac-66e7614f283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.250466 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.250436    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llknw\" (UniqueName: \"kubernetes.io/projected/c5e2f441-54fd-4474-99ac-66e7614f283a-kube-api-access-llknw\") pod \"kuadrant-console-plugin-66b5774985-25brp\" (UID: \"c5e2f441-54fd-4474-99ac-66e7614f283a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.337958 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.337876    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"
Jul 13 19:36:17.489001 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.488799    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-25brp"]
Jul 13 19:36:17.491876 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:36:17.491849    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5e2f441_54fd_4474_99ac_66e7614f283a.slice/crio-bef4a6559dce280475440a352372c5128595e6ca8471c17517f19978d5f03020 WatchSource:0}: Error finding container bef4a6559dce280475440a352372c5128595e6ca8471c17517f19978d5f03020: Status 404 returned error can't find the container with id bef4a6559dce280475440a352372c5128595e6ca8471c17517f19978d5f03020
Jul 13 19:36:17.493224 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:17.493206    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:36:18.057508 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:18.057470    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp" event={"ID":"c5e2f441-54fd-4474-99ac-66e7614f283a","Type":"ContainerStarted","Data":"bef4a6559dce280475440a352372c5128595e6ca8471c17517f19978d5f03020"}
Jul 13 19:36:43.192562 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:43.192530    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp" event={"ID":"c5e2f441-54fd-4474-99ac-66e7614f283a","Type":"ContainerStarted","Data":"5a3142178e0dc0339ff471d3fac5736e28bdebf5a502c3bb0fe62f892fc4e478"}
Jul 13 19:36:43.208925 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:36:43.208842    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-25brp" podStartSLOduration=2.536277679 podStartE2EDuration="27.208798574s" totalImagesPullingTime="24.672520895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:36:43.207981983 +0000 UTC m=+676.208472542" watchObservedRunningTime="2026-07-13 19:36:43.208798574 +0000 UTC m=+676.209289134"
Jul 13 19:37:10.177174 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.177142    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"]
Jul 13 19:37:10.234597 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.234553    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"]
Jul 13 19:37:10.234763 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.234663    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:10.237596 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.237567    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 19:37:10.273426 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.273391    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"]
Jul 13 19:37:10.332550 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.332509    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/919dd65a-f55e-4c7d-8901-d74ca17688af-config-file\") pod \"limitador-limitador-64c94fd64f-cjsmb\" (UID: \"919dd65a-f55e-4c7d-8901-d74ca17688af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:10.332741 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.332641    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2lhb\" (UniqueName: \"kubernetes.io/projected/919dd65a-f55e-4c7d-8901-d74ca17688af-kube-api-access-t2lhb\") pod \"limitador-limitador-64c94fd64f-cjsmb\" (UID: \"919dd65a-f55e-4c7d-8901-d74ca17688af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:10.433777 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.433690    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2lhb\" (UniqueName: \"kubernetes.io/projected/919dd65a-f55e-4c7d-8901-d74ca17688af-kube-api-access-t2lhb\") pod \"limitador-limitador-64c94fd64f-cjsmb\" (UID: \"919dd65a-f55e-4c7d-8901-d74ca17688af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:10.433777 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.433753    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/919dd65a-f55e-4c7d-8901-d74ca17688af-config-file\") pod \"limitador-limitador-64c94fd64f-cjsmb\" (UID: \"919dd65a-f55e-4c7d-8901-d74ca17688af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:10.434377 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.434358    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/919dd65a-f55e-4c7d-8901-d74ca17688af-config-file\") pod \"limitador-limitador-64c94fd64f-cjsmb\" (UID: \"919dd65a-f55e-4c7d-8901-d74ca17688af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:10.442154 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.442126    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2lhb\" (UniqueName: \"kubernetes.io/projected/919dd65a-f55e-4c7d-8901-d74ca17688af-kube-api-access-t2lhb\") pod \"limitador-limitador-64c94fd64f-cjsmb\" (UID: \"919dd65a-f55e-4c7d-8901-d74ca17688af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:10.547640 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.547601    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:10.747618 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:10.747558    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"]
Jul 13 19:37:10.750100 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:37:10.750059    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919dd65a_f55e_4c7d_8901_d74ca17688af.slice/crio-9c178d9549ee452116c15f32b865b957e307ef85852121802a3101752baa361e WatchSource:0}: Error finding container 9c178d9549ee452116c15f32b865b957e307ef85852121802a3101752baa361e: Status 404 returned error can't find the container with id 9c178d9549ee452116c15f32b865b957e307ef85852121802a3101752baa361e
Jul 13 19:37:11.140757 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:11.140675    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpb9n"]
Jul 13 19:37:11.149412 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:11.149385    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fpb9n"
Jul 13 19:37:11.151418 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:11.151389    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpb9n"]
Jul 13 19:37:11.152284 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:11.152267    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kqs99\""
Jul 13 19:37:11.240253 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:11.240214    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v627t\" (UniqueName: \"kubernetes.io/projected/e9ac0185-4e82-41b1-8e46-d31783680673-kube-api-access-v627t\") pod \"authorino-75d556bd77-fpb9n\" (UID: \"e9ac0185-4e82-41b1-8e46-d31783680673\") " pod="kuadrant-system/authorino-75d556bd77-fpb9n"
Jul 13 19:37:11.318491 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:11.318459    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb" event={"ID":"919dd65a-f55e-4c7d-8901-d74ca17688af","Type":"ContainerStarted","Data":"9c178d9549ee452116c15f32b865b957e307ef85852121802a3101752baa361e"}
Jul 13 19:37:11.341602 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:11.341568    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v627t\" (UniqueName: \"kubernetes.io/projected/e9ac0185-4e82-41b1-8e46-d31783680673-kube-api-access-v627t\") pod \"authorino-75d556bd77-fpb9n\" (UID: \"e9ac0185-4e82-41b1-8e46-d31783680673\") " pod="kuadrant-system/authorino-75d556bd77-fpb9n"
Jul 13 19:37:11.350359 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:11.350322    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v627t\" (UniqueName: \"kubernetes.io/projected/e9ac0185-4e82-41b1-8e46-d31783680673-kube-api-access-v627t\") pod \"authorino-75d556bd77-fpb9n\" (UID: \"e9ac0185-4e82-41b1-8e46-d31783680673\") " pod="kuadrant-system/authorino-75d556bd77-fpb9n"
Jul 13 19:37:11.461651 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:11.461435    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fpb9n"
Jul 13 19:37:11.633105 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:11.633074    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpb9n"]
Jul 13 19:37:11.636063 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:37:11.636014    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9ac0185_4e82_41b1_8e46_d31783680673.slice/crio-59ddad090f69193cf07e03d441403d86097d56f9f85329c629be0484681c2f44 WatchSource:0}: Error finding container 59ddad090f69193cf07e03d441403d86097d56f9f85329c629be0484681c2f44: Status 404 returned error can't find the container with id 59ddad090f69193cf07e03d441403d86097d56f9f85329c629be0484681c2f44
Jul 13 19:37:12.324662 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:12.324623    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fpb9n" event={"ID":"e9ac0185-4e82-41b1-8e46-d31783680673","Type":"ContainerStarted","Data":"59ddad090f69193cf07e03d441403d86097d56f9f85329c629be0484681c2f44"}
Jul 13 19:37:14.339826 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:14.339766    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb" event={"ID":"919dd65a-f55e-4c7d-8901-d74ca17688af","Type":"ContainerStarted","Data":"be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505"}
Jul 13 19:37:14.340292 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:14.339937    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:14.356530 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:14.356461    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb" podStartSLOduration=1.51894447 podStartE2EDuration="4.356437199s" totalImagesPullingTime="2.837492729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:37:14.355334555 +0000 UTC m=+707.355825116" watchObservedRunningTime="2026-07-13 19:37:14.356437199 +0000 UTC m=+707.356927761"
Jul 13 19:37:16.351849 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:16.351786    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fpb9n" event={"ID":"e9ac0185-4e82-41b1-8e46-d31783680673","Type":"ContainerStarted","Data":"8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1"}
Jul 13 19:37:16.369204 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:16.369147    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-fpb9n" podStartSLOduration=1.237972561 podStartE2EDuration="5.369130161s" totalImagesPullingTime="4.1311576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:37:16.367315316 +0000 UTC m=+709.367805875" watchObservedRunningTime="2026-07-13 19:37:16.369130161 +0000 UTC m=+709.369620768"
Jul 13 19:37:25.137484 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:25.137402    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"]
Jul 13 19:37:25.137902 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:25.137626    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb" podUID="919dd65a-f55e-4c7d-8901-d74ca17688af" containerName="limitador" containerID="cri-o://be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505" gracePeriod=30
Jul 13 19:37:25.138441 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:25.138343    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:25.693704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:25.693677    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:25.786704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:25.786610    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/919dd65a-f55e-4c7d-8901-d74ca17688af-config-file\") pod \"919dd65a-f55e-4c7d-8901-d74ca17688af\" (UID: \"919dd65a-f55e-4c7d-8901-d74ca17688af\") "
Jul 13 19:37:25.786704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:25.786682    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2lhb\" (UniqueName: \"kubernetes.io/projected/919dd65a-f55e-4c7d-8901-d74ca17688af-kube-api-access-t2lhb\") pod \"919dd65a-f55e-4c7d-8901-d74ca17688af\" (UID: \"919dd65a-f55e-4c7d-8901-d74ca17688af\") "
Jul 13 19:37:25.787073 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:25.787054    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/919dd65a-f55e-4c7d-8901-d74ca17688af-config-file" (OuterVolumeSpecName: "config-file") pod "919dd65a-f55e-4c7d-8901-d74ca17688af" (UID: "919dd65a-f55e-4c7d-8901-d74ca17688af"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:37:25.789055 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:25.789025    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/919dd65a-f55e-4c7d-8901-d74ca17688af-kube-api-access-t2lhb" (OuterVolumeSpecName: "kube-api-access-t2lhb") pod "919dd65a-f55e-4c7d-8901-d74ca17688af" (UID: "919dd65a-f55e-4c7d-8901-d74ca17688af"). InnerVolumeSpecName "kube-api-access-t2lhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:37:25.887834 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:25.887761    2550 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/919dd65a-f55e-4c7d-8901-d74ca17688af-config-file\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:37:25.887834 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:25.887796    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2lhb\" (UniqueName: \"kubernetes.io/projected/919dd65a-f55e-4c7d-8901-d74ca17688af-kube-api-access-t2lhb\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:37:26.400139 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:26.400102    2550 generic.go:356] "Generic (PLEG): container finished" podID="919dd65a-f55e-4c7d-8901-d74ca17688af" containerID="be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505" exitCode=0
Jul 13 19:37:26.400139 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:26.400143    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"
Jul 13 19:37:26.400635 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:26.400163    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb" event={"ID":"919dd65a-f55e-4c7d-8901-d74ca17688af","Type":"ContainerDied","Data":"be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505"}
Jul 13 19:37:26.400635 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:26.400216    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-cjsmb" event={"ID":"919dd65a-f55e-4c7d-8901-d74ca17688af","Type":"ContainerDied","Data":"9c178d9549ee452116c15f32b865b957e307ef85852121802a3101752baa361e"}
Jul 13 19:37:26.400635 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:26.400245    2550 scope.go:117] "RemoveContainer" containerID="be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505"
Jul 13 19:37:26.409479 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:26.409460    2550 scope.go:117] "RemoveContainer" containerID="be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505"
Jul 13 19:37:26.409760 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:37:26.409743    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505\": container with ID starting with be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505 not found: ID does not exist" containerID="be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505"
Jul 13 19:37:26.409841 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:26.409767    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505"} err="failed to get container status \"be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505\": rpc error: code = NotFound desc = could not find container \"be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505\": container with ID starting with be76a95f7a80dd153d2e7932d421b213201cd570fa791be175130265dc542505 not found: ID does not exist"
Jul 13 19:37:26.421609 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:26.421574    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"]
Jul 13 19:37:26.425021 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:26.424983    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-cjsmb"]
Jul 13 19:37:27.544607 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:27.544577    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="919dd65a-f55e-4c7d-8901-d74ca17688af" path="/var/lib/kubelet/pods/919dd65a-f55e-4c7d-8901-d74ca17688af/volumes"
Jul 13 19:37:30.074615 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.074582    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"]
Jul 13 19:37:30.074981 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.074968    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="919dd65a-f55e-4c7d-8901-d74ca17688af" containerName="limitador"
Jul 13 19:37:30.075035 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.074983    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="919dd65a-f55e-4c7d-8901-d74ca17688af" containerName="limitador"
Jul 13 19:37:30.075069 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.075044    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="919dd65a-f55e-4c7d-8901-d74ca17688af" containerName="limitador"
Jul 13 19:37:30.077557 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.077541    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"
Jul 13 19:37:30.080268 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.080242    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 19:37:30.080395 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.080379    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-vh28n\""
Jul 13 19:37:30.080467 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.080380    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 13 19:37:30.080705 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.080682    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 19:37:30.086645 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.086618    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"]
Jul 13 19:37:30.125972 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.125930    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfjkv\" (UniqueName: \"kubernetes.io/projected/0656f015-2ccb-4493-a977-d03e89ed7e6a-kube-api-access-zfjkv\") pod \"postgres-69fb4594cf-z9s5q\" (UID: \"0656f015-2ccb-4493-a977-d03e89ed7e6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"
Jul 13 19:37:30.125972 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.125972    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0656f015-2ccb-4493-a977-d03e89ed7e6a-data\") pod \"postgres-69fb4594cf-z9s5q\" (UID: \"0656f015-2ccb-4493-a977-d03e89ed7e6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"
Jul 13 19:37:30.227380 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.227346    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfjkv\" (UniqueName: \"kubernetes.io/projected/0656f015-2ccb-4493-a977-d03e89ed7e6a-kube-api-access-zfjkv\") pod \"postgres-69fb4594cf-z9s5q\" (UID: \"0656f015-2ccb-4493-a977-d03e89ed7e6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"
Jul 13 19:37:30.227599 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.227385    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0656f015-2ccb-4493-a977-d03e89ed7e6a-data\") pod \"postgres-69fb4594cf-z9s5q\" (UID: \"0656f015-2ccb-4493-a977-d03e89ed7e6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"
Jul 13 19:37:30.227757 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.227738    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0656f015-2ccb-4493-a977-d03e89ed7e6a-data\") pod \"postgres-69fb4594cf-z9s5q\" (UID: \"0656f015-2ccb-4493-a977-d03e89ed7e6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"
Jul 13 19:37:30.238567 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.238534    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfjkv\" (UniqueName: \"kubernetes.io/projected/0656f015-2ccb-4493-a977-d03e89ed7e6a-kube-api-access-zfjkv\") pod \"postgres-69fb4594cf-z9s5q\" (UID: \"0656f015-2ccb-4493-a977-d03e89ed7e6a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"
Jul 13 19:37:30.389295 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.389196    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"
Jul 13 19:37:30.522907 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:30.522882    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"]
Jul 13 19:37:30.525493 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:37:30.525464    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0656f015_2ccb_4493_a977_d03e89ed7e6a.slice/crio-8db1437f1e2b8ea341fc3f96ba0f7cee7ea60189beb280745ccc47d7ecb0a837 WatchSource:0}: Error finding container 8db1437f1e2b8ea341fc3f96ba0f7cee7ea60189beb280745ccc47d7ecb0a837: Status 404 returned error can't find the container with id 8db1437f1e2b8ea341fc3f96ba0f7cee7ea60189beb280745ccc47d7ecb0a837
Jul 13 19:37:31.429068 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:31.429028    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q" event={"ID":"0656f015-2ccb-4493-a977-d03e89ed7e6a","Type":"ContainerStarted","Data":"8db1437f1e2b8ea341fc3f96ba0f7cee7ea60189beb280745ccc47d7ecb0a837"}
Jul 13 19:37:35.456056 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:35.456016    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q" event={"ID":"0656f015-2ccb-4493-a977-d03e89ed7e6a","Type":"ContainerStarted","Data":"1a78412d15c2ed706d6e2218f446c15f0b63d37d13b544f880f6d55a758c23ea"}
Jul 13 19:37:35.456440 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:35.456136    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"
Jul 13 19:37:35.473000 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:35.472888    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q" podStartSLOduration=0.630656383 podStartE2EDuration="5.472866645s" totalImagesPullingTime="4.842210262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:37:35.47272707 +0000 UTC m=+728.473217630" watchObservedRunningTime="2026-07-13 19:37:35.472866645 +0000 UTC m=+728.473357206"
Jul 13 19:37:41.492395 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:41.492366    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z9s5q"
Jul 13 19:37:42.455312 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.455281    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cd946cdb-4d4wq"]
Jul 13 19:37:42.461669 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.461641    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cd946cdb-4d4wq"
Jul 13 19:37:42.464789 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.464764    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 13 19:37:42.466118 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.466096    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cd946cdb-4d4wq"]
Jul 13 19:37:42.544755 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.544718    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-tls-cert\") pod \"authorino-6cd946cdb-4d4wq\" (UID: \"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0\") " pod="kuadrant-system/authorino-6cd946cdb-4d4wq"
Jul 13 19:37:42.545180 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.544818    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8cpp\" (UniqueName: \"kubernetes.io/projected/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-kube-api-access-r8cpp\") pod \"authorino-6cd946cdb-4d4wq\" (UID: \"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0\") " pod="kuadrant-system/authorino-6cd946cdb-4d4wq"
Jul 13 19:37:42.646270 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.646231    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-tls-cert\") pod \"authorino-6cd946cdb-4d4wq\" (UID: \"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0\") " pod="kuadrant-system/authorino-6cd946cdb-4d4wq"
Jul 13 19:37:42.646450 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.646307    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8cpp\" (UniqueName: \"kubernetes.io/projected/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-kube-api-access-r8cpp\") pod \"authorino-6cd946cdb-4d4wq\" (UID: \"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0\") " pod="kuadrant-system/authorino-6cd946cdb-4d4wq"
Jul 13 19:37:42.648850 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.648826    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-tls-cert\") pod \"authorino-6cd946cdb-4d4wq\" (UID: \"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0\") " pod="kuadrant-system/authorino-6cd946cdb-4d4wq"
Jul 13 19:37:42.655235 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.655207    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8cpp\" (UniqueName: \"kubernetes.io/projected/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-kube-api-access-r8cpp\") pod \"authorino-6cd946cdb-4d4wq\" (UID: \"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0\") " pod="kuadrant-system/authorino-6cd946cdb-4d4wq"
Jul 13 19:37:42.772651 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.772562    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cd946cdb-4d4wq"
Jul 13 19:37:42.913829 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:42.913780    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cd946cdb-4d4wq"]
Jul 13 19:37:42.916463 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:37:42.916419    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55bad8fa_2d58_4a9c_bf36_78c1bf65bbb0.slice/crio-4e579810afd60e066ba0703699200e61060c0796b1d7051334d9d71c69c9c967 WatchSource:0}: Error finding container 4e579810afd60e066ba0703699200e61060c0796b1d7051334d9d71c69c9c967: Status 404 returned error can't find the container with id 4e579810afd60e066ba0703699200e61060c0796b1d7051334d9d71c69c9c967
Jul 13 19:37:43.497998 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:43.497962    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cd946cdb-4d4wq" event={"ID":"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0","Type":"ContainerStarted","Data":"d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671"}
Jul 13 19:37:43.498197 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:43.498013    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cd946cdb-4d4wq" event={"ID":"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0","Type":"ContainerStarted","Data":"4e579810afd60e066ba0703699200e61060c0796b1d7051334d9d71c69c9c967"}
Jul 13 19:37:43.520358 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:43.520298    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cd946cdb-4d4wq" podStartSLOduration=1.039891347 podStartE2EDuration="1.520274701s" totalImagesPullingTime="480.383354ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:37:43.520008007 +0000 UTC m=+736.520498570" watchObservedRunningTime="2026-07-13 19:37:43.520274701 +0000 UTC m=+736.520765265"
Jul 13 19:37:43.555531 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:43.555496    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpb9n"]
Jul 13 19:37:43.555945 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:43.555713    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-fpb9n" podUID="e9ac0185-4e82-41b1-8e46-d31783680673" containerName="authorino" containerID="cri-o://8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1" gracePeriod=30
Jul 13 19:37:43.807970 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:43.807942    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fpb9n"
Jul 13 19:37:43.959077 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:43.959037    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v627t\" (UniqueName: \"kubernetes.io/projected/e9ac0185-4e82-41b1-8e46-d31783680673-kube-api-access-v627t\") pod \"e9ac0185-4e82-41b1-8e46-d31783680673\" (UID: \"e9ac0185-4e82-41b1-8e46-d31783680673\") "
Jul 13 19:37:43.961391 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:43.961358    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9ac0185-4e82-41b1-8e46-d31783680673-kube-api-access-v627t" (OuterVolumeSpecName: "kube-api-access-v627t") pod "e9ac0185-4e82-41b1-8e46-d31783680673" (UID: "e9ac0185-4e82-41b1-8e46-d31783680673"). InnerVolumeSpecName "kube-api-access-v627t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:37:44.060263 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:44.060225    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v627t\" (UniqueName: \"kubernetes.io/projected/e9ac0185-4e82-41b1-8e46-d31783680673-kube-api-access-v627t\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:37:44.503764 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:44.503722    2550 generic.go:356] "Generic (PLEG): container finished" podID="e9ac0185-4e82-41b1-8e46-d31783680673" containerID="8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1" exitCode=0
Jul 13 19:37:44.503985 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:44.503766    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fpb9n" event={"ID":"e9ac0185-4e82-41b1-8e46-d31783680673","Type":"ContainerDied","Data":"8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1"}
Jul 13 19:37:44.503985 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:44.503783    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fpb9n"
Jul 13 19:37:44.503985 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:44.503828    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fpb9n" event={"ID":"e9ac0185-4e82-41b1-8e46-d31783680673","Type":"ContainerDied","Data":"59ddad090f69193cf07e03d441403d86097d56f9f85329c629be0484681c2f44"}
Jul 13 19:37:44.503985 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:44.503855    2550 scope.go:117] "RemoveContainer" containerID="8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1"
Jul 13 19:37:44.513136 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:44.513118    2550 scope.go:117] "RemoveContainer" containerID="8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1"
Jul 13 19:37:44.513444 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:37:44.513426    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1\": container with ID starting with 8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1 not found: ID does not exist" containerID="8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1"
Jul 13 19:37:44.513514 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:44.513452    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1"} err="failed to get container status \"8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1\": rpc error: code = NotFound desc = could not find container \"8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1\": container with ID starting with 8a224ef6df467bc786afc0fd5e2ddaddab6eda46896bde7facbd15bcb9e65ac1 not found: ID does not exist"
Jul 13 19:37:44.525514 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:44.525484    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpb9n"]
Jul 13 19:37:44.529869 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:44.529848    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fpb9n"]
Jul 13 19:37:45.548989 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:45.546336    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9ac0185-4e82-41b1-8e46-d31783680673" path="/var/lib/kubelet/pods/e9ac0185-4e82-41b1-8e46-d31783680673/volumes"
Jul 13 19:37:48.381916 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.381876    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f545dcb-lkbg6"]
Jul 13 19:37:48.382408 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.382288    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ac0185-4e82-41b1-8e46-d31783680673" containerName="authorino"
Jul 13 19:37:48.382408 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.382300    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ac0185-4e82-41b1-8e46-d31783680673" containerName="authorino"
Jul 13 19:37:48.382408 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.382385    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ac0185-4e82-41b1-8e46-d31783680673" containerName="authorino"
Jul 13 19:37:48.430703 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.430655    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f545dcb-lkbg6"]
Jul 13 19:37:48.430892 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.430753    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:37:48.433534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.433507    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 19:37:48.433534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.433532    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 19:37:48.433746 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.433587    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4ppkp\""
Jul 13 19:37:48.500904 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.500869    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btr78\" (UniqueName: \"kubernetes.io/projected/cdb54856-6681-45de-8743-22c890926c98-kube-api-access-btr78\") pod \"maas-controller-8f545dcb-lkbg6\" (UID: \"cdb54856-6681-45de-8743-22c890926c98\") " pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:37:48.501064 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.500933    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdb54856-6681-45de-8743-22c890926c98-webhook-cert\") pod \"maas-controller-8f545dcb-lkbg6\" (UID: \"cdb54856-6681-45de-8743-22c890926c98\") " pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:37:48.602455 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.602421    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btr78\" (UniqueName: \"kubernetes.io/projected/cdb54856-6681-45de-8743-22c890926c98-kube-api-access-btr78\") pod \"maas-controller-8f545dcb-lkbg6\" (UID: \"cdb54856-6681-45de-8743-22c890926c98\") " pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:37:48.602650 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.602515    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdb54856-6681-45de-8743-22c890926c98-webhook-cert\") pod \"maas-controller-8f545dcb-lkbg6\" (UID: \"cdb54856-6681-45de-8743-22c890926c98\") " pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:37:48.602845 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:37:48.602728    2550 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 13 19:37:48.602944 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:37:48.602866    2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdb54856-6681-45de-8743-22c890926c98-webhook-cert podName:cdb54856-6681-45de-8743-22c890926c98 nodeName:}" failed. No retries permitted until 2026-07-13 19:37:49.102835112 +0000 UTC m=+742.103325668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/cdb54856-6681-45de-8743-22c890926c98-webhook-cert") pod "maas-controller-8f545dcb-lkbg6" (UID: "cdb54856-6681-45de-8743-22c890926c98") : secret "maas-controller-webhook-cert" not found
Jul 13 19:37:48.611196 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:48.611170    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btr78\" (UniqueName: \"kubernetes.io/projected/cdb54856-6681-45de-8743-22c890926c98-kube-api-access-btr78\") pod \"maas-controller-8f545dcb-lkbg6\" (UID: \"cdb54856-6681-45de-8743-22c890926c98\") " pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:37:49.108570 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:49.108524    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdb54856-6681-45de-8743-22c890926c98-webhook-cert\") pod \"maas-controller-8f545dcb-lkbg6\" (UID: \"cdb54856-6681-45de-8743-22c890926c98\") " pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:37:49.111115 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:49.111082    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdb54856-6681-45de-8743-22c890926c98-webhook-cert\") pod \"maas-controller-8f545dcb-lkbg6\" (UID: \"cdb54856-6681-45de-8743-22c890926c98\") " pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:37:49.340613 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:49.340566    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:37:49.518169 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:49.518140    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f545dcb-lkbg6"]
Jul 13 19:37:49.520908 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:37:49.520869    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdb54856_6681_45de_8743_22c890926c98.slice/crio-65d397789947d8fe60d9e9ffc2707cb5a090634fad62bb24845d5a1fd1462907 WatchSource:0}: Error finding container 65d397789947d8fe60d9e9ffc2707cb5a090634fad62bb24845d5a1fd1462907: Status 404 returned error can't find the container with id 65d397789947d8fe60d9e9ffc2707cb5a090634fad62bb24845d5a1fd1462907
Jul 13 19:37:49.530748 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:49.530718    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f545dcb-lkbg6" event={"ID":"cdb54856-6681-45de-8743-22c890926c98","Type":"ContainerStarted","Data":"65d397789947d8fe60d9e9ffc2707cb5a090634fad62bb24845d5a1fd1462907"}
Jul 13 19:37:53.553390 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:53.553356    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f545dcb-lkbg6" event={"ID":"cdb54856-6681-45de-8743-22c890926c98","Type":"ContainerStarted","Data":"ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9"}
Jul 13 19:37:53.553870 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:53.553434    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:37:53.575855 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:37:53.575782    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8f545dcb-lkbg6" podStartSLOduration=2.519340149 podStartE2EDuration="5.575764674s" totalImagesPullingTime="3.056424525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:37:53.574669405 +0000 UTC m=+746.575159962" watchObservedRunningTime="2026-07-13 19:37:53.575764674 +0000 UTC m=+746.576255290"
Jul 13 19:38:03.191494 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.191456    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f545dcb-lkbg6"]
Jul 13 19:38:03.191984 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.191710    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8f545dcb-lkbg6" podUID="cdb54856-6681-45de-8743-22c890926c98" containerName="manager" containerID="cri-o://ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9" gracePeriod=30
Jul 13 19:38:03.194046 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.194020    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:38:03.436759 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.436734    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:38:03.445953 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.445891    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btr78\" (UniqueName: \"kubernetes.io/projected/cdb54856-6681-45de-8743-22c890926c98-kube-api-access-btr78\") pod \"cdb54856-6681-45de-8743-22c890926c98\" (UID: \"cdb54856-6681-45de-8743-22c890926c98\") "
Jul 13 19:38:03.446044 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.445966    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdb54856-6681-45de-8743-22c890926c98-webhook-cert\") pod \"cdb54856-6681-45de-8743-22c890926c98\" (UID: \"cdb54856-6681-45de-8743-22c890926c98\") "
Jul 13 19:38:03.448176 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.448147    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdb54856-6681-45de-8743-22c890926c98-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cdb54856-6681-45de-8743-22c890926c98" (UID: "cdb54856-6681-45de-8743-22c890926c98"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:38:03.448176 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.448144    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdb54856-6681-45de-8743-22c890926c98-kube-api-access-btr78" (OuterVolumeSpecName: "kube-api-access-btr78") pod "cdb54856-6681-45de-8743-22c890926c98" (UID: "cdb54856-6681-45de-8743-22c890926c98"). InnerVolumeSpecName "kube-api-access-btr78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:38:03.546673 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.546644    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btr78\" (UniqueName: \"kubernetes.io/projected/cdb54856-6681-45de-8743-22c890926c98-kube-api-access-btr78\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:38:03.546673 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.546668    2550 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cdb54856-6681-45de-8743-22c890926c98-webhook-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:38:03.601309 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.601281    2550 generic.go:356] "Generic (PLEG): container finished" podID="cdb54856-6681-45de-8743-22c890926c98" containerID="ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9" exitCode=0
Jul 13 19:38:03.601464 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.601323    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f545dcb-lkbg6"
Jul 13 19:38:03.601464 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.601363    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f545dcb-lkbg6" event={"ID":"cdb54856-6681-45de-8743-22c890926c98","Type":"ContainerDied","Data":"ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9"}
Jul 13 19:38:03.601464 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.601418    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f545dcb-lkbg6" event={"ID":"cdb54856-6681-45de-8743-22c890926c98","Type":"ContainerDied","Data":"65d397789947d8fe60d9e9ffc2707cb5a090634fad62bb24845d5a1fd1462907"}
Jul 13 19:38:03.601464 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.601447    2550 scope.go:117] "RemoveContainer" containerID="ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9"
Jul 13 19:38:03.610137 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.610120    2550 scope.go:117] "RemoveContainer" containerID="ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9"
Jul 13 19:38:03.610420 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:38:03.610403    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9\": container with ID starting with ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9 not found: ID does not exist" containerID="ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9"
Jul 13 19:38:03.610496 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.610427    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9"} err="failed to get container status \"ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9\": rpc error: code = NotFound desc = could not find container \"ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9\": container with ID starting with ba2eb1b7f2ceb86dfd39f60e407602c979cecdd7eb9d891f820c5dc770e7f8d9 not found: ID does not exist"
Jul 13 19:38:03.619033 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.619008    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f545dcb-lkbg6"]
Jul 13 19:38:03.623331 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:03.623305    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8f545dcb-lkbg6"]
Jul 13 19:38:05.544942 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:05.544911    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdb54856-6681-45de-8743-22c890926c98" path="/var/lib/kubelet/pods/cdb54856-6681-45de-8743-22c890926c98/volumes"
Jul 13 19:38:24.873200 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.873145    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"]
Jul 13 19:38:24.873832 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.873717    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdb54856-6681-45de-8743-22c890926c98" containerName="manager"
Jul 13 19:38:24.873832 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.873738    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdb54856-6681-45de-8743-22c890926c98" containerName="manager"
Jul 13 19:38:24.873974 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.873847    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdb54856-6681-45de-8743-22c890926c98" containerName="manager"
Jul 13 19:38:24.878175 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.878151    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:24.881114 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.881081    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 13 19:38:24.881291 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.881095    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7xhth\""
Jul 13 19:38:24.886221 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.885755    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"]
Jul 13 19:38:24.939853 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.939793    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e22e4ab0-cc75-4edd-8a99-65fad275235b-maas-api-tls\") pod \"maas-api-5fbf5b9f44-wjjxt\" (UID: \"e22e4ab0-cc75-4edd-8a99-65fad275235b\") " pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:24.940025 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.939917    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp5ph\" (UniqueName: \"kubernetes.io/projected/e22e4ab0-cc75-4edd-8a99-65fad275235b-kube-api-access-lp5ph\") pod \"maas-api-5fbf5b9f44-wjjxt\" (UID: \"e22e4ab0-cc75-4edd-8a99-65fad275235b\") " pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:24.940025 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:24.939946    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22e4ab0-cc75-4edd-8a99-65fad275235b-openshift-service-ca\") pod \"maas-api-5fbf5b9f44-wjjxt\" (UID: \"e22e4ab0-cc75-4edd-8a99-65fad275235b\") " pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:25.040906 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.040863    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e22e4ab0-cc75-4edd-8a99-65fad275235b-maas-api-tls\") pod \"maas-api-5fbf5b9f44-wjjxt\" (UID: \"e22e4ab0-cc75-4edd-8a99-65fad275235b\") " pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:25.041082 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.040943    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp5ph\" (UniqueName: \"kubernetes.io/projected/e22e4ab0-cc75-4edd-8a99-65fad275235b-kube-api-access-lp5ph\") pod \"maas-api-5fbf5b9f44-wjjxt\" (UID: \"e22e4ab0-cc75-4edd-8a99-65fad275235b\") " pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:25.041082 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.040963    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22e4ab0-cc75-4edd-8a99-65fad275235b-openshift-service-ca\") pod \"maas-api-5fbf5b9f44-wjjxt\" (UID: \"e22e4ab0-cc75-4edd-8a99-65fad275235b\") " pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:25.041585 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.041567    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22e4ab0-cc75-4edd-8a99-65fad275235b-openshift-service-ca\") pod \"maas-api-5fbf5b9f44-wjjxt\" (UID: \"e22e4ab0-cc75-4edd-8a99-65fad275235b\") " pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:25.043497 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.043473    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e22e4ab0-cc75-4edd-8a99-65fad275235b-maas-api-tls\") pod \"maas-api-5fbf5b9f44-wjjxt\" (UID: \"e22e4ab0-cc75-4edd-8a99-65fad275235b\") " pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:25.050676 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.050647    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp5ph\" (UniqueName: \"kubernetes.io/projected/e22e4ab0-cc75-4edd-8a99-65fad275235b-kube-api-access-lp5ph\") pod \"maas-api-5fbf5b9f44-wjjxt\" (UID: \"e22e4ab0-cc75-4edd-8a99-65fad275235b\") " pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:25.190456 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.190407    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:25.351006 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.350773    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"]
Jul 13 19:38:25.353528 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:38:25.353498    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22e4ab0_cc75_4edd_8a99_65fad275235b.slice/crio-c6f5e15f807246cf279d39364b9bb80235d792e5b69a047a8f32f97a44ae0b1d WatchSource:0}: Error finding container c6f5e15f807246cf279d39364b9bb80235d792e5b69a047a8f32f97a44ae0b1d: Status 404 returned error can't find the container with id c6f5e15f807246cf279d39364b9bb80235d792e5b69a047a8f32f97a44ae0b1d
Jul 13 19:38:25.422067 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.422032    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"]
Jul 13 19:38:25.425288 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.425269    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"
Jul 13 19:38:25.428035 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.428013    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 13 19:38:25.428143 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.428107    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gppll\""
Jul 13 19:38:25.436409 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.436372    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"]
Jul 13 19:38:25.545646 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.545571    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83d4faf8-6c53-48ae-94b3-23d1df0de01a-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-dh8wp\" (UID: \"83d4faf8-6c53-48ae-94b3-23d1df0de01a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"
Jul 13 19:38:25.545646 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.545608    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9kg2\" (UniqueName: \"kubernetes.io/projected/83d4faf8-6c53-48ae-94b3-23d1df0de01a-kube-api-access-x9kg2\") pod \"payload-processing-f9b8d9b9b-dh8wp\" (UID: \"83d4faf8-6c53-48ae-94b3-23d1df0de01a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"
Jul 13 19:38:25.646832 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.646752    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83d4faf8-6c53-48ae-94b3-23d1df0de01a-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-dh8wp\" (UID: \"83d4faf8-6c53-48ae-94b3-23d1df0de01a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"
Jul 13 19:38:25.647039 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.646869    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9kg2\" (UniqueName: \"kubernetes.io/projected/83d4faf8-6c53-48ae-94b3-23d1df0de01a-kube-api-access-x9kg2\") pod \"payload-processing-f9b8d9b9b-dh8wp\" (UID: \"83d4faf8-6c53-48ae-94b3-23d1df0de01a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"
Jul 13 19:38:25.647507 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.647483    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83d4faf8-6c53-48ae-94b3-23d1df0de01a-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-dh8wp\" (UID: \"83d4faf8-6c53-48ae-94b3-23d1df0de01a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"
Jul 13 19:38:25.662626 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.662602    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9kg2\" (UniqueName: \"kubernetes.io/projected/83d4faf8-6c53-48ae-94b3-23d1df0de01a-kube-api-access-x9kg2\") pod \"payload-processing-f9b8d9b9b-dh8wp\" (UID: \"83d4faf8-6c53-48ae-94b3-23d1df0de01a\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"
Jul 13 19:38:25.707315 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.707280    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt" event={"ID":"e22e4ab0-cc75-4edd-8a99-65fad275235b","Type":"ContainerStarted","Data":"c6f5e15f807246cf279d39364b9bb80235d792e5b69a047a8f32f97a44ae0b1d"}
Jul 13 19:38:25.737561 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.737521    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"
Jul 13 19:38:25.874300 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:25.874274    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"]
Jul 13 19:38:25.876008 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:38:25.875984    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d4faf8_6c53_48ae_94b3_23d1df0de01a.slice/crio-db6605ef76e23ab2189d78e5a058b51238f14fb445b7207c3874ceaaf192019c WatchSource:0}: Error finding container db6605ef76e23ab2189d78e5a058b51238f14fb445b7207c3874ceaaf192019c: Status 404 returned error can't find the container with id db6605ef76e23ab2189d78e5a058b51238f14fb445b7207c3874ceaaf192019c
Jul 13 19:38:26.714025 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:26.713986    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp" event={"ID":"83d4faf8-6c53-48ae-94b3-23d1df0de01a","Type":"ContainerStarted","Data":"db6605ef76e23ab2189d78e5a058b51238f14fb445b7207c3874ceaaf192019c"}
Jul 13 19:38:27.720387 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:27.720345    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt" event={"ID":"e22e4ab0-cc75-4edd-8a99-65fad275235b","Type":"ContainerStarted","Data":"ceee04733c48c18f4f1e7a814a631ab9a9be8a5a17d639517109854e25d6cc4d"}
Jul 13 19:38:27.720859 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:27.720487    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:27.722014 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:27.721990    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp" event={"ID":"83d4faf8-6c53-48ae-94b3-23d1df0de01a","Type":"ContainerStarted","Data":"4cdc12f4c8203d30b17e6f2bfce75756ae9ad8810e7ede3913aecc23371dd521"}
Jul 13 19:38:27.722105 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:27.722040    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"
Jul 13 19:38:27.738963 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:27.738909    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt" podStartSLOduration=1.764063711 podStartE2EDuration="3.738895216s" totalImagesPullingTime="1.974831505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:38:27.73763767 +0000 UTC m=+780.738128415" watchObservedRunningTime="2026-07-13 19:38:27.738895216 +0000 UTC m=+780.739385776"
Jul 13 19:38:27.753133 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:27.753089    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp" podStartSLOduration=1.29973101 podStartE2EDuration="2.753072241s" totalImagesPullingTime="1.453341231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:38:27.752600197 +0000 UTC m=+780.753090735" watchObservedRunningTime="2026-07-13 19:38:27.753072241 +0000 UTC m=+780.753562801"
Jul 13 19:38:33.731638 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:33.731608    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5fbf5b9f44-wjjxt"
Jul 13 19:38:38.729019 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:38.728986    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-dh8wp"
Jul 13 19:38:56.167421 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.167382    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"]
Jul 13 19:38:56.171511 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.171485    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.174358 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.174333    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 19:38:56.175728 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.175707    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 13 19:38:56.175867 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.175786    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 19:38:56.175867 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.175829    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rx4h8\""
Jul 13 19:38:56.182349 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.182323    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"]
Jul 13 19:38:56.239279 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.239245    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7441d2b9-4017-4d01-aebf-9759fc0001ec-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.239279 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.239289    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.239548 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.239309    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22vmp\" (UniqueName: \"kubernetes.io/projected/7441d2b9-4017-4d01-aebf-9759fc0001ec-kube-api-access-22vmp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.239548 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.239411    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.239548 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.239455    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.239548 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.239544    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.340910 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.340871    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.341100 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.340925    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7441d2b9-4017-4d01-aebf-9759fc0001ec-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.341100 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.340950    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.341100 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.340968    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22vmp\" (UniqueName: \"kubernetes.io/projected/7441d2b9-4017-4d01-aebf-9759fc0001ec-kube-api-access-22vmp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.341100 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.341005    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.341100 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.341022    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.341419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.341330    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.341419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.341355    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.341419 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.341405    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.343450 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.343425    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7441d2b9-4017-4d01-aebf-9759fc0001ec-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.343665 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.343646    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7441d2b9-4017-4d01-aebf-9759fc0001ec-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.348839 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.348799    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22vmp\" (UniqueName: \"kubernetes.io/projected/7441d2b9-4017-4d01-aebf-9759fc0001ec-kube-api-access-22vmp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vbvv\" (UID: \"7441d2b9-4017-4d01-aebf-9759fc0001ec\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.483508 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.483419    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:38:56.622905 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.622875    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"]
Jul 13 19:38:56.624848 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:38:56.624785    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7441d2b9_4017_4d01_aebf_9759fc0001ec.slice/crio-c8db88b26b4cc34fdea42179da584b3de1f1529761e638d5e114eadc106599f9 WatchSource:0}: Error finding container c8db88b26b4cc34fdea42179da584b3de1f1529761e638d5e114eadc106599f9: Status 404 returned error can't find the container with id c8db88b26b4cc34fdea42179da584b3de1f1529761e638d5e114eadc106599f9
Jul 13 19:38:56.869715 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:56.869619    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv" event={"ID":"7441d2b9-4017-4d01-aebf-9759fc0001ec","Type":"ContainerStarted","Data":"c8db88b26b4cc34fdea42179da584b3de1f1529761e638d5e114eadc106599f9"}
Jul 13 19:38:57.876577 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:57.876539    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv" event={"ID":"7441d2b9-4017-4d01-aebf-9759fc0001ec","Type":"ContainerStarted","Data":"3a44d3e09c2706af94c88f6bd0b7767f8a5bc5fb7e21f2107d107a97f1d90e4a"}
Jul 13 19:38:57.895161 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:38:57.895107    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv" podStartSLOduration=0.774807421 podStartE2EDuration="1.895091049s" totalImagesPullingTime="1.120283628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:38:57.893402174 +0000 UTC m=+810.893892733" watchObservedRunningTime="2026-07-13 19:38:57.895091049 +0000 UTC m=+810.895581609"
Jul 13 19:39:06.484547 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:39:06.484508    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:39:06.485064 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:39:06.484607    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:39:06.497684 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:39:06.497657    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:39:06.936872 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:39:06.936837    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vbvv"
Jul 13 19:40:27.437287 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:27.437202    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:40:27.438915 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:27.438890    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:40:55.128261 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.128223    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6cd946cdb-4d4wq"]
Jul 13 19:40:55.128826 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.128439    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6cd946cdb-4d4wq" podUID="55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0" containerName="authorino" containerID="cri-o://d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671" gracePeriod=30
Jul 13 19:40:55.391501 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.391433    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cd946cdb-4d4wq"
Jul 13 19:40:55.442900 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.442861    2550 generic.go:356] "Generic (PLEG): container finished" podID="55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0" containerID="d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671" exitCode=0
Jul 13 19:40:55.442900 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.442900    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cd946cdb-4d4wq"
Jul 13 19:40:55.443145 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.442910    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cd946cdb-4d4wq" event={"ID":"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0","Type":"ContainerDied","Data":"d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671"}
Jul 13 19:40:55.443145 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.442951    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cd946cdb-4d4wq" event={"ID":"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0","Type":"ContainerDied","Data":"4e579810afd60e066ba0703699200e61060c0796b1d7051334d9d71c69c9c967"}
Jul 13 19:40:55.443145 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.442972    2550 scope.go:117] "RemoveContainer" containerID="d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671"
Jul 13 19:40:55.453223 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.453184    2550 scope.go:117] "RemoveContainer" containerID="d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671"
Jul 13 19:40:55.453627 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:40:55.453604    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671\": container with ID starting with d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671 not found: ID does not exist" containerID="d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671"
Jul 13 19:40:55.453725 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.453638    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671"} err="failed to get container status \"d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671\": rpc error: code = NotFound desc = could not find container \"d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671\": container with ID starting with d46898a96459620fa0082b2ca4a89ea65224f628de519df121ecf61aa96e4671 not found: ID does not exist"
Jul 13 19:40:55.463661 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.463635    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8cpp\" (UniqueName: \"kubernetes.io/projected/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-kube-api-access-r8cpp\") pod \"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0\" (UID: \"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0\") "
Jul 13 19:40:55.463842 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.463716    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-tls-cert\") pod \"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0\" (UID: \"55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0\") "
Jul 13 19:40:55.465967 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.465934    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-kube-api-access-r8cpp" (OuterVolumeSpecName: "kube-api-access-r8cpp") pod "55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0" (UID: "55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0"). InnerVolumeSpecName "kube-api-access-r8cpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:40:55.475017 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.474983    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0" (UID: "55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:40:55.565405 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.565367    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8cpp\" (UniqueName: \"kubernetes.io/projected/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-kube-api-access-r8cpp\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:40:55.565405 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.565401    2550 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0-tls-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:40:55.761844 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.761788    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6cd946cdb-4d4wq"]
Jul 13 19:40:55.766157 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:55.766129    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6cd946cdb-4d4wq"]
Jul 13 19:40:57.547587 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:40:57.547551    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0" path="/var/lib/kubelet/pods/55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0/volumes"
Jul 13 19:42:10.428071 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.428038    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65fb85bbdb-v77cs"]
Jul 13 19:42:10.428605 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.428454    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0" containerName="authorino"
Jul 13 19:42:10.428605 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.428469    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0" containerName="authorino"
Jul 13 19:42:10.428605 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.428535    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="55bad8fa-2d58-4a9c-bf36-78c1bf65bbb0" containerName="authorino"
Jul 13 19:42:10.431554 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.431537    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65fb85bbdb-v77cs"
Jul 13 19:42:10.435566 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.435540    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 19:42:10.435687 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.435540    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4ppkp\""
Jul 13 19:42:10.435687 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.435596    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 19:42:10.442667 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.442642    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65fb85bbdb-v77cs"]
Jul 13 19:42:10.471026 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.470989    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jmzm\" (UniqueName: \"kubernetes.io/projected/1c52a024-2aea-4d93-b00e-cf752e5e5fe4-kube-api-access-2jmzm\") pod \"maas-controller-65fb85bbdb-v77cs\" (UID: \"1c52a024-2aea-4d93-b00e-cf752e5e5fe4\") " pod="opendatahub/maas-controller-65fb85bbdb-v77cs"
Jul 13 19:42:10.471212 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.471100    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c52a024-2aea-4d93-b00e-cf752e5e5fe4-webhook-cert\") pod \"maas-controller-65fb85bbdb-v77cs\" (UID: \"1c52a024-2aea-4d93-b00e-cf752e5e5fe4\") " pod="opendatahub/maas-controller-65fb85bbdb-v77cs"
Jul 13 19:42:10.572113 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.572078    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jmzm\" (UniqueName: \"kubernetes.io/projected/1c52a024-2aea-4d93-b00e-cf752e5e5fe4-kube-api-access-2jmzm\") pod \"maas-controller-65fb85bbdb-v77cs\" (UID: \"1c52a024-2aea-4d93-b00e-cf752e5e5fe4\") " pod="opendatahub/maas-controller-65fb85bbdb-v77cs"
Jul 13 19:42:10.572313 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.572170    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c52a024-2aea-4d93-b00e-cf752e5e5fe4-webhook-cert\") pod \"maas-controller-65fb85bbdb-v77cs\" (UID: \"1c52a024-2aea-4d93-b00e-cf752e5e5fe4\") " pod="opendatahub/maas-controller-65fb85bbdb-v77cs"
Jul 13 19:42:10.574952 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.574928    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1c52a024-2aea-4d93-b00e-cf752e5e5fe4-webhook-cert\") pod \"maas-controller-65fb85bbdb-v77cs\" (UID: \"1c52a024-2aea-4d93-b00e-cf752e5e5fe4\") " pod="opendatahub/maas-controller-65fb85bbdb-v77cs"
Jul 13 19:42:10.581366 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.581339    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jmzm\" (UniqueName: \"kubernetes.io/projected/1c52a024-2aea-4d93-b00e-cf752e5e5fe4-kube-api-access-2jmzm\") pod \"maas-controller-65fb85bbdb-v77cs\" (UID: \"1c52a024-2aea-4d93-b00e-cf752e5e5fe4\") " pod="opendatahub/maas-controller-65fb85bbdb-v77cs"
Jul 13 19:42:10.742402 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.742313    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65fb85bbdb-v77cs"
Jul 13 19:42:10.886363 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.886336    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65fb85bbdb-v77cs"]
Jul 13 19:42:10.892155 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:10.892130    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:42:11.801207 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:11.801175    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65fb85bbdb-v77cs" event={"ID":"1c52a024-2aea-4d93-b00e-cf752e5e5fe4","Type":"ContainerStarted","Data":"87796d5a99862481303faef624a9d32a575ed8efd89c02d1b360061c3d6122ed"}
Jul 13 19:42:11.801642 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:11.801234    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65fb85bbdb-v77cs" event={"ID":"1c52a024-2aea-4d93-b00e-cf752e5e5fe4","Type":"ContainerStarted","Data":"50e78e0c8c54b51cc0f6b33e98879e26e82716679b6545d1ac80ee961097346f"}
Jul 13 19:42:11.801642 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:11.801265    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65fb85bbdb-v77cs"
Jul 13 19:42:11.822862 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:11.822789    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65fb85bbdb-v77cs" podStartSLOduration=1.353901564 podStartE2EDuration="1.822772669s" totalImagesPullingTime="468.871105ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:42:11.820665281 +0000 UTC m=+1004.821155840" watchObservedRunningTime="2026-07-13 19:42:11.822772669 +0000 UTC m=+1004.823263229"
Jul 13 19:42:22.808825 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:42:22.808774    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65fb85bbdb-v77cs"
Jul 13 19:45:00.139367 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:00.139324    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2"]
Jul 13 19:45:00.142834 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:00.142794    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2"
Jul 13 19:45:00.145528 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:00.145509    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hk9td\""
Jul 13 19:45:00.152096 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:00.152079    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2"
Jul 13 19:45:00.157019 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:00.156992    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2"]
Jul 13 19:45:00.291047 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:00.291019    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2"]
Jul 13 19:45:00.294036 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:45:00.294009    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89edfef_b78a_413d_86f6_f363942980c1.slice/crio-4f01b5a6bac45fe43fca5ad5819cb77c4dada6420d495dcefcbb80b95178524e WatchSource:0}: Error finding container 4f01b5a6bac45fe43fca5ad5819cb77c4dada6420d495dcefcbb80b95178524e: Status 404 returned error can't find the container with id 4f01b5a6bac45fe43fca5ad5819cb77c4dada6420d495dcefcbb80b95178524e
Jul 13 19:45:00.610167 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:00.610129    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2" event={"ID":"b89edfef-b78a-413d-86f6-f363942980c1","Type":"ContainerStarted","Data":"4f01b5a6bac45fe43fca5ad5819cb77c4dada6420d495dcefcbb80b95178524e"}
Jul 13 19:45:03.628428 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:03.628391    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2" event={"ID":"b89edfef-b78a-413d-86f6-f363942980c1","Type":"ContainerStarted","Data":"fcb0b632103a87c3172b3bcb1ab7e2ec37948ec1fdb9c0c6fdcb9aac865e0dc3"}
Jul 13 19:45:03.645653 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:03.645600    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2" podStartSLOduration=1.215573242 podStartE2EDuration="3.645582281s" totalImagesPullingTime="2.430009039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:45:03.643312978 +0000 UTC m=+1176.643803539" watchObservedRunningTime="2026-07-13 19:45:03.645582281 +0000 UTC m=+1176.646072841"
Jul 13 19:45:04.634716 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:04.634683    2550 generic.go:356] "Generic (PLEG): container finished" podID="b89edfef-b78a-413d-86f6-f363942980c1" containerID="fcb0b632103a87c3172b3bcb1ab7e2ec37948ec1fdb9c0c6fdcb9aac865e0dc3" exitCode=0
Jul 13 19:45:04.635102 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:04.634754    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2" event={"ID":"b89edfef-b78a-413d-86f6-f363942980c1","Type":"ContainerDied","Data":"fcb0b632103a87c3172b3bcb1ab7e2ec37948ec1fdb9c0c6fdcb9aac865e0dc3"}
Jul 13 19:45:05.775113 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:05.775091    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2"
Jul 13 19:45:06.644677 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:06.644638    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2"
Jul 13 19:45:06.644677 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:06.644643    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732865-c7xp2" event={"ID":"b89edfef-b78a-413d-86f6-f363942980c1","Type":"ContainerDied","Data":"4f01b5a6bac45fe43fca5ad5819cb77c4dada6420d495dcefcbb80b95178524e"}
Jul 13 19:45:06.644932 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:06.644696    2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f01b5a6bac45fe43fca5ad5819cb77c4dada6420d495dcefcbb80b95178524e"
Jul 13 19:45:27.467185 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:27.467151    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:45:27.471341 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:45:27.471314    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:50:27.497115 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:50:27.497086    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:50:27.503319 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:50:27.503295    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:54:24.483328 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.483292    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"]
Jul 13 19:54:24.484641 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.483874    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b89edfef-b78a-413d-86f6-f363942980c1" containerName="cleanup"
Jul 13 19:54:24.484641 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.483891    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="b89edfef-b78a-413d-86f6-f363942980c1" containerName="cleanup"
Jul 13 19:54:24.484641 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.484006    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="b89edfef-b78a-413d-86f6-f363942980c1" containerName="cleanup"
Jul 13 19:54:24.486186 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.486167    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.489219 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.489195    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-29d8d858-openshift-default-dockercfg-fn942\""
Jul 13 19:54:24.489363 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.489201    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 19:54:24.510009 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.509979    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"]
Jul 13 19:54:24.580932 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.580889    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kxr7\" (UniqueName: \"kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-kube-api-access-6kxr7\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.581122 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.580957    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-certs\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.581122 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.581056    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-data\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.581215 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.581125    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-socket\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.581215 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.581154    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-envoy\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.581215 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.581178    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-istio-token\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.581321 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.581245    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/165ae628-4f65-4617-8dcf-045cc028af01-istio-podinfo\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.581321 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.581266    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-credential-socket\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.581321 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.581280    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/165ae628-4f65-4617-8dcf-045cc028af01-istiod-ca-cert\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.681901 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.681857    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kxr7\" (UniqueName: \"kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-kube-api-access-6kxr7\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682105 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.681913    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-certs\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682105 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.681948    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-data\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682105 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.681993    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-socket\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682105 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.682014    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-envoy\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682105 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.682036    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-istio-token\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682366 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.682236    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/165ae628-4f65-4617-8dcf-045cc028af01-istio-podinfo\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682366 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.682312    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-credential-socket\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682366 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.682340    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/165ae628-4f65-4617-8dcf-045cc028af01-istiod-ca-cert\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682509 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.682407    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-data\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682567 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.682553    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-certs\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682619 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.682553    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-socket\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.682677 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.682663    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-credential-socket\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.683067 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.683046    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/165ae628-4f65-4617-8dcf-045cc028af01-istiod-ca-cert\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.684465 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.684445    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-envoy\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.684894 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.684874    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/165ae628-4f65-4617-8dcf-045cc028af01-istio-podinfo\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.690982 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.690952    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-istio-token\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.691112 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.691093    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kxr7\" (UniqueName: \"kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-kube-api-access-6kxr7\") pod \"e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") " pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.800534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.800428    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:24.945437 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.945408    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"]
Jul 13 19:54:24.947539 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:54:24.947513    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165ae628_4f65_4617_8dcf_045cc028af01.slice/crio-bfc272fa2990e1e12198b849907f0c30c545c17833f38022338020d2bbd15838 WatchSource:0}: Error finding container bfc272fa2990e1e12198b849907f0c30c545c17833f38022338020d2bbd15838: Status 404 returned error can't find the container with id bfc272fa2990e1e12198b849907f0c30c545c17833f38022338020d2bbd15838
Jul 13 19:54:24.949774 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:24.949753    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 19:54:25.351745 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:25.351711    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp" event={"ID":"165ae628-4f65-4617-8dcf-045cc028af01","Type":"ContainerStarted","Data":"bfc272fa2990e1e12198b849907f0c30c545c17833f38022338020d2bbd15838"}
Jul 13 19:54:25.812682 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:25.812644    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"]
Jul 13 19:54:25.816195 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:25.816175    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:25.818971 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:25.818950    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-29d8d858-serving-cert\""
Jul 13 19:54:25.823163 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:25.823138    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"]
Jul 13 19:54:25.993855 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:25.993781    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-maas-api-tls\") pod \"maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:25.994080 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:25.993897    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-openshift-service-ca\") pod \"maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:25.994080 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:25.994024    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx5rl\" (UniqueName: \"kubernetes.io/projected/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-kube-api-access-jx5rl\") pod \"maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:26.095053 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:26.094947    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx5rl\" (UniqueName: \"kubernetes.io/projected/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-kube-api-access-jx5rl\") pod \"maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:26.095053 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:26.095007    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-maas-api-tls\") pod \"maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:26.095053 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:26.095035    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-openshift-service-ca\") pod \"maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:26.095660 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:26.095637    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-openshift-service-ca\") pod \"maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:26.097773 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:26.097747    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-maas-api-tls\") pod \"maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:26.104247 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:26.104220    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx5rl\" (UniqueName: \"kubernetes.io/projected/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-kube-api-access-jx5rl\") pod \"maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:26.129502 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:26.129467    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:26.270541 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:26.270486    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"]
Jul 13 19:54:26.272997 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:54:26.272962    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e20b7ac_66c0_4a69_87f8_caa4ae32bb86.slice/crio-13fdfcc9619544b3ee2020b4b444b4fabbe2e157459dbe7601a37d5c1cd93679 WatchSource:0}: Error finding container 13fdfcc9619544b3ee2020b4b444b4fabbe2e157459dbe7601a37d5c1cd93679: Status 404 returned error can't find the container with id 13fdfcc9619544b3ee2020b4b444b4fabbe2e157459dbe7601a37d5c1cd93679
Jul 13 19:54:26.358263 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:26.358178    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj" event={"ID":"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86","Type":"ContainerStarted","Data":"13fdfcc9619544b3ee2020b4b444b4fabbe2e157459dbe7601a37d5c1cd93679"}
Jul 13 19:54:27.365001 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:27.364908    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj" event={"ID":"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86","Type":"ContainerStarted","Data":"e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2"}
Jul 13 19:54:27.365354 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:27.365053    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:27.382872 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:27.382779    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj" podStartSLOduration=1.685803442 podStartE2EDuration="2.382754682s" totalImagesPullingTime="696.95124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:54:27.381150948 +0000 UTC m=+1740.381641509" watchObservedRunningTime="2026-07-13 19:54:27.382754682 +0000 UTC m=+1740.383245242"
Jul 13 19:54:33.376453 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:33.376423    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:41.054534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.054494    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"]
Jul 13 19:54:41.055066 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.054778    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj" podUID="2e20b7ac-66c0-4a69-87f8-caa4ae32bb86" containerName="maas-api" containerID="cri-o://e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2" gracePeriod=30
Jul 13 19:54:41.305260 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.305195    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:41.337881 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.337853    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-maas-api-tls\") pod \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") "
Jul 13 19:54:41.338049 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.337924    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jx5rl\" (UniqueName: \"kubernetes.io/projected/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-kube-api-access-jx5rl\") pod \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") "
Jul 13 19:54:41.338049 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.337970    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-openshift-service-ca\") pod \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\" (UID: \"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86\") "
Jul 13 19:54:41.338369 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.338344    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2e20b7ac-66c0-4a69-87f8-caa4ae32bb86" (UID: "2e20b7ac-66c0-4a69-87f8-caa4ae32bb86"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:54:41.340215 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.340184    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2e20b7ac-66c0-4a69-87f8-caa4ae32bb86" (UID: "2e20b7ac-66c0-4a69-87f8-caa4ae32bb86"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:54:41.340310 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.340274    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-kube-api-access-jx5rl" (OuterVolumeSpecName: "kube-api-access-jx5rl") pod "2e20b7ac-66c0-4a69-87f8-caa4ae32bb86" (UID: "2e20b7ac-66c0-4a69-87f8-caa4ae32bb86"). InnerVolumeSpecName "kube-api-access-jx5rl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:54:41.439175 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.439135    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-maas-api-tls\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:54:41.439175 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.439175    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jx5rl\" (UniqueName: \"kubernetes.io/projected/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-kube-api-access-jx5rl\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:54:41.439402 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.439191    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86-openshift-service-ca\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:54:41.451255 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.451224    2550 generic.go:356] "Generic (PLEG): container finished" podID="2e20b7ac-66c0-4a69-87f8-caa4ae32bb86" containerID="e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2" exitCode=0
Jul 13 19:54:41.451435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.451273    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"
Jul 13 19:54:41.451435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.451318    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj" event={"ID":"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86","Type":"ContainerDied","Data":"e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2"}
Jul 13 19:54:41.451435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.451370    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj" event={"ID":"2e20b7ac-66c0-4a69-87f8-caa4ae32bb86","Type":"ContainerDied","Data":"13fdfcc9619544b3ee2020b4b444b4fabbe2e157459dbe7601a37d5c1cd93679"}
Jul 13 19:54:41.451435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.451392    2550 scope.go:117] "RemoveContainer" containerID="e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2"
Jul 13 19:54:41.461268 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.461248    2550 scope.go:117] "RemoveContainer" containerID="e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2"
Jul 13 19:54:41.461570 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:54:41.461548    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2\": container with ID starting with e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2 not found: ID does not exist" containerID="e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2"
Jul 13 19:54:41.461622 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.461582    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2"} err="failed to get container status \"e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2\": rpc error: code = NotFound desc = could not find container \"e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2\": container with ID starting with e94e736858025bd8aa19facf55335c15c95c349a58d54b7cdc90102642367cf2 not found: ID does not exist"
Jul 13 19:54:41.474574 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.474531    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"]
Jul 13 19:54:41.476778 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.476744    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-29d8d858-5b6d5b5f99-bk2tj"]
Jul 13 19:54:41.551223 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:41.551188    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e20b7ac-66c0-4a69-87f8-caa4ae32bb86" path="/var/lib/kubelet/pods/2e20b7ac-66c0-4a69-87f8-caa4ae32bb86/volumes"
Jul 13 19:54:50.020844 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:50.020781    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:54:50.021129 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:50.020885    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:54:50.021129 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:50.020917    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:54:50.499308 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:50.499275    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp" event={"ID":"165ae628-4f65-4617-8dcf-045cc028af01","Type":"ContainerStarted","Data":"53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d"}
Jul 13 19:54:50.521645 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:50.521599    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp" podStartSLOduration=1.451139632 podStartE2EDuration="26.521582732s" totalImagesPullingTime="25.0704431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:54:50.519131441 +0000 UTC m=+1763.519622002" watchObservedRunningTime="2026-07-13 19:54:50.521582732 +0000 UTC m=+1763.522073291"
Jul 13 19:54:50.801154 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:50.801059    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:51.806183 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:51.806148    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:52.508601 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:52.508564    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:52.509633 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:52.509612    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:54:55.930911 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:55.930877    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"]
Jul 13 19:54:55.931417 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:55.931059    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp" podUID="165ae628-4f65-4617-8dcf-045cc028af01" containerName="istio-proxy" containerID="cri-o://53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d" gracePeriod=30
Jul 13 19:54:57.844226 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:57.844195    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"]
Jul 13 19:54:57.844584 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:57.844577    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e20b7ac-66c0-4a69-87f8-caa4ae32bb86" containerName="maas-api"
Jul 13 19:54:57.844625 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:57.844588    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e20b7ac-66c0-4a69-87f8-caa4ae32bb86" containerName="maas-api"
Jul 13 19:54:57.844663 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:57.844658    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e20b7ac-66c0-4a69-87f8-caa4ae32bb86" containerName="maas-api"
Jul 13 19:54:57.847640 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:57.847620    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:57.850393 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:57.850374    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-ac3fa3ea-serving-cert\""
Jul 13 19:54:57.858863 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:57.858838    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"]
Jul 13 19:54:58.001323 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.001282    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8tzp\" (UniqueName: \"kubernetes.io/projected/85a5847c-e214-4cdd-9b8b-66250dc10e95-kube-api-access-f8tzp\") pod \"maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:58.001323 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.001323    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85a5847c-e214-4cdd-9b8b-66250dc10e95-openshift-service-ca\") pod \"maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:58.001534 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.001353    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a5847c-e214-4cdd-9b8b-66250dc10e95-maas-api-tls\") pod \"maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:58.102596 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.102504    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8tzp\" (UniqueName: \"kubernetes.io/projected/85a5847c-e214-4cdd-9b8b-66250dc10e95-kube-api-access-f8tzp\") pod \"maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:58.102596 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.102549    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85a5847c-e214-4cdd-9b8b-66250dc10e95-openshift-service-ca\") pod \"maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:58.102596 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.102582    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a5847c-e214-4cdd-9b8b-66250dc10e95-maas-api-tls\") pod \"maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:58.103373 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.103320    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85a5847c-e214-4cdd-9b8b-66250dc10e95-openshift-service-ca\") pod \"maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:58.105305 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.105281    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a5847c-e214-4cdd-9b8b-66250dc10e95-maas-api-tls\") pod \"maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:58.111446 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.111420    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8tzp\" (UniqueName: \"kubernetes.io/projected/85a5847c-e214-4cdd-9b8b-66250dc10e95-kube-api-access-f8tzp\") pod \"maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:58.158302 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.158271    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:58.300072 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.300016    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"]
Jul 13 19:54:58.302472 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:54:58.302443    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a5847c_e214_4cdd_9b8b_66250dc10e95.slice/crio-a0c885460186304ed3c098b98b422fde19a004da89faf023a61f2f70618ad156 WatchSource:0}: Error finding container a0c885460186304ed3c098b98b422fde19a004da89faf023a61f2f70618ad156: Status 404 returned error can't find the container with id a0c885460186304ed3c098b98b422fde19a004da89faf023a61f2f70618ad156
Jul 13 19:54:58.536609 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:58.536578    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws" event={"ID":"85a5847c-e214-4cdd-9b8b-66250dc10e95","Type":"ContainerStarted","Data":"a0c885460186304ed3c098b98b422fde19a004da89faf023a61f2f70618ad156"}
Jul 13 19:54:59.544727 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:59.544702    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:54:59.545126 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:59.544751    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws" event={"ID":"85a5847c-e214-4cdd-9b8b-66250dc10e95","Type":"ContainerStarted","Data":"fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b"}
Jul 13 19:54:59.561283 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:54:59.561232    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws" podStartSLOduration=1.914224107 podStartE2EDuration="2.561215958s" totalImagesPullingTime="646.991851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:54:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:54:59.560467022 +0000 UTC m=+1772.560957581" watchObservedRunningTime="2026-07-13 19:54:59.561215958 +0000 UTC m=+1772.561706518"
Jul 13 19:55:01.190271 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.190201    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:55:01.331757 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.331721    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-credential-socket\") pod \"165ae628-4f65-4617-8dcf-045cc028af01\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") "
Jul 13 19:55:01.331944 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.331766    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-data\") pod \"165ae628-4f65-4617-8dcf-045cc028af01\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") "
Jul 13 19:55:01.331944 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.331877    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/165ae628-4f65-4617-8dcf-045cc028af01-istiod-ca-cert\") pod \"165ae628-4f65-4617-8dcf-045cc028af01\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") "
Jul 13 19:55:01.331944 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.331924    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kxr7\" (UniqueName: \"kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-kube-api-access-6kxr7\") pod \"165ae628-4f65-4617-8dcf-045cc028af01\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") "
Jul 13 19:55:01.332049 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.331978    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-certs\") pod \"165ae628-4f65-4617-8dcf-045cc028af01\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") "
Jul 13 19:55:01.332049 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332002    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-socket\") pod \"165ae628-4f65-4617-8dcf-045cc028af01\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") "
Jul 13 19:55:01.332049 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332030    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-istio-token\") pod \"165ae628-4f65-4617-8dcf-045cc028af01\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") "
Jul 13 19:55:01.332162 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332063    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/165ae628-4f65-4617-8dcf-045cc028af01-istio-podinfo\") pod \"165ae628-4f65-4617-8dcf-045cc028af01\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") "
Jul 13 19:55:01.332162 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332089    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-envoy\") pod \"165ae628-4f65-4617-8dcf-045cc028af01\" (UID: \"165ae628-4f65-4617-8dcf-045cc028af01\") "
Jul 13 19:55:01.332162 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332098    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "165ae628-4f65-4617-8dcf-045cc028af01" (UID: "165ae628-4f65-4617-8dcf-045cc028af01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:55:01.332162 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332128    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-data" (OuterVolumeSpecName: "istio-data") pod "165ae628-4f65-4617-8dcf-045cc028af01" (UID: "165ae628-4f65-4617-8dcf-045cc028af01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:55:01.332310 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332276    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/165ae628-4f65-4617-8dcf-045cc028af01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "165ae628-4f65-4617-8dcf-045cc028af01" (UID: "165ae628-4f65-4617-8dcf-045cc028af01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:55:01.332349 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332320    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "165ae628-4f65-4617-8dcf-045cc028af01" (UID: "165ae628-4f65-4617-8dcf-045cc028af01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:55:01.332447 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332429    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:01.332504 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332450    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:01.332504 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332465    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:01.332504 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332482    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/165ae628-4f65-4617-8dcf-045cc028af01-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:01.332836 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.332482    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "165ae628-4f65-4617-8dcf-045cc028af01" (UID: "165ae628-4f65-4617-8dcf-045cc028af01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:55:01.334481 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.334446    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/165ae628-4f65-4617-8dcf-045cc028af01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "165ae628-4f65-4617-8dcf-045cc028af01" (UID: "165ae628-4f65-4617-8dcf-045cc028af01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:55:01.334481 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.334457    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-kube-api-access-6kxr7" (OuterVolumeSpecName: "kube-api-access-6kxr7") pod "165ae628-4f65-4617-8dcf-045cc028af01" (UID: "165ae628-4f65-4617-8dcf-045cc028af01"). InnerVolumeSpecName "kube-api-access-6kxr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:55:01.334481 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.334466    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-istio-token" (OuterVolumeSpecName: "istio-token") pod "165ae628-4f65-4617-8dcf-045cc028af01" (UID: "165ae628-4f65-4617-8dcf-045cc028af01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:55:01.334726 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.334492    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "165ae628-4f65-4617-8dcf-045cc028af01" (UID: "165ae628-4f65-4617-8dcf-045cc028af01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:55:01.433124 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.433089    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kxr7\" (UniqueName: \"kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-kube-api-access-6kxr7\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:01.433124 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.433122    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:01.433124 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.433135    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/165ae628-4f65-4617-8dcf-045cc028af01-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:01.433431 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.433143    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/165ae628-4f65-4617-8dcf-045cc028af01-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:01.433431 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.433151    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/165ae628-4f65-4617-8dcf-045cc028af01-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:01.557258 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.557188    2550 generic.go:356] "Generic (PLEG): container finished" podID="165ae628-4f65-4617-8dcf-045cc028af01" containerID="53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d" exitCode=0
Jul 13 19:55:01.557336 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.557319    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"
Jul 13 19:55:01.557382 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.557351    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp" event={"ID":"165ae628-4f65-4617-8dcf-045cc028af01","Type":"ContainerDied","Data":"53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d"}
Jul 13 19:55:01.557422 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.557405    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp" event={"ID":"165ae628-4f65-4617-8dcf-045cc028af01","Type":"ContainerDied","Data":"bfc272fa2990e1e12198b849907f0c30c545c17833f38022338020d2bbd15838"}
Jul 13 19:55:01.557463 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.557441    2550 scope.go:117] "RemoveContainer" containerID="53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d"
Jul 13 19:55:01.566788 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.566768    2550 scope.go:117] "RemoveContainer" containerID="53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d"
Jul 13 19:55:01.567129 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:55:01.567108    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d\": container with ID starting with 53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d not found: ID does not exist" containerID="53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d"
Jul 13 19:55:01.567200 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.567140    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d"} err="failed to get container status \"53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d\": rpc error: code = NotFound desc = could not find container \"53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d\": container with ID starting with 53b9ffa57bf518b344d703a70c36491bd0fcc6fb1f8dc6c791295ca040c3338d not found: ID does not exist"
Jul 13 19:55:01.577401 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.577364    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"]
Jul 13 19:55:01.583288 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:01.583255    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-29d8d858-openshift-default-6b7f5b9b67-9j6wp"]
Jul 13 19:55:02.300385 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.300342    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"]
Jul 13 19:55:02.301039 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.301017    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165ae628-4f65-4617-8dcf-045cc028af01" containerName="istio-proxy"
Jul 13 19:55:02.301098 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.301044    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="165ae628-4f65-4617-8dcf-045cc028af01" containerName="istio-proxy"
Jul 13 19:55:02.301172 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.301160    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="165ae628-4f65-4617-8dcf-045cc028af01" containerName="istio-proxy"
Jul 13 19:55:02.306346 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.306315    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"
Jul 13 19:55:02.309451 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.309419    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hk9td\""
Jul 13 19:55:02.311245 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.311222    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"]
Jul 13 19:55:02.443358 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.443313    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7365550d-4ec1-4798-ad46-75689beeaed9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv\" (UID: \"7365550d-4ec1-4798-ad46-75689beeaed9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"
Jul 13 19:55:02.544760 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.544724    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7365550d-4ec1-4798-ad46-75689beeaed9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv\" (UID: \"7365550d-4ec1-4798-ad46-75689beeaed9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"
Jul 13 19:55:02.545500 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.545476    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7365550d-4ec1-4798-ad46-75689beeaed9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv\" (UID: \"7365550d-4ec1-4798-ad46-75689beeaed9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"
Jul 13 19:55:02.619489 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.619399    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"
Jul 13 19:55:02.775343 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:02.775268    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"]
Jul 13 19:55:02.777745 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:55:02.777717    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7365550d_4ec1_4798_ad46_75689beeaed9.slice/crio-0b84e0235220794ed670fb9f475c75fee2f0d216230a73ec6ea16a9df8bc3eaa WatchSource:0}: Error finding container 0b84e0235220794ed670fb9f475c75fee2f0d216230a73ec6ea16a9df8bc3eaa: Status 404 returned error can't find the container with id 0b84e0235220794ed670fb9f475c75fee2f0d216230a73ec6ea16a9df8bc3eaa
Jul 13 19:55:03.545723 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:03.545686    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="165ae628-4f65-4617-8dcf-045cc028af01" path="/var/lib/kubelet/pods/165ae628-4f65-4617-8dcf-045cc028af01/volumes"
Jul 13 19:55:03.569799 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:03.569757    2550 generic.go:356] "Generic (PLEG): container finished" podID="7365550d-4ec1-4798-ad46-75689beeaed9" containerID="cba540e3e177a489a043cc63dc89727ce9f0f487e83c8a9958dab2fcb3628aef" exitCode=7
Jul 13 19:55:03.570013 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:03.569852    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv" event={"ID":"7365550d-4ec1-4798-ad46-75689beeaed9","Type":"ContainerDied","Data":"cba540e3e177a489a043cc63dc89727ce9f0f487e83c8a9958dab2fcb3628aef"}
Jul 13 19:55:03.570013 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:03.569916    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv" event={"ID":"7365550d-4ec1-4798-ad46-75689beeaed9","Type":"ContainerStarted","Data":"0b84e0235220794ed670fb9f475c75fee2f0d216230a73ec6ea16a9df8bc3eaa"}
Jul 13 19:55:03.570096 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:03.570058    2550 scope.go:117] "RemoveContainer" containerID="cba540e3e177a489a043cc63dc89727ce9f0f487e83c8a9958dab2fcb3628aef"
Jul 13 19:55:04.576830 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:04.576768    2550 generic.go:356] "Generic (PLEG): container finished" podID="7365550d-4ec1-4798-ad46-75689beeaed9" containerID="ee293549984be890c714d80dcdaa41d54eb659aee0bfbaf993601fdb0b1495c0" exitCode=7
Jul 13 19:55:04.577232 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:04.576860    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv" event={"ID":"7365550d-4ec1-4798-ad46-75689beeaed9","Type":"ContainerDied","Data":"ee293549984be890c714d80dcdaa41d54eb659aee0bfbaf993601fdb0b1495c0"}
Jul 13 19:55:04.577232 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:04.576913    2550 scope.go:117] "RemoveContainer" containerID="cba540e3e177a489a043cc63dc89727ce9f0f487e83c8a9958dab2fcb3628aef"
Jul 13 19:55:04.577232 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:04.577204    2550 scope.go:117] "RemoveContainer" containerID="ee293549984be890c714d80dcdaa41d54eb659aee0bfbaf993601fdb0b1495c0"
Jul 13 19:55:04.577460 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:55:04.577438    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv_odh-ai-gateway-infra(7365550d-4ec1-4798-ad46-75689beeaed9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv" podUID="7365550d-4ec1-4798-ad46-75689beeaed9"
Jul 13 19:55:05.554644 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:05.554616    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:55:05.584512 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:05.584485    2550 scope.go:117] "RemoveContainer" containerID="ee293549984be890c714d80dcdaa41d54eb659aee0bfbaf993601fdb0b1495c0"
Jul 13 19:55:05.584909 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:55:05.584666    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv_odh-ai-gateway-infra(7365550d-4ec1-4798-ad46-75689beeaed9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv" podUID="7365550d-4ec1-4798-ad46-75689beeaed9"
Jul 13 19:55:18.539314 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:18.539226    2550 scope.go:117] "RemoveContainer" containerID="ee293549984be890c714d80dcdaa41d54eb659aee0bfbaf993601fdb0b1495c0"
Jul 13 19:55:19.657856 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:19.657745    2550 generic.go:356] "Generic (PLEG): container finished" podID="7365550d-4ec1-4798-ad46-75689beeaed9" containerID="ff936d7a64b7ad0292ce7b0c518e4bed60aa064de9da42ac3f948d417f6cc723" exitCode=0
Jul 13 19:55:19.657856 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:19.657843    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv" event={"ID":"7365550d-4ec1-4798-ad46-75689beeaed9","Type":"ContainerDied","Data":"ff936d7a64b7ad0292ce7b0c518e4bed60aa064de9da42ac3f948d417f6cc723"}
Jul 13 19:55:19.658274 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:19.657910    2550 scope.go:117] "RemoveContainer" containerID="ee293549984be890c714d80dcdaa41d54eb659aee0bfbaf993601fdb0b1495c0"
Jul 13 19:55:20.689929 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:20.689889    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"]
Jul 13 19:55:20.803070 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:20.803039    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"
Jul 13 19:55:20.917955 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:20.917925    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7365550d-4ec1-4798-ad46-75689beeaed9-maas-api-service-ca\") pod \"7365550d-4ec1-4798-ad46-75689beeaed9\" (UID: \"7365550d-4ec1-4798-ad46-75689beeaed9\") "
Jul 13 19:55:20.918278 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:20.918258    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7365550d-4ec1-4798-ad46-75689beeaed9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7365550d-4ec1-4798-ad46-75689beeaed9" (UID: "7365550d-4ec1-4798-ad46-75689beeaed9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:55:21.019727 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:21.019696    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7365550d-4ec1-4798-ad46-75689beeaed9-maas-api-service-ca\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:21.670524 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:21.670489    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv" event={"ID":"7365550d-4ec1-4798-ad46-75689beeaed9","Type":"ContainerDied","Data":"0b84e0235220794ed670fb9f475c75fee2f0d216230a73ec6ea16a9df8bc3eaa"}
Jul 13 19:55:21.670524 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:21.670509    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"
Jul 13 19:55:21.670782 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:21.670553    2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b84e0235220794ed670fb9f475c75fee2f0d216230a73ec6ea16a9df8bc3eaa"
Jul 13 19:55:21.702296 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:21.702262    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"]
Jul 13 19:55:21.707732 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:21.707700    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-jpdhv"]
Jul 13 19:55:23.546020 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:23.545989    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7365550d-4ec1-4798-ad46-75689beeaed9" path="/var/lib/kubelet/pods/7365550d-4ec1-4798-ad46-75689beeaed9/volumes"
Jul 13 19:55:27.528188 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:27.528162    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:55:27.534628 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:27.534604    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 19:55:52.344375 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.344339    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n"]
Jul 13 19:55:52.344897 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.344737    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7365550d-4ec1-4798-ad46-75689beeaed9" containerName="revoke-keys"
Jul 13 19:55:52.344897 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.344753    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7365550d-4ec1-4798-ad46-75689beeaed9" containerName="revoke-keys"
Jul 13 19:55:52.344897 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.344787    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7365550d-4ec1-4798-ad46-75689beeaed9" containerName="revoke-keys"
Jul 13 19:55:52.344897 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.344796    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7365550d-4ec1-4798-ad46-75689beeaed9" containerName="revoke-keys"
Jul 13 19:55:52.344897 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.344824    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7365550d-4ec1-4798-ad46-75689beeaed9" containerName="revoke-keys"
Jul 13 19:55:52.344897 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.344833    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7365550d-4ec1-4798-ad46-75689beeaed9" containerName="revoke-keys"
Jul 13 19:55:52.345276 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.344938    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="7365550d-4ec1-4798-ad46-75689beeaed9" containerName="revoke-keys"
Jul 13 19:55:52.345276 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.344947    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="7365550d-4ec1-4798-ad46-75689beeaed9" containerName="revoke-keys"
Jul 13 19:55:52.345276 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.344956    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="7365550d-4ec1-4798-ad46-75689beeaed9" containerName="revoke-keys"
Jul 13 19:55:52.349528 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.349505    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n"
Jul 13 19:55:52.352573 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.352544    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hk9td\""
Jul 13 19:55:52.356727 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.356647    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n"]
Jul 13 19:55:52.424666 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.424631    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51f5d87e-f511-471c-b358-779d130a4d2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n\" (UID: \"51f5d87e-f511-471c-b358-779d130a4d2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n"
Jul 13 19:55:52.526084 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.526042    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51f5d87e-f511-471c-b358-779d130a4d2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n\" (UID: \"51f5d87e-f511-471c-b358-779d130a4d2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n"
Jul 13 19:55:52.526761 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.526738    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51f5d87e-f511-471c-b358-779d130a4d2a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n\" (UID: \"51f5d87e-f511-471c-b358-779d130a4d2a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n"
Jul 13 19:55:52.663957 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.663866    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n"
Jul 13 19:55:52.804842 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.804782    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n"]
Jul 13 19:55:52.806552 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:55:52.806503    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f5d87e_f511_471c_b358_779d130a4d2a.slice/crio-f300744353b2ecbc5cfbb5b6cd30ebb91616e2c1585ac60feb606896d7b0594e WatchSource:0}: Error finding container f300744353b2ecbc5cfbb5b6cd30ebb91616e2c1585ac60feb606896d7b0594e: Status 404 returned error can't find the container with id f300744353b2ecbc5cfbb5b6cd30ebb91616e2c1585ac60feb606896d7b0594e
Jul 13 19:55:52.823878 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:52.823844    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n" event={"ID":"51f5d87e-f511-471c-b358-779d130a4d2a","Type":"ContainerStarted","Data":"f300744353b2ecbc5cfbb5b6cd30ebb91616e2c1585ac60feb606896d7b0594e"}
Jul 13 19:55:53.830439 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:53.830399    2550 generic.go:356] "Generic (PLEG): container finished" podID="51f5d87e-f511-471c-b358-779d130a4d2a" containerID="36ba7785f66b6977d79d75ff744f225cf57c94c63912e8975012741e659980bb" exitCode=0
Jul 13 19:55:53.830871 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:53.830440    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n" event={"ID":"51f5d87e-f511-471c-b358-779d130a4d2a","Type":"ContainerDied","Data":"36ba7785f66b6977d79d75ff744f225cf57c94c63912e8975012741e659980bb"}
Jul 13 19:55:54.969533 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:54.969508    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n"
Jul 13 19:55:55.049497 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:55.049461    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51f5d87e-f511-471c-b358-779d130a4d2a-maas-api-service-ca\") pod \"51f5d87e-f511-471c-b358-779d130a4d2a\" (UID: \"51f5d87e-f511-471c-b358-779d130a4d2a\") "
Jul 13 19:55:55.049913 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:55.049889    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51f5d87e-f511-471c-b358-779d130a4d2a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "51f5d87e-f511-471c-b358-779d130a4d2a" (UID: "51f5d87e-f511-471c-b358-779d130a4d2a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:55:55.150233 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:55.150150    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/51f5d87e-f511-471c-b358-779d130a4d2a-maas-api-service-ca\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:55:55.842195 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:55.842102    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n" event={"ID":"51f5d87e-f511-471c-b358-779d130a4d2a","Type":"ContainerDied","Data":"f300744353b2ecbc5cfbb5b6cd30ebb91616e2c1585ac60feb606896d7b0594e"}
Jul 13 19:55:55.842195 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:55.842161    2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f300744353b2ecbc5cfbb5b6cd30ebb91616e2c1585ac60feb606896d7b0594e"
Jul 13 19:55:55.842195 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:55:55.842112    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n"
Jul 13 19:56:02.769429 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:02.769396    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"]
Jul 13 19:56:02.769951 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:02.769620    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws" podUID="85a5847c-e214-4cdd-9b8b-66250dc10e95" containerName="maas-api" containerID="cri-o://fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b" gracePeriod=30
Jul 13 19:56:03.025880 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.025794    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:56:03.130420 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.130373    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a5847c-e214-4cdd-9b8b-66250dc10e95-maas-api-tls\") pod \"85a5847c-e214-4cdd-9b8b-66250dc10e95\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") "
Jul 13 19:56:03.130420 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.130418    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8tzp\" (UniqueName: \"kubernetes.io/projected/85a5847c-e214-4cdd-9b8b-66250dc10e95-kube-api-access-f8tzp\") pod \"85a5847c-e214-4cdd-9b8b-66250dc10e95\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") "
Jul 13 19:56:03.130643 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.130474    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85a5847c-e214-4cdd-9b8b-66250dc10e95-openshift-service-ca\") pod \"85a5847c-e214-4cdd-9b8b-66250dc10e95\" (UID: \"85a5847c-e214-4cdd-9b8b-66250dc10e95\") "
Jul 13 19:56:03.130937 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.130910    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85a5847c-e214-4cdd-9b8b-66250dc10e95-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "85a5847c-e214-4cdd-9b8b-66250dc10e95" (UID: "85a5847c-e214-4cdd-9b8b-66250dc10e95"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:56:03.132726 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.132693    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85a5847c-e214-4cdd-9b8b-66250dc10e95-kube-api-access-f8tzp" (OuterVolumeSpecName: "kube-api-access-f8tzp") pod "85a5847c-e214-4cdd-9b8b-66250dc10e95" (UID: "85a5847c-e214-4cdd-9b8b-66250dc10e95"). InnerVolumeSpecName "kube-api-access-f8tzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:56:03.132863 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.132775    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85a5847c-e214-4cdd-9b8b-66250dc10e95-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "85a5847c-e214-4cdd-9b8b-66250dc10e95" (UID: "85a5847c-e214-4cdd-9b8b-66250dc10e95"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 19:56:03.231682 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.231645    2550 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/85a5847c-e214-4cdd-9b8b-66250dc10e95-openshift-service-ca\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:56:03.231682 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.231677    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/85a5847c-e214-4cdd-9b8b-66250dc10e95-maas-api-tls\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:56:03.231682 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.231686    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8tzp\" (UniqueName: \"kubernetes.io/projected/85a5847c-e214-4cdd-9b8b-66250dc10e95-kube-api-access-f8tzp\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:56:03.883789 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.883697    2550 generic.go:356] "Generic (PLEG): container finished" podID="85a5847c-e214-4cdd-9b8b-66250dc10e95" containerID="fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b" exitCode=0
Jul 13 19:56:03.883789 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.883744    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"
Jul 13 19:56:03.883789 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.883777    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws" event={"ID":"85a5847c-e214-4cdd-9b8b-66250dc10e95","Type":"ContainerDied","Data":"fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b"}
Jul 13 19:56:03.884277 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.883842    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws" event={"ID":"85a5847c-e214-4cdd-9b8b-66250dc10e95","Type":"ContainerDied","Data":"a0c885460186304ed3c098b98b422fde19a004da89faf023a61f2f70618ad156"}
Jul 13 19:56:03.884277 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.883865    2550 scope.go:117] "RemoveContainer" containerID="fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b"
Jul 13 19:56:03.894845 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.894826    2550 scope.go:117] "RemoveContainer" containerID="fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b"
Jul 13 19:56:03.895134 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:56:03.895114    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b\": container with ID starting with fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b not found: ID does not exist" containerID="fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b"
Jul 13 19:56:03.895205 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.895141    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b"} err="failed to get container status \"fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b\": rpc error: code = NotFound desc = could not find container \"fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b\": container with ID starting with fe1cdae8b7ccf8fb9f00f84c19bf2419fbaaef644f23151c88e1e75bf442a93b not found: ID does not exist"
Jul 13 19:56:03.903001 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.902975    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"]
Jul 13 19:56:03.909159 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:03.909134    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ac3fa3ea-69479677bf-g8vws"]
Jul 13 19:56:05.545310 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:05.545264    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85a5847c-e214-4cdd-9b8b-66250dc10e95" path="/var/lib/kubelet/pods/85a5847c-e214-4cdd-9b8b-66250dc10e95/volumes"
Jul 13 19:56:08.740771 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.740738    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"]
Jul 13 19:56:08.741352 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.741323    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f5d87e-f511-471c-b358-779d130a4d2a" containerName="revoke-keys"
Jul 13 19:56:08.741352 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.741350    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f5d87e-f511-471c-b358-779d130a4d2a" containerName="revoke-keys"
Jul 13 19:56:08.741538 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.741400    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85a5847c-e214-4cdd-9b8b-66250dc10e95" containerName="maas-api"
Jul 13 19:56:08.741538 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.741409    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="85a5847c-e214-4cdd-9b8b-66250dc10e95" containerName="maas-api"
Jul 13 19:56:08.741538 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.741501    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f5d87e-f511-471c-b358-779d130a4d2a" containerName="revoke-keys"
Jul 13 19:56:08.741538 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.741514    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="85a5847c-e214-4cdd-9b8b-66250dc10e95" containerName="maas-api"
Jul 13 19:56:08.746678 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.746653    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.752250 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.752227    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-facb3ea1-openshift-default-dockercfg-s6fkx\""
Jul 13 19:56:08.752411 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.752300    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 19:56:08.765853 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.765823    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"]
Jul 13 19:56:08.888181 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.888145    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-socket\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.888181 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.888185    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-envoy\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.888435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.888224    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-token\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.888435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.888243    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g4gk\" (UniqueName: \"kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-kube-api-access-8g4gk\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.888435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.888294    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-credential-socket\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.888435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.888310    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-certs\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.888435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.888355    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istiod-ca-cert\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.888435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.888402    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-data\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.888435 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.888417    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-podinfo\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.989166 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.989125    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istiod-ca-cert\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.989377 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.989217    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-data\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.989377 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.989237    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-podinfo\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.989377 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.989261    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-socket\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.989550 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.989410    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-envoy\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.989550 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.989460    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-token\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.989550 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.989490    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g4gk\" (UniqueName: \"kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-kube-api-access-8g4gk\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.989550 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.989536    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-credential-socket\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.989756 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.989560    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-certs\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.990009 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.989983    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-socket\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.990098 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.990029    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istiod-ca-cert\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.990098 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.990078    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-certs\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.990208 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.990185    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-data\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.990208 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.990186    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-credential-socket\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.992010 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.991952    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-envoy\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:08.992198 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:08.992176    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-podinfo\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:09.012970 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:09.012936    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g4gk\" (UniqueName: \"kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-kube-api-access-8g4gk\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:09.019939 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:09.019903    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-token\") pod \"e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") " pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:09.058769 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:09.058731    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:09.205399 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:09.205372    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"]
Jul 13 19:56:09.207189 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:56:09.207155    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e75c2f2_b9ee_4842_98e7_1590b4d35164.slice/crio-9aed64b239b29040a7365ef6ff6e08d9807d632f65082ce835d7c041d3f7e141 WatchSource:0}: Error finding container 9aed64b239b29040a7365ef6ff6e08d9807d632f65082ce835d7c041d3f7e141: Status 404 returned error can't find the container with id 9aed64b239b29040a7365ef6ff6e08d9807d632f65082ce835d7c041d3f7e141
Jul 13 19:56:09.209141 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:09.209111    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:56:09.209196 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:09.209174    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:56:09.209236 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:09.209204    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:56:09.916401 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:09.916363    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" event={"ID":"6e75c2f2-b9ee-4842-98e7-1590b4d35164","Type":"ContainerStarted","Data":"ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395"}
Jul 13 19:56:09.916782 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:09.916452    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" event={"ID":"6e75c2f2-b9ee-4842-98e7-1590b4d35164","Type":"ContainerStarted","Data":"9aed64b239b29040a7365ef6ff6e08d9807d632f65082ce835d7c041d3f7e141"}
Jul 13 19:56:09.949793 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:09.949738    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" podStartSLOduration=1.949722444 podStartE2EDuration="1.949722444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:56:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:56:09.949276836 +0000 UTC m=+1842.949767395" watchObservedRunningTime="2026-07-13 19:56:09.949722444 +0000 UTC m=+1842.950213004"
Jul 13 19:56:10.059344 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:10.059297    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:10.064706 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:10.064676    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:10.921558 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:10.921530    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:10.922895 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:10.922862    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:15.135989 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:15.135955    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"]
Jul 13 19:56:15.139958 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:15.139936    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"
Jul 13 19:56:15.143115 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:15.143095    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hk9td\""
Jul 13 19:56:15.147766 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:15.147733    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"]
Jul 13 19:56:15.254425 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:15.254386    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc654ff2-655f-46ac-bbbd-af66c348e248-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf\" (UID: \"fc654ff2-655f-46ac-bbbd-af66c348e248\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"
Jul 13 19:56:15.355996 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:15.355956    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc654ff2-655f-46ac-bbbd-af66c348e248-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf\" (UID: \"fc654ff2-655f-46ac-bbbd-af66c348e248\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"
Jul 13 19:56:15.356605 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:15.356585    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc654ff2-655f-46ac-bbbd-af66c348e248-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf\" (UID: \"fc654ff2-655f-46ac-bbbd-af66c348e248\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"
Jul 13 19:56:15.452480 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:15.452443    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"
Jul 13 19:56:15.604184 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:15.604156    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"]
Jul 13 19:56:15.605914 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:56:15.605882    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc654ff2_655f_46ac_bbbd_af66c348e248.slice/crio-b2b11696fac3c06c8107cc0a29ce44b3768d7c56b601dfb09b934a127ae04415 WatchSource:0}: Error finding container b2b11696fac3c06c8107cc0a29ce44b3768d7c56b601dfb09b934a127ae04415: Status 404 returned error can't find the container with id b2b11696fac3c06c8107cc0a29ce44b3768d7c56b601dfb09b934a127ae04415
Jul 13 19:56:15.948414 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:15.948377    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf" event={"ID":"fc654ff2-655f-46ac-bbbd-af66c348e248","Type":"ContainerStarted","Data":"b2b11696fac3c06c8107cc0a29ce44b3768d7c56b601dfb09b934a127ae04415"}
Jul 13 19:56:16.955184 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:16.955148    2550 generic.go:356] "Generic (PLEG): container finished" podID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerID="4301cd5fc365e501209237496f9e6381ccbdd73837f540edeebfbfa5c4c05876" exitCode=7
Jul 13 19:56:16.955565 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:16.955195    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf" event={"ID":"fc654ff2-655f-46ac-bbbd-af66c348e248","Type":"ContainerDied","Data":"4301cd5fc365e501209237496f9e6381ccbdd73837f540edeebfbfa5c4c05876"}
Jul 13 19:56:16.955565 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:16.955416    2550 scope.go:117] "RemoveContainer" containerID="4301cd5fc365e501209237496f9e6381ccbdd73837f540edeebfbfa5c4c05876"
Jul 13 19:56:17.962361 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:17.962324    2550 generic.go:356] "Generic (PLEG): container finished" podID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerID="976cc590738e86353e911bb9aecc8b2cb035ffdb4c2991718dab6ba5d5734133" exitCode=7
Jul 13 19:56:17.962757 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:17.962396    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf" event={"ID":"fc654ff2-655f-46ac-bbbd-af66c348e248","Type":"ContainerDied","Data":"976cc590738e86353e911bb9aecc8b2cb035ffdb4c2991718dab6ba5d5734133"}
Jul 13 19:56:17.962757 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:17.962499    2550 scope.go:117] "RemoveContainer" containerID="4301cd5fc365e501209237496f9e6381ccbdd73837f540edeebfbfa5c4c05876"
Jul 13 19:56:17.962757 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:17.962697    2550 scope.go:117] "RemoveContainer" containerID="976cc590738e86353e911bb9aecc8b2cb035ffdb4c2991718dab6ba5d5734133"
Jul 13 19:56:17.962984 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:56:17.962966    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf_odh-ai-gateway-infra(fc654ff2-655f-46ac-bbbd-af66c348e248)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248"
Jul 13 19:56:18.970447 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:18.970417    2550 scope.go:117] "RemoveContainer" containerID="976cc590738e86353e911bb9aecc8b2cb035ffdb4c2991718dab6ba5d5734133"
Jul 13 19:56:18.970871 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:56:18.970677    2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf_odh-ai-gateway-infra(fc654ff2-655f-46ac-bbbd-af66c348e248)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248"
Jul 13 19:56:25.923115 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:25.923075    2550 patch_prober.go:28] interesting pod/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 13 19:56:25.923585 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:25.923134    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 13 19:56:26.007460 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:26.007372    2550 generic.go:356] "Generic (PLEG): container finished" podID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerID="ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395" exitCode=0
Jul 13 19:56:26.007636 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:26.007453    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" event={"ID":"6e75c2f2-b9ee-4842-98e7-1590b4d35164","Type":"ContainerDied","Data":"ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395"}
Jul 13 19:56:26.007956 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:26.007939    2550 scope.go:117] "RemoveContainer" containerID="ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395"
Jul 13 19:56:26.009033 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:26.009005    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:56:26.009093 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:26.009073    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:56:26.009131 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:26.009105    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:56:27.015289 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:27.015256    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" event={"ID":"6e75c2f2-b9ee-4842-98e7-1590b4d35164","Type":"ContainerStarted","Data":"b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1"}
Jul 13 19:56:27.058947 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:27.058899    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:27.059401 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:27.059368    2550 patch_prober.go:28] interesting pod/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 13 19:56:27.059515 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:27.059428    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 13 19:56:28.060213 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:28.060172    2550 patch_prober.go:28] interesting pod/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 13 19:56:28.060842 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:28.060784    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 13 19:56:29.060246 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:29.060195    2550 patch_prober.go:28] interesting pod/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 13 19:56:29.060760 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:29.060275    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 13 19:56:30.060133 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:30.060087    2550 patch_prober.go:28] interesting pod/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 13 19:56:30.060350 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:30.060208    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 13 19:56:31.063370 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:31.063340    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:31.063855 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:31.063733    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:31.064404 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:31.064385    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:56:32.539886 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:32.539842    2550 scope.go:117] "RemoveContainer" containerID="976cc590738e86353e911bb9aecc8b2cb035ffdb4c2991718dab6ba5d5734133"
Jul 13 19:56:33.046758 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:33.046717    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf" event={"ID":"fc654ff2-655f-46ac-bbbd-af66c348e248","Type":"ContainerStarted","Data":"789395213a9af419d42cf574cfdf3b7821f6197987590e0a44c7c19107bcb7bb"}
Jul 13 19:56:33.065653 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:33.065599    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf" podStartSLOduration=18.065582703 podStartE2EDuration="18.065582703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:56:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:56:33.065008047 +0000 UTC m=+1866.065498608" watchObservedRunningTime="2026-07-13 19:56:33.065582703 +0000 UTC m=+1866.066073304"
Jul 13 19:56:34.053397 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:34.053363    2550 generic.go:356] "Generic (PLEG): container finished" podID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerID="789395213a9af419d42cf574cfdf3b7821f6197987590e0a44c7c19107bcb7bb" exitCode=0
Jul 13 19:56:34.053840 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:34.053445    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf" event={"ID":"fc654ff2-655f-46ac-bbbd-af66c348e248","Type":"ContainerDied","Data":"789395213a9af419d42cf574cfdf3b7821f6197987590e0a44c7c19107bcb7bb"}
Jul 13 19:56:34.053840 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:34.053518    2550 scope.go:117] "RemoveContainer" containerID="976cc590738e86353e911bb9aecc8b2cb035ffdb4c2991718dab6ba5d5734133"
Jul 13 19:56:34.080400 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:34.080362    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"]
Jul 13 19:56:35.202455 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:35.202421    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"
Jul 13 19:56:35.251928 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:35.251895    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc654ff2-655f-46ac-bbbd-af66c348e248-maas-api-service-ca\") pod \"fc654ff2-655f-46ac-bbbd-af66c348e248\" (UID: \"fc654ff2-655f-46ac-bbbd-af66c348e248\") "
Jul 13 19:56:35.252291 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:35.252267    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc654ff2-655f-46ac-bbbd-af66c348e248-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fc654ff2-655f-46ac-bbbd-af66c348e248" (UID: "fc654ff2-655f-46ac-bbbd-af66c348e248"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:56:35.353562 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:35.353471    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc654ff2-655f-46ac-bbbd-af66c348e248-maas-api-service-ca\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:56:36.066348 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:36.066322    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"
Jul 13 19:56:36.066519 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:36.066314    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf" event={"ID":"fc654ff2-655f-46ac-bbbd-af66c348e248","Type":"ContainerDied","Data":"b2b11696fac3c06c8107cc0a29ce44b3768d7c56b601dfb09b934a127ae04415"}
Jul 13 19:56:36.066519 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:36.066444    2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2b11696fac3c06c8107cc0a29ce44b3768d7c56b601dfb09b934a127ae04415"
Jul 13 19:56:36.098424 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:36.098380    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"]
Jul 13 19:56:36.104029 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:36.103999    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-facb3ea1-ssrdf"]
Jul 13 19:56:37.545034 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:56:37.545003    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248" path="/var/lib/kubelet/pods/fc654ff2-655f-46ac-bbbd-af66c348e248/volumes"
Jul 13 19:57:41.553989 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.553949    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"]
Jul 13 19:57:41.554498 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.554192    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy" containerID="cri-o://b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1" gracePeriod=30
Jul 13 19:57:41.870393 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.870308    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"]
Jul 13 19:57:41.871013 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.870991    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerName="revoke-keys"
Jul 13 19:57:41.871069 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.871019    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerName="revoke-keys"
Jul 13 19:57:41.871069 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.871034    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerName="revoke-keys"
Jul 13 19:57:41.871069 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.871043    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerName="revoke-keys"
Jul 13 19:57:41.871170 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.871078    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerName="revoke-keys"
Jul 13 19:57:41.871170 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.871087    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerName="revoke-keys"
Jul 13 19:57:41.871246 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.871188    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerName="revoke-keys"
Jul 13 19:57:41.871246 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.871200    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerName="revoke-keys"
Jul 13 19:57:41.874899 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.874872    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.878376 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.878353    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-66d7f166-openshift-default-dockercfg-lhcvs\""
Jul 13 19:57:41.885563 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.885529    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"]
Jul 13 19:57:41.888319 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.888295    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-token\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.888477 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.888327    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-podinfo\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.888477 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.888351    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-credential-socket\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.888477 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.888374    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nln6\" (UniqueName: \"kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-kube-api-access-6nln6\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.888477 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.888427    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-socket\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.888477 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.888469    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-data\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.888753 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.888560    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-envoy\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.888753 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.888582    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-certs\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.888753 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.888616    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istiod-ca-cert\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.989884 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.989846    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-certs\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.989884 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.989892    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istiod-ca-cert\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.989933    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-token\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.989968    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-podinfo\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.990006    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-credential-socket\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.990039    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nln6\" (UniqueName: \"kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-kube-api-access-6nln6\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.990072    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-socket\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990134 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.990114    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-data\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990463 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.990188    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-envoy\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990463 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.990367    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-certs\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990597 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.990567    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-socket\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990647 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.990615    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-data\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990705 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.990684    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-credential-socket\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.990791 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.990769    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istiod-ca-cert\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.992574 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.992550    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-envoy\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.992766 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.992746    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-podinfo\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.998455 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.998425    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-token\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:41.998578 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:41.998503    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nln6\" (UniqueName: \"kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-kube-api-access-6nln6\") pod \"e2e-derive-66d7f166-openshift-default-7594bdb779-rz987\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") " pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:42.188164 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:42.188115    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:42.334322 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:42.334290    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"]
Jul 13 19:57:42.336603 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:57:42.336577    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f4dcbf_1fc3_49de_98ed_ab357bde0e40.slice/crio-5fb2fc63c03812cdb98b03fcb1914427246f07266e58daa2bbd7bb9be3fbe3ec WatchSource:0}: Error finding container 5fb2fc63c03812cdb98b03fcb1914427246f07266e58daa2bbd7bb9be3fbe3ec: Status 404 returned error can't find the container with id 5fb2fc63c03812cdb98b03fcb1914427246f07266e58daa2bbd7bb9be3fbe3ec
Jul 13 19:57:42.339306 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:42.339273    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:57:42.339399 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:42.339338    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:57:42.339399 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:42.339374    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:57:42.410551 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:42.410505    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" event={"ID":"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40","Type":"ContainerStarted","Data":"58c69f6927a77c66e33aa7951f053d204d3fe74556e926044eff198d2c866a16"}
Jul 13 19:57:42.410708 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:42.410573    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" event={"ID":"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40","Type":"ContainerStarted","Data":"5fb2fc63c03812cdb98b03fcb1914427246f07266e58daa2bbd7bb9be3fbe3ec"}
Jul 13 19:57:42.430558 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:42.430485    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" podStartSLOduration=1.43046787 podStartE2EDuration="1.43046787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 19:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 19:57:42.42806117 +0000 UTC m=+1935.428551731" watchObservedRunningTime="2026-07-13 19:57:42.43046787 +0000 UTC m=+1935.430958433"
Jul 13 19:57:43.188746 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:43.188711    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:43.214843 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:43.214789    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:43.416291 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:43.416261    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:43.417203 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:43.417185    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:57:46.065678 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.065635    2550 patch_prober.go:28] interesting pod/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 19:57:46.066088 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.065694    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 19:57:46.812976 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.812951    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:57:46.840407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.840293    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-podinfo\") pod \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") "
Jul 13 19:57:46.840407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.840355    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-certs\") pod \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") "
Jul 13 19:57:46.840407 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.840401    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-socket\") pod \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") "
Jul 13 19:57:46.840847 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.840757    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e75c2f2-b9ee-4842-98e7-1590b4d35164" (UID: "6e75c2f2-b9ee-4842-98e7-1590b4d35164"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:57:46.840847 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.840796    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e75c2f2-b9ee-4842-98e7-1590b4d35164" (UID: "6e75c2f2-b9ee-4842-98e7-1590b4d35164"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:57:46.840997 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.840905    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istiod-ca-cert\") pod \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") "
Jul 13 19:57:46.840997 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.840945    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-token\") pod \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") "
Jul 13 19:57:46.840997 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.840974    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-data\") pod \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") "
Jul 13 19:57:46.841155 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.841025    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-envoy\") pod \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") "
Jul 13 19:57:46.841155 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.841084    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-credential-socket\") pod \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") "
Jul 13 19:57:46.841155 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.841131    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g4gk\" (UniqueName: \"kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-kube-api-access-8g4gk\") pod \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\" (UID: \"6e75c2f2-b9ee-4842-98e7-1590b4d35164\") "
Jul 13 19:57:46.841759 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.841506    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e75c2f2-b9ee-4842-98e7-1590b4d35164" (UID: "6e75c2f2-b9ee-4842-98e7-1590b4d35164"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:57:46.842126 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.841891    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e75c2f2-b9ee-4842-98e7-1590b4d35164" (UID: "6e75c2f2-b9ee-4842-98e7-1590b4d35164"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:57:46.842979 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.842943    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e75c2f2-b9ee-4842-98e7-1590b4d35164" (UID: "6e75c2f2-b9ee-4842-98e7-1590b4d35164"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:57:46.843529 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.843404    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:57:46.843529 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.843435    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:57:46.843529 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.843451    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:57:46.843529 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.843465    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:57:46.843529 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.843480    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:57:46.843840 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.843562    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e75c2f2-b9ee-4842-98e7-1590b4d35164" (UID: "6e75c2f2-b9ee-4842-98e7-1590b4d35164"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:57:46.844465 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.844401    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e75c2f2-b9ee-4842-98e7-1590b4d35164" (UID: "6e75c2f2-b9ee-4842-98e7-1590b4d35164"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:57:46.844465 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.844426    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e75c2f2-b9ee-4842-98e7-1590b4d35164" (UID: "6e75c2f2-b9ee-4842-98e7-1590b4d35164"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:57:46.846058 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.846028    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-kube-api-access-8g4gk" (OuterVolumeSpecName: "kube-api-access-8g4gk") pod "6e75c2f2-b9ee-4842-98e7-1590b4d35164" (UID: "6e75c2f2-b9ee-4842-98e7-1590b4d35164"). InnerVolumeSpecName "kube-api-access-8g4gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:57:46.944611 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.944573    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:57:46.944611 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.944603    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g4gk\" (UniqueName: \"kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-kube-api-access-8g4gk\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:57:46.944611 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.944614    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:57:46.944887 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:46.944622    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e75c2f2-b9ee-4842-98e7-1590b4d35164-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:57:47.437657 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.437623    2550 generic.go:356] "Generic (PLEG): container finished" podID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerID="b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1" exitCode=0
Jul 13 19:57:47.438115 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.437710    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"
Jul 13 19:57:47.438115 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.437711    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" event={"ID":"6e75c2f2-b9ee-4842-98e7-1590b4d35164","Type":"ContainerDied","Data":"b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1"}
Jul 13 19:57:47.438115 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.437824    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc" event={"ID":"6e75c2f2-b9ee-4842-98e7-1590b4d35164","Type":"ContainerDied","Data":"9aed64b239b29040a7365ef6ff6e08d9807d632f65082ce835d7c041d3f7e141"}
Jul 13 19:57:47.438115 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.437856    2550 scope.go:117] "RemoveContainer" containerID="b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1"
Jul 13 19:57:47.448307 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.447987    2550 scope.go:117] "RemoveContainer" containerID="ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395"
Jul 13 19:57:47.458233 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.458211    2550 scope.go:117] "RemoveContainer" containerID="b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1"
Jul 13 19:57:47.458587 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:57:47.458567    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1\": container with ID starting with b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1 not found: ID does not exist" containerID="b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1"
Jul 13 19:57:47.458637 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.458599    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1"} err="failed to get container status \"b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1\": rpc error: code = NotFound desc = could not find container \"b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1\": container with ID starting with b5caf4113a193a76ff5539919c0b36024523e292d2c6580197068e9eeba2c1e1 not found: ID does not exist"
Jul 13 19:57:47.458637 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.458619    2550 scope.go:117] "RemoveContainer" containerID="ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395"
Jul 13 19:57:47.458948 ip-10-0-143-201 kubenswrapper[2550]: E0713 19:57:47.458924    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395\": container with ID starting with ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395 not found: ID does not exist" containerID="ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395"
Jul 13 19:57:47.459008 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.458955    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395"} err="failed to get container status \"ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395\": rpc error: code = NotFound desc = could not find container \"ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395\": container with ID starting with ac904e14449c923bc3249567355bc1e4ea0c4c1ec10e7377157accc004a5e395 not found: ID does not exist"
Jul 13 19:57:47.466668 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.466639    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"]
Jul 13 19:57:47.474118 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.474084    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-facb3ea1-openshift-default-6fdc79664c-dsmqc"]
Jul 13 19:57:47.547879 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:47.547842    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" path="/var/lib/kubelet/pods/6e75c2f2-b9ee-4842-98e7-1590b4d35164/volumes"
Jul 13 19:57:58.423099 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:58.422875    2550 patch_prober.go:28] interesting pod/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:33836->10.133.0.43:15021: read: connection reset by peer" start-of-body=
Jul 13 19:57:58.423099 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:58.422946    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": read tcp 10.133.0.2:33836->10.133.0.43:15021: read: connection reset by peer"
Jul 13 19:57:58.501253 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:58.501221    2550 generic.go:356] "Generic (PLEG): container finished" podID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerID="58c69f6927a77c66e33aa7951f053d204d3fe74556e926044eff198d2c866a16" exitCode=0
Jul 13 19:57:58.501420 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:58.501282    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" event={"ID":"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40","Type":"ContainerDied","Data":"58c69f6927a77c66e33aa7951f053d204d3fe74556e926044eff198d2c866a16"}
Jul 13 19:57:58.501710 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:58.501697    2550 scope.go:117] "RemoveContainer" containerID="58c69f6927a77c66e33aa7951f053d204d3fe74556e926044eff198d2c866a16"
Jul 13 19:57:58.502728 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:58.502692    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:57:58.502852 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:58.502766    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:57:58.502904 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:58.502848    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 19:57:59.508606 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:57:59.508572    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" event={"ID":"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40","Type":"ContainerStarted","Data":"a3c30b3c4d4791b245f3d79fb7779e3bce09313d0612d113bcf13d1375df667e"}
Jul 13 19:58:00.189372 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:00.189329    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:58:00.189592 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:00.189568    2550 patch_prober.go:28] interesting pod/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 13 19:58:00.189647 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:00.189630    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 13 19:58:01.188542 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:01.188505    2550 patch_prober.go:28] interesting pod/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 13 19:58:01.188968 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:01.188576    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 13 19:58:02.189304 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:02.189264    2550 patch_prober.go:28] interesting pod/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 13 19:58:02.189695 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:02.189346    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 13 19:58:03.189094 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:03.189060    2550 patch_prober.go:28] interesting pod/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 13 19:58:03.189283 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:03.189117    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 13 19:58:04.192781 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:04.192750    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:58:04.193217 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:04.193009    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:58:04.193719 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:04.193696    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:58:47.506024 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.505984    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5"]
Jul 13 19:58:47.506615 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.506595    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy"
Jul 13 19:58:47.506704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.506618    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy"
Jul 13 19:58:47.506704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.506650    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy"
Jul 13 19:58:47.506704 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.506660    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy"
Jul 13 19:58:47.506884 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.506780    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy"
Jul 13 19:58:47.506884 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.506793    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc654ff2-655f-46ac-bbbd-af66c348e248" containerName="revoke-keys"
Jul 13 19:58:47.506884 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.506822    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e75c2f2-b9ee-4842-98e7-1590b4d35164" containerName="istio-proxy"
Jul 13 19:58:47.509898 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.509876    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5"
Jul 13 19:58:47.512726 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.512696    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hk9td\""
Jul 13 19:58:47.517274 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.517247    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5"]
Jul 13 19:58:47.641532 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.641488    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd5ac1c4-c77e-4925-89ff-cf422841a84b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5\" (UID: \"cd5ac1c4-c77e-4925-89ff-cf422841a84b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5"
Jul 13 19:58:47.742488 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.742446    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd5ac1c4-c77e-4925-89ff-cf422841a84b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5\" (UID: \"cd5ac1c4-c77e-4925-89ff-cf422841a84b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5"
Jul 13 19:58:47.743110 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.743093    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd5ac1c4-c77e-4925-89ff-cf422841a84b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5\" (UID: \"cd5ac1c4-c77e-4925-89ff-cf422841a84b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5"
Jul 13 19:58:47.823730 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.823634    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5"
Jul 13 19:58:47.965356 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:47.965326    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5"]
Jul 13 19:58:47.967988 ip-10-0-143-201 kubenswrapper[2550]: W0713 19:58:47.967959    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5ac1c4_c77e_4925_89ff_cf422841a84b.slice/crio-6402b4796994820fd8fa4af865210dd5abfd272d7984886bd89802e563779cc9 WatchSource:0}: Error finding container 6402b4796994820fd8fa4af865210dd5abfd272d7984886bd89802e563779cc9: Status 404 returned error can't find the container with id 6402b4796994820fd8fa4af865210dd5abfd272d7984886bd89802e563779cc9
Jul 13 19:58:48.763138 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:48.763096    2550 generic.go:356] "Generic (PLEG): container finished" podID="cd5ac1c4-c77e-4925-89ff-cf422841a84b" containerID="340ebe95bb1fa277f729e146db5d853c720a183b922d4c8b24a20bb16d50422f" exitCode=0
Jul 13 19:58:48.763579 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:48.763149    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5" event={"ID":"cd5ac1c4-c77e-4925-89ff-cf422841a84b","Type":"ContainerDied","Data":"340ebe95bb1fa277f729e146db5d853c720a183b922d4c8b24a20bb16d50422f"}
Jul 13 19:58:48.763579 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:48.763240    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5" event={"ID":"cd5ac1c4-c77e-4925-89ff-cf422841a84b","Type":"ContainerStarted","Data":"6402b4796994820fd8fa4af865210dd5abfd272d7984886bd89802e563779cc9"}
Jul 13 19:58:49.910791 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:49.910765    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5"
Jul 13 19:58:50.064716 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:50.064611    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd5ac1c4-c77e-4925-89ff-cf422841a84b-maas-api-service-ca\") pod \"cd5ac1c4-c77e-4925-89ff-cf422841a84b\" (UID: \"cd5ac1c4-c77e-4925-89ff-cf422841a84b\") "
Jul 13 19:58:50.065039 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:50.065014    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd5ac1c4-c77e-4925-89ff-cf422841a84b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cd5ac1c4-c77e-4925-89ff-cf422841a84b" (UID: "cd5ac1c4-c77e-4925-89ff-cf422841a84b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:58:50.165750 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:50.165709    2550 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd5ac1c4-c77e-4925-89ff-cf422841a84b-maas-api-service-ca\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:58:50.774069 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:50.774039    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5"
Jul 13 19:58:50.774262 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:50.774083    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5" event={"ID":"cd5ac1c4-c77e-4925-89ff-cf422841a84b","Type":"ContainerDied","Data":"6402b4796994820fd8fa4af865210dd5abfd272d7984886bd89802e563779cc9"}
Jul 13 19:58:50.774262 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:58:50.774136    2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6402b4796994820fd8fa4af865210dd5abfd272d7984886bd89802e563779cc9"
Jul 13 19:59:12.746155 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:12.746118    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"]
Jul 13 19:59:12.746723 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:12.746345    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy" containerID="cri-o://a3c30b3c4d4791b245f3d79fb7779e3bce09313d0612d113bcf13d1375df667e" gracePeriod=30
Jul 13 19:59:17.911772 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:17.911737    2550 generic.go:356] "Generic (PLEG): container finished" podID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerID="a3c30b3c4d4791b245f3d79fb7779e3bce09313d0612d113bcf13d1375df667e" exitCode=0
Jul 13 19:59:17.912347 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:17.911835    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" event={"ID":"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40","Type":"ContainerDied","Data":"a3c30b3c4d4791b245f3d79fb7779e3bce09313d0612d113bcf13d1375df667e"}
Jul 13 19:59:17.912347 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:17.911915    2550 scope.go:117] "RemoveContainer" containerID="58c69f6927a77c66e33aa7951f053d204d3fe74556e926044eff198d2c866a16"
Jul 13 19:59:18.007722 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.007695    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:59:18.135917 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.135880    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istiod-ca-cert\") pod \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") "
Jul 13 19:59:18.136112 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.135959    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-data\") pod \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") "
Jul 13 19:59:18.136112 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.135986    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-token\") pod \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") "
Jul 13 19:59:18.136112 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136000    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-envoy\") pod \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") "
Jul 13 19:59:18.136112 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136019    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-socket\") pod \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") "
Jul 13 19:59:18.136112 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136064    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-certs\") pod \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") "
Jul 13 19:59:18.136112 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136107    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-podinfo\") pod \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") "
Jul 13 19:59:18.136421 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136132    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nln6\" (UniqueName: \"kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-kube-api-access-6nln6\") pod \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") "
Jul 13 19:59:18.136421 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136173    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-credential-socket\") pod \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\" (UID: \"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40\") "
Jul 13 19:59:18.136421 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136358    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" (UID: "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:59:18.136421 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136377    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" (UID: "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:59:18.136421 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136391    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" (UID: "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 19:59:18.136688 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136560    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:59:18.136688 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136581    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:59:18.136688 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136594    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:59:18.136688 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.136594    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" (UID: "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:59:18.137100 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.137072    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" (UID: "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:59:18.138361 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.138332    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" (UID: "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:59:18.138465 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.138403    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" (UID: "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 19:59:18.138982 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.138955    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-kube-api-access-6nln6" (OuterVolumeSpecName: "kube-api-access-6nln6") pod "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" (UID: "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40"). InnerVolumeSpecName "kube-api-access-6nln6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 19:59:18.139090 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.138970    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" (UID: "b9f4dcbf-1fc3-49de-98ed-ab357bde0e40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 19:59:18.237927 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.237890    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:59:18.237927 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.237922    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:59:18.237927 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.237930    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:59:18.237927 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.237937    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:59:18.238202 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.237946    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nln6\" (UniqueName: \"kubernetes.io/projected/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-kube-api-access-6nln6\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:59:18.238202 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.237956    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 19:59:18.918936 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.918902    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"
Jul 13 19:59:18.919384 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.918950    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987" event={"ID":"b9f4dcbf-1fc3-49de-98ed-ab357bde0e40","Type":"ContainerDied","Data":"5fb2fc63c03812cdb98b03fcb1914427246f07266e58daa2bbd7bb9be3fbe3ec"}
Jul 13 19:59:18.919384 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.919014    2550 scope.go:117] "RemoveContainer" containerID="a3c30b3c4d4791b245f3d79fb7779e3bce09313d0612d113bcf13d1375df667e"
Jul 13 19:59:18.941693 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.941662    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"]
Jul 13 19:59:18.946118 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:18.946095    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-66d7f166-openshift-default-7594bdb779-rz987"]
Jul 13 19:59:19.545754 ip-10-0-143-201 kubenswrapper[2550]: I0713 19:59:19.545671    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" path="/var/lib/kubelet/pods/b9f4dcbf-1fc3-49de-98ed-ab357bde0e40/volumes"
Jul 13 20:00:00.137815 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.137767    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb"]
Jul 13 20:00:00.138285 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.138186    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy"
Jul 13 20:00:00.138285 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.138198    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy"
Jul 13 20:00:00.138285 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.138213    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd5ac1c4-c77e-4925-89ff-cf422841a84b" containerName="revoke-keys"
Jul 13 20:00:00.138285 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.138219    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd5ac1c4-c77e-4925-89ff-cf422841a84b" containerName="revoke-keys"
Jul 13 20:00:00.138285 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.138228    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy"
Jul 13 20:00:00.138285 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.138238    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy"
Jul 13 20:00:00.138496 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.138306    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd5ac1c4-c77e-4925-89ff-cf422841a84b" containerName="revoke-keys"
Jul 13 20:00:00.138496 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.138351    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy"
Jul 13 20:00:00.141366 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.141348    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb"
Jul 13 20:00:00.144333 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.144312    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hk9td\""
Jul 13 20:00:00.147850 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.147825    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb"]
Jul 13 20:00:00.153369 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.153349    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb"
Jul 13 20:00:00.496616 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:00.496590    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb"]
Jul 13 20:00:00.498980 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:00:00.498941    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16bcd19_610c_425f_9d1b_2abeda452041.slice/crio-13eb976f457b33ce1c262e9185bc73b922027f224ffcbd5d044dda13ca8bcdff WatchSource:0}: Error finding container 13eb976f457b33ce1c262e9185bc73b922027f224ffcbd5d044dda13ca8bcdff: Status 404 returned error can't find the container with id 13eb976f457b33ce1c262e9185bc73b922027f224ffcbd5d044dda13ca8bcdff
Jul 13 20:00:01.125617 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:01.125522    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb" event={"ID":"d16bcd19-610c-425f-9d1b-2abeda452041","Type":"ContainerStarted","Data":"b0608a39ef2b9396b3d752573e3e8ec4eb5dae63af63a8d68fed3f2f1cb29f10"}
Jul 13 20:00:01.125617 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:01.125572    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb" event={"ID":"d16bcd19-610c-425f-9d1b-2abeda452041","Type":"ContainerStarted","Data":"13eb976f457b33ce1c262e9185bc73b922027f224ffcbd5d044dda13ca8bcdff"}
Jul 13 20:00:01.143818 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:01.143760    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb" podStartSLOduration=1.143744583 podStartE2EDuration="1.143744583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:00:01.142463647 +0000 UTC m=+2074.142954207" watchObservedRunningTime="2026-07-13 20:00:01.143744583 +0000 UTC m=+2074.144235142"
Jul 13 20:00:02.132421 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:02.132387    2550 generic.go:356] "Generic (PLEG): container finished" podID="d16bcd19-610c-425f-9d1b-2abeda452041" containerID="b0608a39ef2b9396b3d752573e3e8ec4eb5dae63af63a8d68fed3f2f1cb29f10" exitCode=0
Jul 13 20:00:02.132607 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:02.132476    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb" event={"ID":"d16bcd19-610c-425f-9d1b-2abeda452041","Type":"ContainerDied","Data":"b0608a39ef2b9396b3d752573e3e8ec4eb5dae63af63a8d68fed3f2f1cb29f10"}
Jul 13 20:00:03.280773 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:03.280746    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb"
Jul 13 20:00:04.143659 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:04.143633    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb"
Jul 13 20:00:04.143858 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:04.143676    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29732880-kxkgb" event={"ID":"d16bcd19-610c-425f-9d1b-2abeda452041","Type":"ContainerDied","Data":"13eb976f457b33ce1c262e9185bc73b922027f224ffcbd5d044dda13ca8bcdff"}
Jul 13 20:00:04.143858 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:04.143725    2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13eb976f457b33ce1c262e9185bc73b922027f224ffcbd5d044dda13ca8bcdff"
Jul 13 20:00:27.569053 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:27.569025    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 20:00:27.574647 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:27.574623    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 20:00:49.720966 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.720930    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"]
Jul 13 20:00:49.721482 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.721437    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16bcd19-610c-425f-9d1b-2abeda452041" containerName="cleanup"
Jul 13 20:00:49.721482 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.721454    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16bcd19-610c-425f-9d1b-2abeda452041" containerName="cleanup"
Jul 13 20:00:49.721558 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.721521    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9f4dcbf-1fc3-49de-98ed-ab357bde0e40" containerName="istio-proxy"
Jul 13 20:00:49.721558 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.721532    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="d16bcd19-610c-425f-9d1b-2abeda452041" containerName="cleanup"
Jul 13 20:00:49.724850 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.724835    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.727608 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.727586    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 20:00:49.727845 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.727829    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d94baa8e-openshift-default-dockercfg-cd8f5\""
Jul 13 20:00:49.736025 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.735991    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"]
Jul 13 20:00:49.792265 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.792222    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-certs\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.792265 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.792272    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-podinfo\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.792514 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.792314    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-envoy\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.792514 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.792332    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn9hs\" (UniqueName: \"kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-kube-api-access-pn9hs\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.792514 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.792362    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-credential-socket\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.792514 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.792430    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-token\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.792514 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.792454    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istiod-ca-cert\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.792514 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.792511    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-socket\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.792750 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.792553    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-data\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.893565 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.893520    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-token\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.893565 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.893564    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istiod-ca-cert\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.893867 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.893597    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-socket\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.893867 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.893628    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-data\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.893867 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.893655    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-certs\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.893867 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.893688    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-podinfo\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.893867 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.893858    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-envoy\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.894144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.893903    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn9hs\" (UniqueName: \"kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-kube-api-access-pn9hs\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.894144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.893949    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-credential-socket\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.894144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.894115    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-socket\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.894278 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.894154    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-data\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.894347 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.894324    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-certs\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.894399 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.894361    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-credential-socket\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.894624 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.894568    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istiod-ca-cert\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.896241 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.896219    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-envoy\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.896482 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.896465    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-podinfo\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.902923 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.902890    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn9hs\" (UniqueName: \"kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-kube-api-access-pn9hs\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:49.903146 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:49.903125    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-token\") pod \"e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") " pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:50.036890 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:50.036785    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:50.192216 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:50.192187    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"]
Jul 13 20:00:50.194188 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:00:50.194151    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2e58b1_09ab_43c4_9d36_cf5634609af6.slice/crio-4cfce9f6fe99e871154c2b88abe7833fbbc4e654c99ec6242a4b9a72e3b6cfeb WatchSource:0}: Error finding container 4cfce9f6fe99e871154c2b88abe7833fbbc4e654c99ec6242a4b9a72e3b6cfeb: Status 404 returned error can't find the container with id 4cfce9f6fe99e871154c2b88abe7833fbbc4e654c99ec6242a4b9a72e3b6cfeb
Jul 13 20:00:50.196471 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:50.196434    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:00:50.196546 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:50.196503    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:00:50.196546 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:50.196533    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:00:50.382966 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:50.382856    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" event={"ID":"4a2e58b1-09ab-43c4-9d36-cf5634609af6","Type":"ContainerStarted","Data":"3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29"}
Jul 13 20:00:50.382966 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:50.382928    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" event={"ID":"4a2e58b1-09ab-43c4-9d36-cf5634609af6","Type":"ContainerStarted","Data":"4cfce9f6fe99e871154c2b88abe7833fbbc4e654c99ec6242a4b9a72e3b6cfeb"}
Jul 13 20:00:50.403376 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:50.403318    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" podStartSLOduration=1.403299862 podStartE2EDuration="1.403299862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:00:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:00:50.402232891 +0000 UTC m=+2123.402723445" watchObservedRunningTime="2026-07-13 20:00:50.403299862 +0000 UTC m=+2123.403790422"
Jul 13 20:00:51.037283 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:51.037251    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:51.042393 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:51.042367    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:51.388962 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:51.388845    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:00:51.390004 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:00:51.389985    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:01:07.430990 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:07.430950    2550 patch_prober.go:28] interesting pod/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 20:01:07.431449 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:07.431014    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 20:01:08.488288 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:08.488252    2550 generic.go:356] "Generic (PLEG): container finished" podID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerID="3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29" exitCode=0
Jul 13 20:01:08.488772 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:08.488317    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" event={"ID":"4a2e58b1-09ab-43c4-9d36-cf5634609af6","Type":"ContainerDied","Data":"3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29"}
Jul 13 20:01:08.488772 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:08.488708    2550 scope.go:117] "RemoveContainer" containerID="3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29"
Jul 13 20:01:08.489764 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:08.489733    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:01:08.489842 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:08.489818    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:01:08.489887 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:08.489856    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:01:09.494899 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:09.494864    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" event={"ID":"4a2e58b1-09ab-43c4-9d36-cf5634609af6","Type":"ContainerStarted","Data":"bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd"}
Jul 13 20:01:10.037602 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:10.037554    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:01:10.037935 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:10.037909    2550 patch_prober.go:28] interesting pod/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 13 20:01:10.038420 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:10.038132    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 13 20:01:11.037500 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:11.037461    2550 patch_prober.go:28] interesting pod/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 13 20:01:11.038038 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:11.037553    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 13 20:01:12.038275 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:12.038230    2550 patch_prober.go:28] interesting pod/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 13 20:01:12.038796 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:12.038309    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 13 20:01:13.037681 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:13.037629    2550 patch_prober.go:28] interesting pod/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 13 20:01:13.037934 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:13.037705    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 13 20:01:14.040652 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:14.040617    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:01:14.041060 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:14.041003    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:01:14.041849 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:14.041830    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:01:27.640540 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:27.640466    2550 scope.go:117] "RemoveContainer" containerID="ff936d7a64b7ad0292ce7b0c518e4bed60aa064de9da42ac3f948d417f6cc723"
Jul 13 20:01:30.145095 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:30.145057    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"]
Jul 13 20:01:30.145562 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:30.145281    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy" containerID="cri-o://bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd" gracePeriod=30
Jul 13 20:01:35.398824 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.398782    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:01:35.533622 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.533578    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-podinfo\") pod \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") "
Jul 13 20:01:35.533870 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.533631    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pn9hs\" (UniqueName: \"kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-kube-api-access-pn9hs\") pod \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") "
Jul 13 20:01:35.533870 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.533658    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-token\") pod \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") "
Jul 13 20:01:35.533870 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.533715    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istiod-ca-cert\") pod \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") "
Jul 13 20:01:35.533870 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.533744    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-certs\") pod \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") "
Jul 13 20:01:35.533870 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.533786    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-credential-socket\") pod \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") "
Jul 13 20:01:35.533870 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.533870    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-data\") pod \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") "
Jul 13 20:01:35.534227 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.533900    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-envoy\") pod \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") "
Jul 13 20:01:35.534227 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.533961    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-socket\") pod \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\" (UID: \"4a2e58b1-09ab-43c4-9d36-cf5634609af6\") "
Jul 13 20:01:35.534227 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.534158    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a2e58b1-09ab-43c4-9d36-cf5634609af6" (UID: "4a2e58b1-09ab-43c4-9d36-cf5634609af6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:01:35.534385 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.534273    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a2e58b1-09ab-43c4-9d36-cf5634609af6" (UID: "4a2e58b1-09ab-43c4-9d36-cf5634609af6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:01:35.534444 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.534396    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a2e58b1-09ab-43c4-9d36-cf5634609af6" (UID: "4a2e58b1-09ab-43c4-9d36-cf5634609af6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:01:35.534444 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.534421    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:01:35.534444 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.534440    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:01:35.535867 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.535841    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a2e58b1-09ab-43c4-9d36-cf5634609af6" (UID: "4a2e58b1-09ab-43c4-9d36-cf5634609af6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:01:35.536260 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.536227    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a2e58b1-09ab-43c4-9d36-cf5634609af6" (UID: "4a2e58b1-09ab-43c4-9d36-cf5634609af6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:01:35.536366 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.536309    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a2e58b1-09ab-43c4-9d36-cf5634609af6" (UID: "4a2e58b1-09ab-43c4-9d36-cf5634609af6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:01:35.536425 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.536379    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a2e58b1-09ab-43c4-9d36-cf5634609af6" (UID: "4a2e58b1-09ab-43c4-9d36-cf5634609af6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:01:35.536532 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.536509    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-kube-api-access-pn9hs" (OuterVolumeSpecName: "kube-api-access-pn9hs") pod "4a2e58b1-09ab-43c4-9d36-cf5634609af6" (UID: "4a2e58b1-09ab-43c4-9d36-cf5634609af6"). InnerVolumeSpecName "kube-api-access-pn9hs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:01:35.536532 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.536522    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a2e58b1-09ab-43c4-9d36-cf5634609af6" (UID: "4a2e58b1-09ab-43c4-9d36-cf5634609af6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 20:01:35.629563 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.629533    2550 generic.go:356] "Generic (PLEG): container finished" podID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerID="bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd" exitCode=0
Jul 13 20:01:35.629741 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.629587    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"
Jul 13 20:01:35.629741 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.629621    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" event={"ID":"4a2e58b1-09ab-43c4-9d36-cf5634609af6","Type":"ContainerDied","Data":"bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd"}
Jul 13 20:01:35.629741 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.629685    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg" event={"ID":"4a2e58b1-09ab-43c4-9d36-cf5634609af6","Type":"ContainerDied","Data":"4cfce9f6fe99e871154c2b88abe7833fbbc4e654c99ec6242a4b9a72e3b6cfeb"}
Jul 13 20:01:35.629741 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.629715    2550 scope.go:117] "RemoveContainer" containerID="bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd"
Jul 13 20:01:35.635101 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.635080    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:01:35.635101 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.635101    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:01:35.635247 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.635110    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:01:35.635247 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.635123    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a2e58b1-09ab-43c4-9d36-cf5634609af6-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:01:35.635247 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.635135    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:01:35.635247 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.635143    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pn9hs\" (UniqueName: \"kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-kube-api-access-pn9hs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:01:35.635247 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.635151    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a2e58b1-09ab-43c4-9d36-cf5634609af6-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:01:35.639127 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.639108    2550 scope.go:117] "RemoveContainer" containerID="3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29"
Jul 13 20:01:35.647707 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.647685    2550 scope.go:117] "RemoveContainer" containerID="bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd"
Jul 13 20:01:35.648026 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:01:35.648006    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd\": container with ID starting with bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd not found: ID does not exist" containerID="bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd"
Jul 13 20:01:35.648121 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.648038    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd"} err="failed to get container status \"bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd\": rpc error: code = NotFound desc = could not find container \"bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd\": container with ID starting with bbcbbb99b3541d1dc4b3ca743dcd57c8134986e984eb38befb988f0ba9e6bfcd not found: ID does not exist"
Jul 13 20:01:35.648121 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.648064    2550 scope.go:117] "RemoveContainer" containerID="3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29"
Jul 13 20:01:35.648318 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:01:35.648300    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29\": container with ID starting with 3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29 not found: ID does not exist" containerID="3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29"
Jul 13 20:01:35.648358 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.648322    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29"} err="failed to get container status \"3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29\": rpc error: code = NotFound desc = could not find container \"3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29\": container with ID starting with 3f2bc7f4bee0fa8f2cd231a6838f5634c4566d3a5fe17fd0f6ead3d6a643be29 not found: ID does not exist"
Jul 13 20:01:35.649626 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.649608    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"]
Jul 13 20:01:35.654671 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:35.654651    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d94baa8e-openshift-default-756bdf95-xsrlg"]
Jul 13 20:01:37.546299 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:37.546268    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" path="/var/lib/kubelet/pods/4a2e58b1-09ab-43c4-9d36-cf5634609af6/volumes"
Jul 13 20:01:49.783432 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.783394    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"]
Jul 13 20:01:49.783892 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.783788    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy"
Jul 13 20:01:49.783892 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.783814    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy"
Jul 13 20:01:49.783892 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.783825    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy"
Jul 13 20:01:49.783892 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.783830    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy"
Jul 13 20:01:49.784028 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.783903    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy"
Jul 13 20:01:49.788557 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.788538    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.791443 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.791418    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-02a26ce0-openshift-default-dockercfg-jmd6x\""
Jul 13 20:01:49.791443 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.791439    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 20:01:49.798474 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.798444    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"]
Jul 13 20:01:49.871573 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.871541    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-socket\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.871786 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.871588    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istiod-ca-cert\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.871786 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.871669    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-data\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.871786 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.871717    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-token\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.871786 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.871778    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-certs\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.871990 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.871818    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5bdk\" (UniqueName: \"kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-kube-api-access-f5bdk\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.871990 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.871839    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-envoy\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.871990 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.871854    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-podinfo\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.871990 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.871872    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-credential-socket\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973112 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973069    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-credential-socket\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973112 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973116    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-socket\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973384 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973257    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istiod-ca-cert\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973384 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973326    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-data\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973384 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973372    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-token\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973543 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973452    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-certs\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973543 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973479    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-credential-socket\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973543 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973500    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5bdk\" (UniqueName: \"kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-kube-api-access-f5bdk\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973543 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973533    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-socket\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973839 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973538    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-envoy\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973839 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973589    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-podinfo\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973839 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973695    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-data\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.973970 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973899    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-certs\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.974009 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.973989    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istiod-ca-cert\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.975848 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.975829    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-envoy\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.976135 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.976117    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-podinfo\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.982367 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.982343    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5bdk\" (UniqueName: \"kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-kube-api-access-f5bdk\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:49.982480 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:49.982367    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-token\") pod \"e2e-mt-02a26ce0-openshift-default-6975888895-mfph6\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") " pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:50.099595 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:50.099480    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:50.247919 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:50.247887    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"]
Jul 13 20:01:50.250598 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:01:50.250557    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376c7c74_d1dc_4c60_9bc5_07d3850ede7e.slice/crio-e266418d59e30e5adf254d1dd86338fbbeaa48b8c65dbe50faf93a4403ef6f37 WatchSource:0}: Error finding container e266418d59e30e5adf254d1dd86338fbbeaa48b8c65dbe50faf93a4403ef6f37: Status 404 returned error can't find the container with id e266418d59e30e5adf254d1dd86338fbbeaa48b8c65dbe50faf93a4403ef6f37
Jul 13 20:01:50.252743 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:50.252707    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:01:50.252880 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:50.252778    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:01:50.252880 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:50.252832    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:01:50.712241 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:50.712201    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" event={"ID":"376c7c74-d1dc-4c60-9bc5-07d3850ede7e","Type":"ContainerStarted","Data":"d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b"}
Jul 13 20:01:50.712414 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:50.712255    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" event={"ID":"376c7c74-d1dc-4c60-9bc5-07d3850ede7e","Type":"ContainerStarted","Data":"e266418d59e30e5adf254d1dd86338fbbeaa48b8c65dbe50faf93a4403ef6f37"}
Jul 13 20:01:50.734074 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:50.734026    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" podStartSLOduration=1.734009408 podStartE2EDuration="1.734009408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:01:50.732730145 +0000 UTC m=+2183.733220717" watchObservedRunningTime="2026-07-13 20:01:50.734009408 +0000 UTC m=+2183.734499968"
Jul 13 20:01:51.099961 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:51.099868    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:51.104485 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:51.104459    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:51.718370 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:51.718340    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:01:51.719323 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:01:51.719302    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:02:06.371999 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.371910    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"]
Jul 13 20:02:06.372397 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.372384    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a2e58b1-09ab-43c4-9d36-cf5634609af6" containerName="istio-proxy"
Jul 13 20:02:06.375477 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.375461    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.378747 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.378720    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-02a26ce0\"/\"kube-root-ca.crt\""
Jul 13 20:02:06.380188 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.380163    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-02a26ce0\"/\"default-dockercfg-25jgn\""
Jul 13 20:02:06.380324 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.380217    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-02a26ce0\"/\"e2e-lifecycle-model-02a26ce0-kserve-self-signed-certs\""
Jul 13 20:02:06.380324 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.380231    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-02a26ce0\"/\"openshift-service-ca.crt\""
Jul 13 20:02:06.386049 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.386027    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"]
Jul 13 20:02:06.434373 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.434335    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-tmp-dir\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.434555 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.434381    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ae7e78-73f5-4c52-960b-cefd9b275db1-tls-certs\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.434555 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.434445    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-model-cache\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.434555 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.434477    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lddk4\" (UniqueName: \"kubernetes.io/projected/80ae7e78-73f5-4c52-960b-cefd9b275db1-kube-api-access-lddk4\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.434673 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.434591    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-home\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.434673 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.434640    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-dshm\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.535517 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.535485    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ae7e78-73f5-4c52-960b-cefd9b275db1-tls-certs\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.535693 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.535535    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-model-cache\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.535693 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.535561    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lddk4\" (UniqueName: \"kubernetes.io/projected/80ae7e78-73f5-4c52-960b-cefd9b275db1-kube-api-access-lddk4\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.535693 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.535661    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-home\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.535845 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.535702    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-dshm\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.535845 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.535752    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-tmp-dir\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.536025 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.535977    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-model-cache\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.536155 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.536054    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-home\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.536155 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.536105    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-tmp-dir\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.538077 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.538049    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-dshm\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.538342 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.538324    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ae7e78-73f5-4c52-960b-cefd9b275db1-tls-certs\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.544449 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.544426    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lddk4\" (UniqueName: \"kubernetes.io/projected/80ae7e78-73f5-4c52-960b-cefd9b275db1-kube-api-access-lddk4\") pod \"e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") " pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.685679 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.685639    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:06.719886 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.719847    2550 patch_prober.go:28] interesting pod/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 13 20:02:06.720050 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.719902    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 13 20:02:06.800901 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.800864    2550 generic.go:356] "Generic (PLEG): container finished" podID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerID="d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b" exitCode=0
Jul 13 20:02:06.801061 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.800939    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" event={"ID":"376c7c74-d1dc-4c60-9bc5-07d3850ede7e","Type":"ContainerDied","Data":"d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b"}
Jul 13 20:02:06.801371 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.801353    2550 scope.go:117] "RemoveContainer" containerID="d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b"
Jul 13 20:02:06.802417 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.802387    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:02:06.802534 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.802456    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:02:06.802534 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.802488    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:02:06.830648 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:06.830612    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"]
Jul 13 20:02:06.836297 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:02:06.836265    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80ae7e78_73f5_4c52_960b_cefd9b275db1.slice/crio-22bb1cf567cdcc52232123047d508e107b432ea44b2643f7bf428a0ccf43a1fc WatchSource:0}: Error finding container 22bb1cf567cdcc52232123047d508e107b432ea44b2643f7bf428a0ccf43a1fc: Status 404 returned error can't find the container with id 22bb1cf567cdcc52232123047d508e107b432ea44b2643f7bf428a0ccf43a1fc
Jul 13 20:02:07.807317 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:07.807279    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg" event={"ID":"80ae7e78-73f5-4c52-960b-cefd9b275db1","Type":"ContainerStarted","Data":"316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a"}
Jul 13 20:02:07.807317 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:07.807333    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg" event={"ID":"80ae7e78-73f5-4c52-960b-cefd9b275db1","Type":"ContainerStarted","Data":"22bb1cf567cdcc52232123047d508e107b432ea44b2643f7bf428a0ccf43a1fc"}
Jul 13 20:02:07.809401 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:07.809375    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" event={"ID":"376c7c74-d1dc-4c60-9bc5-07d3850ede7e","Type":"ContainerStarted","Data":"12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5"}
Jul 13 20:02:07.827915 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:07.827862    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg" podStartSLOduration=1.827847132 podStartE2EDuration="1.827847132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:02:07.825557486 +0000 UTC m=+2200.826048048" watchObservedRunningTime="2026-07-13 20:02:07.827847132 +0000 UTC m=+2200.828337692"
Jul 13 20:02:08.099934 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:08.099844    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:02:08.100079 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:08.100058    2550 patch_prober.go:28] interesting pod/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 13 20:02:08.100138 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:08.100105    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 13 20:02:09.100208 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:09.100172    2550 patch_prober.go:28] interesting pod/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 13 20:02:09.100626 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:09.100232    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 13 20:02:10.100599 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:10.100562    2550 patch_prober.go:28] interesting pod/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 13 20:02:10.101012 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:10.100623    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 13 20:02:11.100927 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:11.100884    2550 patch_prober.go:28] interesting pod/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 13 20:02:11.101400 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:11.100951    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 13 20:02:12.103790 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:12.103759    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:02:12.104257 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:12.104146    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:02:12.104969 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:12.104949    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:02:16.686558 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:16.686517    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:16.687090 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:16.686674    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:16.699091 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:16.699060    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:16.866001 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:16.865968    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:02:50.438637 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:02:50.438551    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"]
Jul 13 20:03:05.460084 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.460023    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg" podUID="80ae7e78-73f5-4c52-960b-cefd9b275db1" containerName="main" containerID="cri-o://316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a" gracePeriod=45
Jul 13 20:03:05.713159 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.713096    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:03:05.830365 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830327    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-home\") pod \"80ae7e78-73f5-4c52-960b-cefd9b275db1\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") "
Jul 13 20:03:05.830365 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830367    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-model-cache\") pod \"80ae7e78-73f5-4c52-960b-cefd9b275db1\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") "
Jul 13 20:03:05.830633 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830394    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ae7e78-73f5-4c52-960b-cefd9b275db1-tls-certs\") pod \"80ae7e78-73f5-4c52-960b-cefd9b275db1\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") "
Jul 13 20:03:05.830633 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830410    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-tmp-dir\") pod \"80ae7e78-73f5-4c52-960b-cefd9b275db1\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") "
Jul 13 20:03:05.830633 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830475    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lddk4\" (UniqueName: \"kubernetes.io/projected/80ae7e78-73f5-4c52-960b-cefd9b275db1-kube-api-access-lddk4\") pod \"80ae7e78-73f5-4c52-960b-cefd9b275db1\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") "
Jul 13 20:03:05.830633 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830523    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-dshm\") pod \"80ae7e78-73f5-4c52-960b-cefd9b275db1\" (UID: \"80ae7e78-73f5-4c52-960b-cefd9b275db1\") "
Jul 13 20:03:05.830884 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830663    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-model-cache" (OuterVolumeSpecName: "model-cache") pod "80ae7e78-73f5-4c52-960b-cefd9b275db1" (UID: "80ae7e78-73f5-4c52-960b-cefd9b275db1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:03:05.830884 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830686    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-home" (OuterVolumeSpecName: "home") pod "80ae7e78-73f5-4c52-960b-cefd9b275db1" (UID: "80ae7e78-73f5-4c52-960b-cefd9b275db1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:03:05.830884 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830742    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "80ae7e78-73f5-4c52-960b-cefd9b275db1" (UID: "80ae7e78-73f5-4c52-960b-cefd9b275db1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:03:05.831011 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830891    2550 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-home\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:05.831011 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830910    2550 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-model-cache\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:05.831011 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.830925    2550 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-tmp-dir\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:05.832936 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.832907    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ae7e78-73f5-4c52-960b-cefd9b275db1-kube-api-access-lddk4" (OuterVolumeSpecName: "kube-api-access-lddk4") pod "80ae7e78-73f5-4c52-960b-cefd9b275db1" (UID: "80ae7e78-73f5-4c52-960b-cefd9b275db1"). InnerVolumeSpecName "kube-api-access-lddk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:03:05.832936 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.832918    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80ae7e78-73f5-4c52-960b-cefd9b275db1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "80ae7e78-73f5-4c52-960b-cefd9b275db1" (UID: "80ae7e78-73f5-4c52-960b-cefd9b275db1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:03:05.832936 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.832934    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-dshm" (OuterVolumeSpecName: "dshm") pod "80ae7e78-73f5-4c52-960b-cefd9b275db1" (UID: "80ae7e78-73f5-4c52-960b-cefd9b275db1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:03:05.931732 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.931694    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lddk4\" (UniqueName: \"kubernetes.io/projected/80ae7e78-73f5-4c52-960b-cefd9b275db1-kube-api-access-lddk4\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:05.931732 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.931726    2550 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80ae7e78-73f5-4c52-960b-cefd9b275db1-dshm\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:05.931732 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:05.931735    2550 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80ae7e78-73f5-4c52-960b-cefd9b275db1-tls-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:06.109203 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:06.109110    2550 generic.go:356] "Generic (PLEG): container finished" podID="80ae7e78-73f5-4c52-960b-cefd9b275db1" containerID="316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a" exitCode=0
Jul 13 20:03:06.109203 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:06.109155    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"
Jul 13 20:03:06.109373 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:06.109203    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg" event={"ID":"80ae7e78-73f5-4c52-960b-cefd9b275db1","Type":"ContainerDied","Data":"316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a"}
Jul 13 20:03:06.109373 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:06.109251    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg" event={"ID":"80ae7e78-73f5-4c52-960b-cefd9b275db1","Type":"ContainerDied","Data":"22bb1cf567cdcc52232123047d508e107b432ea44b2643f7bf428a0ccf43a1fc"}
Jul 13 20:03:06.109373 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:06.109272    2550 scope.go:117] "RemoveContainer" containerID="316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a"
Jul 13 20:03:06.118783 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:06.118763    2550 scope.go:117] "RemoveContainer" containerID="316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a"
Jul 13 20:03:06.119096 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:03:06.119074    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a\": container with ID starting with 316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a not found: ID does not exist" containerID="316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a"
Jul 13 20:03:06.119149 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:06.119106    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a"} err="failed to get container status \"316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a\": rpc error: code = NotFound desc = could not find container \"316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a\": container with ID starting with 316fea83fa7fb525c30b41c215d67a7b126a6b9388575f1c989dd7aa86789a0a not found: ID does not exist"
Jul 13 20:03:06.131316 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:06.130791    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"]
Jul 13 20:03:06.135627 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:06.135598    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-02a26ce0/e2e-lifecycle-model-02a26ce0-kserve-5cb64f6b7f-t7gxg"]
Jul 13 20:03:07.546557 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:07.546515    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80ae7e78-73f5-4c52-960b-cefd9b275db1" path="/var/lib/kubelet/pods/80ae7e78-73f5-4c52-960b-cefd9b275db1/volumes"
Jul 13 20:03:27.672421 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:27.672387    2550 scope.go:117] "RemoveContainer" containerID="789395213a9af419d42cf574cfdf3b7821f6197987590e0a44c7c19107bcb7bb"
Jul 13 20:03:37.665100 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:37.665056    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"]
Jul 13 20:03:37.665639 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:37.665299    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy" containerID="cri-o://12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5" gracePeriod=30
Jul 13 20:03:42.107224 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.107184    2550 patch_prober.go:28] interesting pod/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 20:03:42.107699 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.107260    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:03:42.926042 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.925975    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:03:42.992164 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992123    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-envoy\") pod \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") "
Jul 13 20:03:42.992375 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992207    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5bdk\" (UniqueName: \"kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-kube-api-access-f5bdk\") pod \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") "
Jul 13 20:03:42.992375 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992304    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-certs\") pod \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") "
Jul 13 20:03:42.992375 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992343    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-socket\") pod \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") "
Jul 13 20:03:42.992375 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992371    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-podinfo\") pod \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") "
Jul 13 20:03:42.992630 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992410    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istiod-ca-cert\") pod \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") "
Jul 13 20:03:42.992630 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992438    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-credential-socket\") pod \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") "
Jul 13 20:03:42.992630 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992475    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-data\") pod \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") "
Jul 13 20:03:42.992630 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992529    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-token\") pod \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\" (UID: \"376c7c74-d1dc-4c60-9bc5-07d3850ede7e\") "
Jul 13 20:03:42.992860 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992627    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "376c7c74-d1dc-4c60-9bc5-07d3850ede7e" (UID: "376c7c74-d1dc-4c60-9bc5-07d3850ede7e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:03:42.992860 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992793    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "376c7c74-d1dc-4c60-9bc5-07d3850ede7e" (UID: "376c7c74-d1dc-4c60-9bc5-07d3850ede7e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:03:42.992987 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992936    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:42.992987 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.992956    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:42.993097 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.993021    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "376c7c74-d1dc-4c60-9bc5-07d3850ede7e" (UID: "376c7c74-d1dc-4c60-9bc5-07d3850ede7e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:03:42.993425 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.993401    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "376c7c74-d1dc-4c60-9bc5-07d3850ede7e" (UID: "376c7c74-d1dc-4c60-9bc5-07d3850ede7e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:03:42.993717 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.993694    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-data" (OuterVolumeSpecName: "istio-data") pod "376c7c74-d1dc-4c60-9bc5-07d3850ede7e" (UID: "376c7c74-d1dc-4c60-9bc5-07d3850ede7e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:03:42.994713 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.994693    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-kube-api-access-f5bdk" (OuterVolumeSpecName: "kube-api-access-f5bdk") pod "376c7c74-d1dc-4c60-9bc5-07d3850ede7e" (UID: "376c7c74-d1dc-4c60-9bc5-07d3850ede7e"). InnerVolumeSpecName "kube-api-access-f5bdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:03:42.994944 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.994919    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-token" (OuterVolumeSpecName: "istio-token") pod "376c7c74-d1dc-4c60-9bc5-07d3850ede7e" (UID: "376c7c74-d1dc-4c60-9bc5-07d3850ede7e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:03:42.995215 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.995184    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "376c7c74-d1dc-4c60-9bc5-07d3850ede7e" (UID: "376c7c74-d1dc-4c60-9bc5-07d3850ede7e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 20:03:42.995379 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:42.995359    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "376c7c74-d1dc-4c60-9bc5-07d3850ede7e" (UID: "376c7c74-d1dc-4c60-9bc5-07d3850ede7e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:03:43.093448 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.093406    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:43.093448 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.093440    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:43.093448 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.093449    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:43.093448 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.093459    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:43.093730 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.093468    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:43.093730 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.093477    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:43.093730 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.093484    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5bdk\" (UniqueName: \"kubernetes.io/projected/376c7c74-d1dc-4c60-9bc5-07d3850ede7e-kube-api-access-f5bdk\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:03:43.298043 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.297948    2550 generic.go:356] "Generic (PLEG): container finished" podID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerID="12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5" exitCode=0
Jul 13 20:03:43.298043 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.298026    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"
Jul 13 20:03:43.298561 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.298055    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" event={"ID":"376c7c74-d1dc-4c60-9bc5-07d3850ede7e","Type":"ContainerDied","Data":"12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5"}
Jul 13 20:03:43.298561 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.298124    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6" event={"ID":"376c7c74-d1dc-4c60-9bc5-07d3850ede7e","Type":"ContainerDied","Data":"e266418d59e30e5adf254d1dd86338fbbeaa48b8c65dbe50faf93a4403ef6f37"}
Jul 13 20:03:43.298561 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.298158    2550 scope.go:117] "RemoveContainer" containerID="12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5"
Jul 13 20:03:43.309914 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.309894    2550 scope.go:117] "RemoveContainer" containerID="d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b"
Jul 13 20:03:43.318825 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.318789    2550 scope.go:117] "RemoveContainer" containerID="12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5"
Jul 13 20:03:43.319144 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:03:43.319123    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5\": container with ID starting with 12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5 not found: ID does not exist" containerID="12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5"
Jul 13 20:03:43.319221 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.319154    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5"} err="failed to get container status \"12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5\": rpc error: code = NotFound desc = could not find container \"12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5\": container with ID starting with 12374976b7f0a986a47d3ddc993f22333b2128fdbce3b2ebbd21f4dcce62fea5 not found: ID does not exist"
Jul 13 20:03:43.319221 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.319174    2550 scope.go:117] "RemoveContainer" containerID="d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b"
Jul 13 20:03:43.319446 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:03:43.319430    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b\": container with ID starting with d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b not found: ID does not exist" containerID="d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b"
Jul 13 20:03:43.319487 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.319453    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b"} err="failed to get container status \"d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b\": rpc error: code = NotFound desc = could not find container \"d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b\": container with ID starting with d004244c4f708528acb5cbbbbd6f4e1b4e8c527c5f9c653843666f8fd66ba26b not found: ID does not exist"
Jul 13 20:03:43.327630 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.327605    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"]
Jul 13 20:03:43.332205 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.332185    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-02a26ce0-openshift-default-6975888895-mfph6"]
Jul 13 20:03:43.546858 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:03:43.546821    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" path="/var/lib/kubelet/pods/376c7c74-d1dc-4c60-9bc5-07d3850ede7e/volumes"
Jul 13 20:04:32.847027 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.846991    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"]
Jul 13 20:04:32.847595 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.847549    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy"
Jul 13 20:04:32.847595 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.847567    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy"
Jul 13 20:04:32.847717 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.847598    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ae7e78-73f5-4c52-960b-cefd9b275db1" containerName="main"
Jul 13 20:04:32.847717 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.847606    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ae7e78-73f5-4c52-960b-cefd9b275db1" containerName="main"
Jul 13 20:04:32.847717 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.847697    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy"
Jul 13 20:04:32.847717 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.847713    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy"
Jul 13 20:04:32.847976 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.847721    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ae7e78-73f5-4c52-960b-cefd9b275db1" containerName="main"
Jul 13 20:04:32.850870 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.850849    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:32.853669 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.853647    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 20:04:32.854037 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.854020    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-416f95-openshift-default-dockercfg-cjrmd\""
Jul 13 20:04:32.864545 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.864517    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"]
Jul 13 20:04:32.980391 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.980355    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-credential-socket\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:32.980391 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.980396    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6snt\" (UniqueName: \"kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-kube-api-access-d6snt\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:32.980610 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.980429    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-podinfo\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:32.980610 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.980511    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-token\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:32.980610 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.980566    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istiod-ca-cert\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:32.980709 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.980609    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-socket\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:32.980709 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.980633    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-certs\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:32.980709 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.980651    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-envoy\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:32.980709 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:32.980671    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-data\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.081405 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.081366    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-credential-socket\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.081405 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.081406    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6snt\" (UniqueName: \"kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-kube-api-access-d6snt\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.081636 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.081444    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-podinfo\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.081636 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.081492    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-token\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.081636 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.081548    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istiod-ca-cert\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.081636 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.081577    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-socket\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.081636 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.081612    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-certs\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.081941 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.081637    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-envoy\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.081941 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.081666    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-data\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.081941 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.081901    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-credential-socket\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.082106 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.082008    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-certs\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.082106 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.082090    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-socket\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.082224 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.082109    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-data\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.082546 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.082526    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istiod-ca-cert\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.084156 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.084133    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-podinfo\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.084245 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.084133    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-envoy\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.090077 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.090055    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6snt\" (UniqueName: \"kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-kube-api-access-d6snt\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.090176 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.090078    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-token\") pod \"e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") " pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.161198 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.161112    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:33.303624 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.303589    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"]
Jul 13 20:04:33.304676 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:04:33.304640    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4db5d5_e3ea_4ac1_a81e_e129342e5413.slice/crio-5f63fb87c6985341717de8294ed809f50d9b8234eb0ad1a13d65f70658b80400 WatchSource:0}: Error finding container 5f63fb87c6985341717de8294ed809f50d9b8234eb0ad1a13d65f70658b80400: Status 404 returned error can't find the container with id 5f63fb87c6985341717de8294ed809f50d9b8234eb0ad1a13d65f70658b80400
Jul 13 20:04:33.307398 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.307363    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:33.307479 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.307436    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:33.307479 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.307466    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:33.551613 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.551578    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" event={"ID":"7a4db5d5-e3ea-4ac1-a81e-e129342e5413","Type":"ContainerStarted","Data":"9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857"}
Jul 13 20:04:33.551790 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.551641    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" event={"ID":"7a4db5d5-e3ea-4ac1-a81e-e129342e5413","Type":"ContainerStarted","Data":"5f63fb87c6985341717de8294ed809f50d9b8234eb0ad1a13d65f70658b80400"}
Jul 13 20:04:33.572851 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:33.572777    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podStartSLOduration=1.572755968 podStartE2EDuration="1.572755968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:04:33.571710301 +0000 UTC m=+2346.572200862" watchObservedRunningTime="2026-07-13 20:04:33.572755968 +0000 UTC m=+2346.573246519"
Jul 13 20:04:34.161529 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:34.161497    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:34.166991 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:34.166963    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:34.561550 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:34.561517    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:34.562576 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:34.562553    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:40.649109 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.649071    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"]
Jul 13 20:04:40.649701 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.649682    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy"
Jul 13 20:04:40.649750 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.649705    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="376c7c74-d1dc-4c60-9bc5-07d3850ede7e" containerName="istio-proxy"
Jul 13 20:04:40.653310 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.653290    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.656226 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.656204    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6d9be2-openshift-default-dockercfg-l5jkv\""
Jul 13 20:04:40.664040 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.664015    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"]
Jul 13 20:04:40.753734 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.753703    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-socket\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.753974 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.753768    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b514e78-9269-489a-b4b6-7060ae2b8898-istiod-ca-cert\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.753974 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.753875    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2sfk\" (UniqueName: \"kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-kube-api-access-k2sfk\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.753974 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.753927    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-certs\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.754151 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.753974    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-token\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.754151 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.754032    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-envoy\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.754151 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.754076    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-data\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.754151 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.754107    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-credential-socket\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.754151 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.754146    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-podinfo\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855276 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855243    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2sfk\" (UniqueName: \"kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-kube-api-access-k2sfk\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855276 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855283    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-certs\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855523 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855310    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-token\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855523 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855343    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-envoy\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855523 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855363    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-data\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855523 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855383    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-credential-socket\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855523 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855512    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-podinfo\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855758 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855557    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-socket\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855758 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855645    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b514e78-9269-489a-b4b6-7060ae2b8898-istiod-ca-cert\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855893 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855823    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-credential-socket\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.855957 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855882    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-certs\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.856007 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.855977    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-data\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.856109 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.856089    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-socket\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.856341 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.856290    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b514e78-9269-489a-b4b6-7060ae2b8898-istiod-ca-cert\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.857931 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.857906    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-envoy\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.858125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.858107    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-podinfo\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.866866 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.866841    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-token\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.867498 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.867480    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2sfk\" (UniqueName: \"kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-kube-api-access-k2sfk\") pod \"e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") " pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:40.965438 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:40.965391    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:41.119409 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:41.119375    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"]
Jul 13 20:04:41.121466 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:04:41.121437    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b514e78_9269_489a_b4b6_7060ae2b8898.slice/crio-83296e885a02a03d8df827012ab31732e2b0230154f8afaf0ac429f454112233 WatchSource:0}: Error finding container 83296e885a02a03d8df827012ab31732e2b0230154f8afaf0ac429f454112233: Status 404 returned error can't find the container with id 83296e885a02a03d8df827012ab31732e2b0230154f8afaf0ac429f454112233
Jul 13 20:04:41.123628 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:41.123590    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:41.123735 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:41.123676    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:41.123735 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:41.123723    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:41.604613 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:41.604565    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" event={"ID":"2b514e78-9269-489a-b4b6-7060ae2b8898","Type":"ContainerStarted","Data":"ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81"}
Jul 13 20:04:41.604845 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:41.604675    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" event={"ID":"2b514e78-9269-489a-b4b6-7060ae2b8898","Type":"ContainerStarted","Data":"83296e885a02a03d8df827012ab31732e2b0230154f8afaf0ac429f454112233"}
Jul 13 20:04:41.629494 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:41.629439    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" podStartSLOduration=1.629420962 podStartE2EDuration="1.629420962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:04:41.626529271 +0000 UTC m=+2354.627019823" watchObservedRunningTime="2026-07-13 20:04:41.629420962 +0000 UTC m=+2354.629911524"
Jul 13 20:04:41.966290 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:41.966257    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:42.970834 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:42.970786    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:43.615422 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:43.615391    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:43.616509 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:43.616492    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:04:50.603983 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:50.603943    2550 patch_prober.go:28] interesting pod/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 20:04:50.604390 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:50.604020    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 20:04:51.672760 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:51.672726    2550 generic.go:356] "Generic (PLEG): container finished" podID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerID="9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857" exitCode=0
Jul 13 20:04:51.673203 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:51.672832    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" event={"ID":"7a4db5d5-e3ea-4ac1-a81e-e129342e5413","Type":"ContainerDied","Data":"9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857"}
Jul 13 20:04:51.673261 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:51.673248    2550 scope.go:117] "RemoveContainer" containerID="9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857"
Jul 13 20:04:51.674292 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:51.674263    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:51.674403 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:51.674331    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:51.674403 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:51.674360    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:52.679904 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:52.679866    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" event={"ID":"7a4db5d5-e3ea-4ac1-a81e-e129342e5413","Type":"ContainerStarted","Data":"a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae"}
Jul 13 20:04:53.162008 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:53.161900    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:04:53.162008 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:53.161952    2550 patch_prober.go:28] interesting pod/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 13 20:04:53.162008 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:53.162001    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 13 20:04:54.162322 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:54.162278    2550 patch_prober.go:28] interesting pod/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 13 20:04:54.162768 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:54.162370    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 13 20:04:55.162508 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:55.162459    2550 patch_prober.go:28] interesting pod/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 13 20:04:55.162962 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:55.162544    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 13 20:04:56.162266 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:56.162219    2550 patch_prober.go:28] interesting pod/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 13 20:04:56.162488 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:56.162294    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 13 20:04:57.162310 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:57.162260    2550 patch_prober.go:28] interesting pod/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 13 20:04:57.162884 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:57.162329    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 13 20:04:58.162556 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:58.162516    2550 patch_prober.go:28] interesting pod/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 13 20:04:58.163213 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:58.163182    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 13 20:04:58.689100 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:58.688521    2550 patch_prober.go:28] interesting pod/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:49206->10.133.0.50:15021: read: connection reset by peer" start-of-body=
Jul 13 20:04:58.689100 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:58.688582    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": read tcp 10.133.0.2:49206->10.133.0.50:15021: read: connection reset by peer"
Jul 13 20:04:59.162088 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.161986    2550 patch_prober.go:28] interesting pod/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 13 20:04:59.162088 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.162057    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 13 20:04:59.189678 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.189647    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"]
Jul 13 20:04:59.192530 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.192509    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.196530 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.196509    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-416f95\"/\"openshift-service-ca.crt\""
Jul 13 20:04:59.196530 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.196519    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-416f95\"/\"kube-root-ca.crt\""
Jul 13 20:04:59.196728 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.196521    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-416f95\"/\"test-model-416f95-kserve-self-signed-certs\""
Jul 13 20:04:59.196728 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.196571    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-416f95\"/\"default-dockercfg-5pktp\""
Jul 13 20:04:59.203902 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.203878    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"]
Jul 13 20:04:59.259430 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.259379    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgz8m\" (UniqueName: \"kubernetes.io/projected/21a23ed0-5c89-42b8-a367-cfa863874e08-kube-api-access-cgz8m\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.259635 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.259477    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-model-cache\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.259635 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.259533    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21a23ed0-5c89-42b8-a367-cfa863874e08-tls-certs\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.259635 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.259566    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-dshm\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.259635 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.259597    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-home\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.259635 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.259632    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-tmp-dir\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.360592 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.360540    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-model-cache\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.360827 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.360611    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21a23ed0-5c89-42b8-a367-cfa863874e08-tls-certs\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.360827 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.360660    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-dshm\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.360827 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.360695    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-home\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.360827 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.360733    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-tmp-dir\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.361077 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.360874    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgz8m\" (UniqueName: \"kubernetes.io/projected/21a23ed0-5c89-42b8-a367-cfa863874e08-kube-api-access-cgz8m\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.361682 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.361652    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-model-cache\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.362177 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.362154    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-home\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.362318 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.362241    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-tmp-dir\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.364310 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.364288    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-dshm\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.364394 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.364347    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21a23ed0-5c89-42b8-a367-cfa863874e08-tls-certs\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.370185 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.370167    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgz8m\" (UniqueName: \"kubernetes.io/projected/21a23ed0-5c89-42b8-a367-cfa863874e08-kube-api-access-cgz8m\") pod \"test-model-416f95-kserve-79bf8b699f-v2z5x\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") " pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.502343 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.502296    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:04:59.686530 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.686499    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"]
Jul 13 20:04:59.687714 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:04:59.687688    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21a23ed0_5c89_42b8_a367_cfa863874e08.slice/crio-296b82e115d255fddced598e420baaa8fd0c7c6d7b34c5a6f9d7f1918e6b6051 WatchSource:0}: Error finding container 296b82e115d255fddced598e420baaa8fd0c7c6d7b34c5a6f9d7f1918e6b6051: Status 404 returned error can't find the container with id 296b82e115d255fddced598e420baaa8fd0c7c6d7b34c5a6f9d7f1918e6b6051
Jul 13 20:04:59.718873 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.718835    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x" event={"ID":"21a23ed0-5c89-42b8-a367-cfa863874e08","Type":"ContainerStarted","Data":"296b82e115d255fddced598e420baaa8fd0c7c6d7b34c5a6f9d7f1918e6b6051"}
Jul 13 20:04:59.720262 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.720238    2550 generic.go:356] "Generic (PLEG): container finished" podID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerID="ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81" exitCode=0
Jul 13 20:04:59.720380 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.720276    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" event={"ID":"2b514e78-9269-489a-b4b6-7060ae2b8898","Type":"ContainerDied","Data":"ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81"}
Jul 13 20:04:59.720718 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.720701    2550 scope.go:117] "RemoveContainer" containerID="ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81"
Jul 13 20:04:59.722075 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.722036    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:59.722173 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.722129    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:04:59.722227 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:04:59.722175    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:05:00.162454 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:00.162356    2550 patch_prober.go:28] interesting pod/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 13 20:05:00.162454 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:00.162425    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 13 20:05:00.727590 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:00.727554    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" event={"ID":"2b514e78-9269-489a-b4b6-7060ae2b8898","Type":"ContainerStarted","Data":"674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131"}
Jul 13 20:05:00.729148 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:00.729119    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x" event={"ID":"21a23ed0-5c89-42b8-a367-cfa863874e08","Type":"ContainerStarted","Data":"2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d"}
Jul 13 20:05:00.770381 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:00.770312    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x" podStartSLOduration=1.770292123 podStartE2EDuration="1.770292123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:05:00.768660962 +0000 UTC m=+2373.769151521" watchObservedRunningTime="2026-07-13 20:05:00.770292123 +0000 UTC m=+2373.770782682"
Jul 13 20:05:00.966206 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:00.966157    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:05:00.966407 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:00.966382    2550 patch_prober.go:28] interesting pod/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 13 20:05:00.966455 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:00.966441    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 13 20:05:01.166437 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:01.166402    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:05:01.166915 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:01.166899    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:05:01.167658 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:01.167642    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:05:01.966748 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:01.966708    2550 patch_prober.go:28] interesting pod/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 13 20:05:01.967769 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:01.967362    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 13 20:05:02.966362 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:02.966319    2550 patch_prober.go:28] interesting pod/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 13 20:05:02.966537 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:02.966383    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 13 20:05:03.966119 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:03.966085    2550 patch_prober.go:28] interesting pod/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 13 20:05:03.966592 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:03.966152    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 13 20:05:04.969985 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:04.969944    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:05:04.970431 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:04.970213    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:05:04.970935 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:04.970918    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:05:09.502631 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:09.502584    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:05:09.503072 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:09.502662    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:05:09.515482 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:09.515456    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:05:09.791399 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:09.791315    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:05:27.605120 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:27.605075    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 20:05:27.611360 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:27.611334    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 20:05:46.577341 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:05:46.577301    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"]
Jul 13 20:06:01.598095 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.598054    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x" podUID="21a23ed0-5c89-42b8-a367-cfa863874e08" containerName="main" containerID="cri-o://2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d" gracePeriod=45
Jul 13 20:06:01.857575 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.857514    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:06:01.987092 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987059    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-tmp-dir\") pod \"21a23ed0-5c89-42b8-a367-cfa863874e08\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") "
Jul 13 20:06:01.987292 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987108    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-model-cache\") pod \"21a23ed0-5c89-42b8-a367-cfa863874e08\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") "
Jul 13 20:06:01.987292 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987150    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgz8m\" (UniqueName: \"kubernetes.io/projected/21a23ed0-5c89-42b8-a367-cfa863874e08-kube-api-access-cgz8m\") pod \"21a23ed0-5c89-42b8-a367-cfa863874e08\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") "
Jul 13 20:06:01.987292 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987199    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21a23ed0-5c89-42b8-a367-cfa863874e08-tls-certs\") pod \"21a23ed0-5c89-42b8-a367-cfa863874e08\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") "
Jul 13 20:06:01.987292 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987281    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-dshm\") pod \"21a23ed0-5c89-42b8-a367-cfa863874e08\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") "
Jul 13 20:06:01.987480 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987342    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "21a23ed0-5c89-42b8-a367-cfa863874e08" (UID: "21a23ed0-5c89-42b8-a367-cfa863874e08"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:01.987480 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987373    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-home\") pod \"21a23ed0-5c89-42b8-a367-cfa863874e08\" (UID: \"21a23ed0-5c89-42b8-a367-cfa863874e08\") "
Jul 13 20:06:01.987480 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987391    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-model-cache" (OuterVolumeSpecName: "model-cache") pod "21a23ed0-5c89-42b8-a367-cfa863874e08" (UID: "21a23ed0-5c89-42b8-a367-cfa863874e08"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:01.987694 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987672    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-home" (OuterVolumeSpecName: "home") pod "21a23ed0-5c89-42b8-a367-cfa863874e08" (UID: "21a23ed0-5c89-42b8-a367-cfa863874e08"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:01.987758 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987682    2550 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-tmp-dir\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:01.987758 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.987720    2550 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-model-cache\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:01.989619 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.989595    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-dshm" (OuterVolumeSpecName: "dshm") pod "21a23ed0-5c89-42b8-a367-cfa863874e08" (UID: "21a23ed0-5c89-42b8-a367-cfa863874e08"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:01.989920 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.989894    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21a23ed0-5c89-42b8-a367-cfa863874e08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "21a23ed0-5c89-42b8-a367-cfa863874e08" (UID: "21a23ed0-5c89-42b8-a367-cfa863874e08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:06:01.990020 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:01.989939    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21a23ed0-5c89-42b8-a367-cfa863874e08-kube-api-access-cgz8m" (OuterVolumeSpecName: "kube-api-access-cgz8m") pod "21a23ed0-5c89-42b8-a367-cfa863874e08" (UID: "21a23ed0-5c89-42b8-a367-cfa863874e08"). InnerVolumeSpecName "kube-api-access-cgz8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:06:02.057128 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.057094    2550 generic.go:356] "Generic (PLEG): container finished" podID="21a23ed0-5c89-42b8-a367-cfa863874e08" containerID="2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d" exitCode=0
Jul 13 20:06:02.057330 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.057139    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"
Jul 13 20:06:02.057330 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.057177    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x" event={"ID":"21a23ed0-5c89-42b8-a367-cfa863874e08","Type":"ContainerDied","Data":"2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d"}
Jul 13 20:06:02.057330 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.057226    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x" event={"ID":"21a23ed0-5c89-42b8-a367-cfa863874e08","Type":"ContainerDied","Data":"296b82e115d255fddced598e420baaa8fd0c7c6d7b34c5a6f9d7f1918e6b6051"}
Jul 13 20:06:02.057330 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.057247    2550 scope.go:117] "RemoveContainer" containerID="2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d"
Jul 13 20:06:02.070755 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.070731    2550 scope.go:117] "RemoveContainer" containerID="2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d"
Jul 13 20:06:02.071105 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:06:02.071079    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d\": container with ID starting with 2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d not found: ID does not exist" containerID="2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d"
Jul 13 20:06:02.071217 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.071112    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d"} err="failed to get container status \"2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d\": rpc error: code = NotFound desc = could not find container \"2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d\": container with ID starting with 2720168c4fb3e0746b6d9b056a7ff675a6dae4b5c40d107fefa8a7c3449ef69d not found: ID does not exist"
Jul 13 20:06:02.082175 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.082139    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"]
Jul 13 20:06:02.087692 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.087662    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-416f95/test-model-416f95-kserve-79bf8b699f-v2z5x"]
Jul 13 20:06:02.089078 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.089060    2550 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-dshm\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:02.089132 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.089081    2550 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21a23ed0-5c89-42b8-a367-cfa863874e08-home\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:02.089132 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.089092    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgz8m\" (UniqueName: \"kubernetes.io/projected/21a23ed0-5c89-42b8-a367-cfa863874e08-kube-api-access-cgz8m\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:02.089132 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:02.089102    2550 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21a23ed0-5c89-42b8-a367-cfa863874e08-tls-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:03.545333 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:03.545298    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21a23ed0-5c89-42b8-a367-cfa863874e08" path="/var/lib/kubelet/pods/21a23ed0-5c89-42b8-a367-cfa863874e08/volumes"
Jul 13 20:06:13.451099 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:13.451061    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"]
Jul 13 20:06:13.451713 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:13.451319    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" containerID="cri-o://a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae" gracePeriod=30
Jul 13 20:06:16.169628 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:16.169592    2550 patch_prober.go:28] interesting pod/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 20:06:16.170051 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:16.169663    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:06:18.730441 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.730407    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:06:18.751125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.751034    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-socket\") pod \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") "
Jul 13 20:06:18.751125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.751175    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-envoy\") pod \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") "
Jul 13 20:06:18.751125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.751227    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6snt\" (UniqueName: \"kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-kube-api-access-d6snt\") pod \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") "
Jul 13 20:06:18.751125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.751256    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istiod-ca-cert\") pod \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") "
Jul 13 20:06:18.751125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.751296    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-data\") pod \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") "
Jul 13 20:06:18.751125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.751353    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-podinfo\") pod \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") "
Jul 13 20:06:18.751125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.751388    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-credential-socket\") pod \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") "
Jul 13 20:06:18.751125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.751433    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-token\") pod \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") "
Jul 13 20:06:18.751125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.751534    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-certs\") pod \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\" (UID: \"7a4db5d5-e3ea-4ac1-a81e-e129342e5413\") "
Jul 13 20:06:18.752450 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.752077    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a4db5d5-e3ea-4ac1-a81e-e129342e5413" (UID: "7a4db5d5-e3ea-4ac1-a81e-e129342e5413"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:18.752450 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.752092    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a4db5d5-e3ea-4ac1-a81e-e129342e5413" (UID: "7a4db5d5-e3ea-4ac1-a81e-e129342e5413"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:18.752450 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.752429    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a4db5d5-e3ea-4ac1-a81e-e129342e5413" (UID: "7a4db5d5-e3ea-4ac1-a81e-e129342e5413"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:06:18.752662 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.752489    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a4db5d5-e3ea-4ac1-a81e-e129342e5413" (UID: "7a4db5d5-e3ea-4ac1-a81e-e129342e5413"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:18.752662 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.752607    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a4db5d5-e3ea-4ac1-a81e-e129342e5413" (UID: "7a4db5d5-e3ea-4ac1-a81e-e129342e5413"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:18.754052 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.754002    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a4db5d5-e3ea-4ac1-a81e-e129342e5413" (UID: "7a4db5d5-e3ea-4ac1-a81e-e129342e5413"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 20:06:18.754444 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.754418    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a4db5d5-e3ea-4ac1-a81e-e129342e5413" (UID: "7a4db5d5-e3ea-4ac1-a81e-e129342e5413"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:18.754580 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.754535    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a4db5d5-e3ea-4ac1-a81e-e129342e5413" (UID: "7a4db5d5-e3ea-4ac1-a81e-e129342e5413"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:06:18.754719 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.754692    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-kube-api-access-d6snt" (OuterVolumeSpecName: "kube-api-access-d6snt") pod "7a4db5d5-e3ea-4ac1-a81e-e129342e5413" (UID: "7a4db5d5-e3ea-4ac1-a81e-e129342e5413"). InnerVolumeSpecName "kube-api-access-d6snt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:06:18.853175 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.853139    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:18.853175 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.853166    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:18.853175 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.853176    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:18.853175 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.853186    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:18.853457 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.853193    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:18.853457 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.853202    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:18.853457 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.853210    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6snt\" (UniqueName: \"kubernetes.io/projected/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-kube-api-access-d6snt\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:18.853457 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.853218    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:18.853457 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:18.853226    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a4db5d5-e3ea-4ac1-a81e-e129342e5413-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:19.152108 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.152014    2550 generic.go:356] "Generic (PLEG): container finished" podID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerID="a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae" exitCode=0
Jul 13 20:06:19.152108 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.152061    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"
Jul 13 20:06:19.152306 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.152098    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" event={"ID":"7a4db5d5-e3ea-4ac1-a81e-e129342e5413","Type":"ContainerDied","Data":"a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae"}
Jul 13 20:06:19.152306 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.152158    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787" event={"ID":"7a4db5d5-e3ea-4ac1-a81e-e129342e5413","Type":"ContainerDied","Data":"5f63fb87c6985341717de8294ed809f50d9b8234eb0ad1a13d65f70658b80400"}
Jul 13 20:06:19.152306 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.152188    2550 scope.go:117] "RemoveContainer" containerID="a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae"
Jul 13 20:06:19.162137 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.162116    2550 scope.go:117] "RemoveContainer" containerID="9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857"
Jul 13 20:06:19.171685 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.171664    2550 scope.go:117] "RemoveContainer" containerID="a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae"
Jul 13 20:06:19.172077 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:06:19.172055    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae\": container with ID starting with a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae not found: ID does not exist" containerID="a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae"
Jul 13 20:06:19.172144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.172090    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae"} err="failed to get container status \"a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae\": rpc error: code = NotFound desc = could not find container \"a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae\": container with ID starting with a2b616d53c733a68d5b18465115fa87804e7d6524eda8241d63f6fba3e29b8ae not found: ID does not exist"
Jul 13 20:06:19.172144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.172109    2550 scope.go:117] "RemoveContainer" containerID="9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857"
Jul 13 20:06:19.172509 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:06:19.172479    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857\": container with ID starting with 9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857 not found: ID does not exist" containerID="9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857"
Jul 13 20:06:19.172849 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.172576    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857"} err="failed to get container status \"9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857\": rpc error: code = NotFound desc = could not find container \"9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857\": container with ID starting with 9391a20ab7af975f2c70d4ab7feada05f82671488def943e4b6b7bbcb7430857 not found: ID does not exist"
Jul 13 20:06:19.175084 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.175059    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"]
Jul 13 20:06:19.179606 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.179579    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-416f95-openshift-default-5d564b8c9-qt787"]
Jul 13 20:06:19.545109 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:19.545064    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" path="/var/lib/kubelet/pods/7a4db5d5-e3ea-4ac1-a81e-e129342e5413/volumes"
Jul 13 20:06:39.597145 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:39.597107    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"]
Jul 13 20:06:39.597551 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:39.597368    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy" containerID="cri-o://674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131" gracePeriod=30
Jul 13 20:06:40.490800 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.490760    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"]
Jul 13 20:06:40.491252 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.491233    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy"
Jul 13 20:06:40.491351 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.491254    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy"
Jul 13 20:06:40.491351 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.491270    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy"
Jul 13 20:06:40.491351 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.491278    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy"
Jul 13 20:06:40.491351 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.491321    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a23ed0-5c89-42b8-a367-cfa863874e08" containerName="main"
Jul 13 20:06:40.491351 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.491330    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a23ed0-5c89-42b8-a367-cfa863874e08" containerName="main"
Jul 13 20:06:40.491591 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.491442    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy"
Jul 13 20:06:40.491591 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.491457    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="21a23ed0-5c89-42b8-a367-cfa863874e08" containerName="main"
Jul 13 20:06:40.491591 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.491469    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a4db5d5-e3ea-4ac1-a81e-e129342e5413" containerName="istio-proxy"
Jul 13 20:06:40.495211 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.495172    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.498963 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.498936    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-ebcb0c-openshift-default-dockercfg-cpmv4\""
Jul 13 20:06:40.508354 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.508328    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"]
Jul 13 20:06:40.568586 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.568545    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cf11c4f-3045-4b5a-a426-bbc239029c54-istiod-ca-cert\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.568586 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.568591    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-certs\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.568838 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.568608    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg2d4\" (UniqueName: \"kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-kube-api-access-qg2d4\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.568838 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.568690    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-envoy\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.568838 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.568764    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-token\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.569011 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.568933    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-socket\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.569011 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.568973    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-credential-socket\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.569011 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.569005    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-podinfo\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.569147 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.569030    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-data\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.669846 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.669789    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-socket\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.669846 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.669841    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-credential-socket\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670386 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.669867    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-podinfo\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670386 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.669884    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-data\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670386 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.669934    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cf11c4f-3045-4b5a-a426-bbc239029c54-istiod-ca-cert\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670386 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.669966    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-certs\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670386 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.669988    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg2d4\" (UniqueName: \"kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-kube-api-access-qg2d4\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670386 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.670024    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-envoy\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670386 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.670052    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-token\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670386 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.670270    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-socket\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670386 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.670299    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-credential-socket\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670386 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.670384    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-data\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670840 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.670613    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-certs\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.670840 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.670719    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cf11c4f-3045-4b5a-a426-bbc239029c54-istiod-ca-cert\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.672421 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.672395    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-envoy\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.672564 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.672545    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-podinfo\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.678250 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.678225    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-token\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.678453 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.678436    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg2d4\" (UniqueName: \"kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-kube-api-access-qg2d4\") pod \"e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") " pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.811891 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.811787    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:40.953930 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.953899    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"]
Jul 13 20:06:40.955382 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:06:40.955340    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf11c4f_3045_4b5a_a426_bbc239029c54.slice/crio-0923f206be8acba3b5f9ab8e0d5265adbe770b3eb0ce5e10bde583a49f7ea13b WatchSource:0}: Error finding container 0923f206be8acba3b5f9ab8e0d5265adbe770b3eb0ce5e10bde583a49f7ea13b: Status 404 returned error can't find the container with id 0923f206be8acba3b5f9ab8e0d5265adbe770b3eb0ce5e10bde583a49f7ea13b
Jul 13 20:06:40.957584 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.957551    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:06:40.957661 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.957618    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:06:40.957661 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:40.957647    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:06:41.267241 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:41.267204    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" event={"ID":"9cf11c4f-3045-4b5a-a426-bbc239029c54","Type":"ContainerStarted","Data":"488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90"}
Jul 13 20:06:41.267428 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:41.267270    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" event={"ID":"9cf11c4f-3045-4b5a-a426-bbc239029c54","Type":"ContainerStarted","Data":"0923f206be8acba3b5f9ab8e0d5265adbe770b3eb0ce5e10bde583a49f7ea13b"}
Jul 13 20:06:41.291148 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:41.291099    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" podStartSLOduration=1.291078153 podStartE2EDuration="1.291078153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:06:41.288626205 +0000 UTC m=+2474.289116765" watchObservedRunningTime="2026-07-13 20:06:41.291078153 +0000 UTC m=+2474.291568713"
Jul 13 20:06:41.812646 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:41.812614    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:42.817493 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:42.817459    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:43.278058 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:43.278029    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:43.278919 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:43.278900    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:44.867565 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:44.867492    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:06:45.014444 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.014405    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-socket\") pod \"2b514e78-9269-489a-b4b6-7060ae2b8898\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") "
Jul 13 20:06:45.014658 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.014465    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-data\") pod \"2b514e78-9269-489a-b4b6-7060ae2b8898\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") "
Jul 13 20:06:45.014658 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.014511    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2sfk\" (UniqueName: \"kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-kube-api-access-k2sfk\") pod \"2b514e78-9269-489a-b4b6-7060ae2b8898\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") "
Jul 13 20:06:45.014658 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.014555    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-token\") pod \"2b514e78-9269-489a-b4b6-7060ae2b8898\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") "
Jul 13 20:06:45.014658 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.014593    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-podinfo\") pod \"2b514e78-9269-489a-b4b6-7060ae2b8898\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") "
Jul 13 20:06:45.014658 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.014617    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b514e78-9269-489a-b4b6-7060ae2b8898-istiod-ca-cert\") pod \"2b514e78-9269-489a-b4b6-7060ae2b8898\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") "
Jul 13 20:06:45.014658 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.014634    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-certs\") pod \"2b514e78-9269-489a-b4b6-7060ae2b8898\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") "
Jul 13 20:06:45.015044 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.014697    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-credential-socket\") pod \"2b514e78-9269-489a-b4b6-7060ae2b8898\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") "
Jul 13 20:06:45.015044 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.014722    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-envoy\") pod \"2b514e78-9269-489a-b4b6-7060ae2b8898\" (UID: \"2b514e78-9269-489a-b4b6-7060ae2b8898\") "
Jul 13 20:06:45.015044 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.014764    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b514e78-9269-489a-b4b6-7060ae2b8898" (UID: "2b514e78-9269-489a-b4b6-7060ae2b8898"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:45.015044 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.015003    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b514e78-9269-489a-b4b6-7060ae2b8898" (UID: "2b514e78-9269-489a-b4b6-7060ae2b8898"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:45.015242 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.015070    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:45.015242 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.015090    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:45.015242 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.015187    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b514e78-9269-489a-b4b6-7060ae2b8898" (UID: "2b514e78-9269-489a-b4b6-7060ae2b8898"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:45.015242 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.015222    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b514e78-9269-489a-b4b6-7060ae2b8898-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b514e78-9269-489a-b4b6-7060ae2b8898" (UID: "2b514e78-9269-489a-b4b6-7060ae2b8898"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:06:45.015550 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.015509    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b514e78-9269-489a-b4b6-7060ae2b8898" (UID: "2b514e78-9269-489a-b4b6-7060ae2b8898"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:45.017282 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.017257    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b514e78-9269-489a-b4b6-7060ae2b8898" (UID: "2b514e78-9269-489a-b4b6-7060ae2b8898"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 20:06:45.017548 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.017530    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b514e78-9269-489a-b4b6-7060ae2b8898" (UID: "2b514e78-9269-489a-b4b6-7060ae2b8898"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:06:45.017624 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.017550    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-kube-api-access-k2sfk" (OuterVolumeSpecName: "kube-api-access-k2sfk") pod "2b514e78-9269-489a-b4b6-7060ae2b8898" (UID: "2b514e78-9269-489a-b4b6-7060ae2b8898"). InnerVolumeSpecName "kube-api-access-k2sfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:06:45.017900 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.017633    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b514e78-9269-489a-b4b6-7060ae2b8898" (UID: "2b514e78-9269-489a-b4b6-7060ae2b8898"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:06:45.116020 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.115976    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:45.116020 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.116008    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:45.116020 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.116018    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2sfk\" (UniqueName: \"kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-kube-api-access-k2sfk\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:45.116020 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.116027    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:45.116292 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.116036    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b514e78-9269-489a-b4b6-7060ae2b8898-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:45.116292 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.116045    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b514e78-9269-489a-b4b6-7060ae2b8898-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:45.116292 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.116053    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b514e78-9269-489a-b4b6-7060ae2b8898-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:06:45.297301 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.297264    2550 generic.go:356] "Generic (PLEG): container finished" podID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerID="674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131" exitCode=0
Jul 13 20:06:45.297502 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.297332    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"
Jul 13 20:06:45.297502 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.297353    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" event={"ID":"2b514e78-9269-489a-b4b6-7060ae2b8898","Type":"ContainerDied","Data":"674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131"}
Jul 13 20:06:45.297502 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.297429    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb" event={"ID":"2b514e78-9269-489a-b4b6-7060ae2b8898","Type":"ContainerDied","Data":"83296e885a02a03d8df827012ab31732e2b0230154f8afaf0ac429f454112233"}
Jul 13 20:06:45.297502 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.297452    2550 scope.go:117] "RemoveContainer" containerID="674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131"
Jul 13 20:06:45.310057 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.310036    2550 scope.go:117] "RemoveContainer" containerID="ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81"
Jul 13 20:06:45.319239 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.319216    2550 scope.go:117] "RemoveContainer" containerID="674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131"
Jul 13 20:06:45.319551 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:06:45.319529    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131\": container with ID starting with 674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131 not found: ID does not exist" containerID="674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131"
Jul 13 20:06:45.319606 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.319561    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131"} err="failed to get container status \"674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131\": rpc error: code = NotFound desc = could not find container \"674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131\": container with ID starting with 674e8afc16b2846785206ddd3b26449c4b9840e6006b759aba5e0c4989c65131 not found: ID does not exist"
Jul 13 20:06:45.319606 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.319580    2550 scope.go:117] "RemoveContainer" containerID="ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81"
Jul 13 20:06:45.319841 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:06:45.319817    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81\": container with ID starting with ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81 not found: ID does not exist" containerID="ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81"
Jul 13 20:06:45.319894 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.319852    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81"} err="failed to get container status \"ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81\": rpc error: code = NotFound desc = could not find container \"ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81\": container with ID starting with ce2af41f7dd2ad6489f6696281cad3dd070249f4e824dadd94edd247398c6d81 not found: ID does not exist"
Jul 13 20:06:45.323635 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.323608    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"]
Jul 13 20:06:45.327397 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.327375    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6d9be2-openshift-default-ddf4fbc4c-vz5zb"]
Jul 13 20:06:45.546305 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:45.546271    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" path="/var/lib/kubelet/pods/2b514e78-9269-489a-b4b6-7060ae2b8898/volumes"
Jul 13 20:06:48.440397 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.440361    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"]
Jul 13 20:06:48.440799 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.440758    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy"
Jul 13 20:06:48.440799 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.440769    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy"
Jul 13 20:06:48.440799 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.440778    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy"
Jul 13 20:06:48.440799 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.440783    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy"
Jul 13 20:06:48.440995 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.440893    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy"
Jul 13 20:06:48.440995 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.440904    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b514e78-9269-489a-b4b6-7060ae2b8898" containerName="istio-proxy"
Jul 13 20:06:48.445355 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.445337    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.449334 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.449312    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-3e52c5-openshift-default-dockercfg-hsj2f\""
Jul 13 20:06:48.458040 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.458017    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"]
Jul 13 20:06:48.549720 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.549690    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-token\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.549913 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.549733    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-podinfo\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.549913 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.549755    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-envoy\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.549913 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.549777    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-socket\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.549913 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.549856    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc7fa32-7659-4410-8e03-86e6140f80e0-istiod-ca-cert\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.549913 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.549893    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nxmw\" (UniqueName: \"kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-kube-api-access-2nxmw\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.550110 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.549921    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-credential-socket\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.550110 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.549947    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-certs\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.550110 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.549987    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-data\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.651289 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.651252    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-envoy\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.651504 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.651316    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-socket\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.651504 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.651340    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc7fa32-7659-4410-8e03-86e6140f80e0-istiod-ca-cert\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.651504 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.651371    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nxmw\" (UniqueName: \"kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-kube-api-access-2nxmw\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.651504 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.651405    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-credential-socket\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.651504 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.651443    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-certs\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.651504 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.651481    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-data\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.651853 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.651573    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-token\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.651853 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.651638    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-podinfo\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.652023 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.651911    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-certs\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.652023 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.652012    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-data\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.652136 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.652106    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-credential-socket\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.652231 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.652202    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-socket\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.652344 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.652211    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc7fa32-7659-4410-8e03-86e6140f80e0-istiod-ca-cert\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.653835 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.653789    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-envoy\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.654253 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.654236    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-podinfo\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.660197 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.660170    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-token\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.660378 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.660361    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nxmw\" (UniqueName: \"kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-kube-api-access-2nxmw\") pod \"e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") " pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.756421 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.756331    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:48.903061 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.903037    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"]
Jul 13 20:06:48.904448 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:06:48.904419    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc7fa32_7659_4410_8e03_86e6140f80e0.slice/crio-4da5fa7baed9349107c748c41e0b0d4e3e4f0f636c54f60952185a43b21b28e1 WatchSource:0}: Error finding container 4da5fa7baed9349107c748c41e0b0d4e3e4f0f636c54f60952185a43b21b28e1: Status 404 returned error can't find the container with id 4da5fa7baed9349107c748c41e0b0d4e3e4f0f636c54f60952185a43b21b28e1
Jul 13 20:06:48.906546 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.906515    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:06:48.906626 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.906576    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:06:48.906626 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:48.906605    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:06:49.319688 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:49.319656    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" event={"ID":"7cc7fa32-7659-4410-8e03-86e6140f80e0","Type":"ContainerStarted","Data":"38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2"}
Jul 13 20:06:49.319916 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:49.319708    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" event={"ID":"7cc7fa32-7659-4410-8e03-86e6140f80e0","Type":"ContainerStarted","Data":"4da5fa7baed9349107c748c41e0b0d4e3e4f0f636c54f60952185a43b21b28e1"}
Jul 13 20:06:49.759467 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:49.759418    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:49.766193 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:49.766165    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:49.785696 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:49.785647    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" podStartSLOduration=1.785629661 podStartE2EDuration="1.785629661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:06:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:06:49.344517348 +0000 UTC m=+2482.345007910" watchObservedRunningTime="2026-07-13 20:06:49.785629661 +0000 UTC m=+2482.786120223"
Jul 13 20:06:50.324218 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:50.324180    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:50.325156 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:50.325134    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:06:56.353355 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:56.353250    2550 generic.go:356] "Generic (PLEG): container finished" podID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerID="488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90" exitCode=0
Jul 13 20:06:56.353355 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:56.353288    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" event={"ID":"9cf11c4f-3045-4b5a-a426-bbc239029c54","Type":"ContainerDied","Data":"488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90"}
Jul 13 20:06:56.353796 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:56.353670    2550 scope.go:117] "RemoveContainer" containerID="488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90"
Jul 13 20:06:56.354822 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:56.354771    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:06:56.354889 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:56.354854    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:06:56.354929 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:56.354888    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:06:57.365627 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:57.365589    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" event={"ID":"9cf11c4f-3045-4b5a-a426-bbc239029c54","Type":"ContainerStarted","Data":"86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1"}
Jul 13 20:06:57.812265 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:57.812228    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:57.813504 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:57.813475    2550 patch_prober.go:28] interesting pod/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 13 20:06:57.813626 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:57.813530    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 13 20:06:58.278394 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:58.278350    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:06:58.813191 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:58.813154    2550 patch_prober.go:28] interesting pod/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 13 20:06:58.813576 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:58.813216    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 13 20:06:59.813028 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:59.812987    2550 patch_prober.go:28] interesting pod/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 13 20:06:59.813219 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:06:59.813043    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 13 20:07:00.813228 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:00.813192    2550 patch_prober.go:28] interesting pod/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 13 20:07:00.813643 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:00.813263    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 13 20:07:01.816686 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:01.816653    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:07:01.817905 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:01.817881    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:07:06.365969 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:06.365926    2550 patch_prober.go:28] interesting pod/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 20:07:06.366500 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:06.366009    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 20:07:08.428228 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:08.428194    2550 generic.go:356] "Generic (PLEG): container finished" podID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerID="38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2" exitCode=0
Jul 13 20:07:08.428650 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:08.428273    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" event={"ID":"7cc7fa32-7659-4410-8e03-86e6140f80e0","Type":"ContainerDied","Data":"38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2"}
Jul 13 20:07:08.428744 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:08.428700    2550 scope.go:117] "RemoveContainer" containerID="38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2"
Jul 13 20:07:08.429746 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:08.429712    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:07:08.429870 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:08.429827    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:07:08.429939 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:08.429878    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:07:09.436573 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:09.436537    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" event={"ID":"7cc7fa32-7659-4410-8e03-86e6140f80e0","Type":"ContainerStarted","Data":"08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929"}
Jul 13 20:07:09.757548 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:09.756691    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:07:09.757548 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:09.757176    2550 patch_prober.go:28] interesting pod/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 20:07:09.757548 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:09.757228    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 20:07:10.756767 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:10.756717    2550 patch_prober.go:28] interesting pod/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 20:07:10.757307 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:10.756793    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 20:07:11.757463 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:11.757420    2550 patch_prober.go:28] interesting pod/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 20:07:11.758103 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:11.758066    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 20:07:12.757540 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:12.757499    2550 patch_prober.go:28] interesting pod/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 20:07:12.758186 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:12.758152    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 20:07:13.760600 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:13.760568    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:07:13.761005 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:13.760900    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:07:13.761537 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:13.761521    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:07:29.583367 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:29.583321    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"]
Jul 13 20:07:29.583902 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:29.583577    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy" containerID="cri-o://86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1" gracePeriod=30
Jul 13 20:07:31.819405 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:31.819366    2550 patch_prober.go:28] interesting pod/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 20:07:31.819791 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:31.819423    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:07:34.839125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:34.839099    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:07:35.025670 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.025576    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-certs\") pod \"9cf11c4f-3045-4b5a-a426-bbc239029c54\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") "
Jul 13 20:07:35.025670 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.025628    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-data\") pod \"9cf11c4f-3045-4b5a-a426-bbc239029c54\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") "
Jul 13 20:07:35.025939 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.025685    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg2d4\" (UniqueName: \"kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-kube-api-access-qg2d4\") pod \"9cf11c4f-3045-4b5a-a426-bbc239029c54\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") "
Jul 13 20:07:35.025939 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.025713    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-socket\") pod \"9cf11c4f-3045-4b5a-a426-bbc239029c54\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") "
Jul 13 20:07:35.025939 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.025731    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cf11c4f-3045-4b5a-a426-bbc239029c54-istiod-ca-cert\") pod \"9cf11c4f-3045-4b5a-a426-bbc239029c54\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") "
Jul 13 20:07:35.025939 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.025748    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-token\") pod \"9cf11c4f-3045-4b5a-a426-bbc239029c54\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") "
Jul 13 20:07:35.025939 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.025789    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-envoy\") pod \"9cf11c4f-3045-4b5a-a426-bbc239029c54\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") "
Jul 13 20:07:35.025939 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.025885    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-credential-socket\") pod \"9cf11c4f-3045-4b5a-a426-bbc239029c54\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") "
Jul 13 20:07:35.025939 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.025916    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-podinfo\") pod \"9cf11c4f-3045-4b5a-a426-bbc239029c54\" (UID: \"9cf11c4f-3045-4b5a-a426-bbc239029c54\") "
Jul 13 20:07:35.026207 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.025920    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9cf11c4f-3045-4b5a-a426-bbc239029c54" (UID: "9cf11c4f-3045-4b5a-a426-bbc239029c54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:07:35.026207 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.026132    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9cf11c4f-3045-4b5a-a426-bbc239029c54" (UID: "9cf11c4f-3045-4b5a-a426-bbc239029c54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:07:35.026207 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.026197    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9cf11c4f-3045-4b5a-a426-bbc239029c54" (UID: "9cf11c4f-3045-4b5a-a426-bbc239029c54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:07:35.026373 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.026260    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:07:35.026373 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.026285    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:07:35.026513 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.026400    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf11c4f-3045-4b5a-a426-bbc239029c54-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9cf11c4f-3045-4b5a-a426-bbc239029c54" (UID: "9cf11c4f-3045-4b5a-a426-bbc239029c54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:07:35.026982 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.026954    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-data" (OuterVolumeSpecName: "istio-data") pod "9cf11c4f-3045-4b5a-a426-bbc239029c54" (UID: "9cf11c4f-3045-4b5a-a426-bbc239029c54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:07:35.028206 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.028181    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9cf11c4f-3045-4b5a-a426-bbc239029c54" (UID: "9cf11c4f-3045-4b5a-a426-bbc239029c54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:07:35.028206 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.028198    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-kube-api-access-qg2d4" (OuterVolumeSpecName: "kube-api-access-qg2d4") pod "9cf11c4f-3045-4b5a-a426-bbc239029c54" (UID: "9cf11c4f-3045-4b5a-a426-bbc239029c54"). InnerVolumeSpecName "kube-api-access-qg2d4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:07:35.028346 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.028223    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9cf11c4f-3045-4b5a-a426-bbc239029c54" (UID: "9cf11c4f-3045-4b5a-a426-bbc239029c54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 20:07:35.028346 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.028248    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-token" (OuterVolumeSpecName: "istio-token") pod "9cf11c4f-3045-4b5a-a426-bbc239029c54" (UID: "9cf11c4f-3045-4b5a-a426-bbc239029c54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:07:35.127742 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.127698    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg2d4\" (UniqueName: \"kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-kube-api-access-qg2d4\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:07:35.127742 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.127734    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:07:35.127742 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.127744    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cf11c4f-3045-4b5a-a426-bbc239029c54-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:07:35.127742 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.127752    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:07:35.127742 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.127760    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:07:35.128084 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.127768    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:07:35.128084 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.127775    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cf11c4f-3045-4b5a-a426-bbc239029c54-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:07:35.579298 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.579265    2550 generic.go:356] "Generic (PLEG): container finished" podID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerID="86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1" exitCode=0
Jul 13 20:07:35.579484 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.579329    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"
Jul 13 20:07:35.579484 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.579352    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" event={"ID":"9cf11c4f-3045-4b5a-a426-bbc239029c54","Type":"ContainerDied","Data":"86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1"}
Jul 13 20:07:35.579484 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.579432    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m" event={"ID":"9cf11c4f-3045-4b5a-a426-bbc239029c54","Type":"ContainerDied","Data":"0923f206be8acba3b5f9ab8e0d5265adbe770b3eb0ce5e10bde583a49f7ea13b"}
Jul 13 20:07:35.579484 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.579454    2550 scope.go:117] "RemoveContainer" containerID="86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1"
Jul 13 20:07:35.588582 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.588547    2550 scope.go:117] "RemoveContainer" containerID="488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90"
Jul 13 20:07:35.596901 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.596865    2550 scope.go:117] "RemoveContainer" containerID="86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1"
Jul 13 20:07:35.597766 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:07:35.597739    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1\": container with ID starting with 86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1 not found: ID does not exist" containerID="86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1"
Jul 13 20:07:35.597901 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.597772    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1"} err="failed to get container status \"86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1\": rpc error: code = NotFound desc = could not find container \"86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1\": container with ID starting with 86c57d433fede5f940b3b305057ae8b6600196ce8555f6a2a2da097216bed3e1 not found: ID does not exist"
Jul 13 20:07:35.597901 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.597792    2550 scope.go:117] "RemoveContainer" containerID="488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90"
Jul 13 20:07:35.598137 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:07:35.598112    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90\": container with ID starting with 488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90 not found: ID does not exist" containerID="488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90"
Jul 13 20:07:35.598221 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.598143    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90"} err="failed to get container status \"488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90\": rpc error: code = NotFound desc = could not find container \"488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90\": container with ID starting with 488f13f0e3b1cfea23b308ef3aef64f73be940e264d859c1c3d85d6004109c90 not found: ID does not exist"
Jul 13 20:07:35.599795 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.599772    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"]
Jul 13 20:07:35.603186 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:35.603168    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-ebcb0c-openshift-default-6d4768dfc7-dfv9m"]
Jul 13 20:07:37.545927 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:37.545897    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" path="/var/lib/kubelet/pods/9cf11c4f-3045-4b5a-a426-bbc239029c54/volumes"
Jul 13 20:07:55.729094 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:55.729057    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"]
Jul 13 20:07:55.729504 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:55.729313    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy" containerID="cri-o://08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929" gracePeriod=30
Jul 13 20:07:56.693774 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.693737    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"]
Jul 13 20:07:56.694188 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.694174    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy"
Jul 13 20:07:56.694237 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.694190    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy"
Jul 13 20:07:56.694272 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.694263    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy"
Jul 13 20:07:56.694272 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.694271    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy"
Jul 13 20:07:56.697544 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.697525    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.704292 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.704200    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-939152-openshift-default-dockercfg-ln94c\""
Jul 13 20:07:56.721111 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.721075    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"]
Jul 13 20:07:56.825320 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.825274    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-socket\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.825320 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.825320    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/851b72c8-e542-4f1f-a998-3a24e960c14f-istiod-ca-cert\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.825779 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.825341    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-podinfo\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.825779 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.825439    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8kwj\" (UniqueName: \"kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-kube-api-access-v8kwj\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.825779 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.825499    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-certs\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.825779 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.825551    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-token\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.825779 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.825577    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-envoy\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.825779 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.825608    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-credential-socket\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.825779 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.825631    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-data\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.926725 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.926680    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8kwj\" (UniqueName: \"kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-kube-api-access-v8kwj\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.926956 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.926789    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-certs\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.926956 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.926914    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-token\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.926956 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.926952    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-envoy\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.927144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.926986    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-credential-socket\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.927144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.927016    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-data\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.927144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.927084    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-socket\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.927144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.927113    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/851b72c8-e542-4f1f-a998-3a24e960c14f-istiod-ca-cert\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.927144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.927139    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-podinfo\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.927413 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.927212    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-certs\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.927413 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.927292    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-credential-socket\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.927511 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.927488    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-data\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.927616 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.927597    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-socket\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.927908 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.927889    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/851b72c8-e542-4f1f-a998-3a24e960c14f-istiod-ca-cert\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.929414 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.929395    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-envoy\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.929736 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.929715    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-podinfo\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.935275 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.935244    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-token\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:56.935275 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:56.935263    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8kwj\" (UniqueName: \"kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-kube-api-access-v8kwj\") pod \"e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") " pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:57.008265 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:57.008177    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:57.157216 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:57.157186    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"]
Jul 13 20:07:57.159086 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:07:57.159062    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851b72c8_e542_4f1f_a998_3a24e960c14f.slice/crio-0122476a53063da523a2d5774633edfd0fdef574945959736e10f5479a35714c WatchSource:0}: Error finding container 0122476a53063da523a2d5774633edfd0fdef574945959736e10f5479a35714c: Status 404 returned error can't find the container with id 0122476a53063da523a2d5774633edfd0fdef574945959736e10f5479a35714c
Jul 13 20:07:57.161481 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:57.161445    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:07:57.161560 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:57.161521    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:07:57.161560 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:57.161552    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:07:57.695463 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:57.695427    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" event={"ID":"851b72c8-e542-4f1f-a998-3a24e960c14f","Type":"ContainerStarted","Data":"be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf"}
Jul 13 20:07:57.695658 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:57.695479    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" event={"ID":"851b72c8-e542-4f1f-a998-3a24e960c14f","Type":"ContainerStarted","Data":"0122476a53063da523a2d5774633edfd0fdef574945959736e10f5479a35714c"}
Jul 13 20:07:57.720366 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:57.720298    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" podStartSLOduration=1.7202794099999998 podStartE2EDuration="1.72027941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:07:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:07:57.718334622 +0000 UTC m=+2550.718825183" watchObservedRunningTime="2026-07-13 20:07:57.72027941 +0000 UTC m=+2550.720769970"
Jul 13 20:07:58.009051 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:58.008955    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:58.014024 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:58.013993    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:58.700470 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:58.700436    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:58.701429 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:58.701408    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:07:58.763157 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:58.763104    2550 patch_prober.go:28] interesting pod/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 13 20:07:58.763325 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:07:58.763174    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:08:01.008628 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.008596    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:08:01.080184 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080150    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nxmw\" (UniqueName: \"kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-kube-api-access-2nxmw\") pod \"7cc7fa32-7659-4410-8e03-86e6140f80e0\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") "
Jul 13 20:08:01.080373 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080227    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-certs\") pod \"7cc7fa32-7659-4410-8e03-86e6140f80e0\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") "
Jul 13 20:08:01.080373 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080266    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-podinfo\") pod \"7cc7fa32-7659-4410-8e03-86e6140f80e0\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") "
Jul 13 20:08:01.080373 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080289    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc7fa32-7659-4410-8e03-86e6140f80e0-istiod-ca-cert\") pod \"7cc7fa32-7659-4410-8e03-86e6140f80e0\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") "
Jul 13 20:08:01.080373 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080313    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-credential-socket\") pod \"7cc7fa32-7659-4410-8e03-86e6140f80e0\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") "
Jul 13 20:08:01.080596 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080376    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-token\") pod \"7cc7fa32-7659-4410-8e03-86e6140f80e0\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") "
Jul 13 20:08:01.080596 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080408    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-socket\") pod \"7cc7fa32-7659-4410-8e03-86e6140f80e0\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") "
Jul 13 20:08:01.080596 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080450    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-data\") pod \"7cc7fa32-7659-4410-8e03-86e6140f80e0\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") "
Jul 13 20:08:01.080596 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080483    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-envoy\") pod \"7cc7fa32-7659-4410-8e03-86e6140f80e0\" (UID: \"7cc7fa32-7659-4410-8e03-86e6140f80e0\") "
Jul 13 20:08:01.080596 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080567    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7cc7fa32-7659-4410-8e03-86e6140f80e0" (UID: "7cc7fa32-7659-4410-8e03-86e6140f80e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:08:01.080894 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080659    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7cc7fa32-7659-4410-8e03-86e6140f80e0" (UID: "7cc7fa32-7659-4410-8e03-86e6140f80e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:08:01.080894 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080794    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7cc7fa32-7659-4410-8e03-86e6140f80e0" (UID: "7cc7fa32-7659-4410-8e03-86e6140f80e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:08:01.080894 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080880    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:08:01.081056 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.080902    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:08:01.081133 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.081044    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cc7fa32-7659-4410-8e03-86e6140f80e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7cc7fa32-7659-4410-8e03-86e6140f80e0" (UID: "7cc7fa32-7659-4410-8e03-86e6140f80e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:08:01.081625 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.081597    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "7cc7fa32-7659-4410-8e03-86e6140f80e0" (UID: "7cc7fa32-7659-4410-8e03-86e6140f80e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:08:01.082727 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.082705    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7cc7fa32-7659-4410-8e03-86e6140f80e0" (UID: "7cc7fa32-7659-4410-8e03-86e6140f80e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 20:08:01.082849 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.082796    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-kube-api-access-2nxmw" (OuterVolumeSpecName: "kube-api-access-2nxmw") pod "7cc7fa32-7659-4410-8e03-86e6140f80e0" (UID: "7cc7fa32-7659-4410-8e03-86e6140f80e0"). InnerVolumeSpecName "kube-api-access-2nxmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:08:01.082919 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.082897    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7cc7fa32-7659-4410-8e03-86e6140f80e0" (UID: "7cc7fa32-7659-4410-8e03-86e6140f80e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:08:01.083028 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.083010    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "7cc7fa32-7659-4410-8e03-86e6140f80e0" (UID: "7cc7fa32-7659-4410-8e03-86e6140f80e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:08:01.182345 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.182304    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:08:01.182345 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.182337    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:08:01.182345 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.182347    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:08:01.182345 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.182356    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:08:01.182672 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.182366    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nxmw\" (UniqueName: \"kubernetes.io/projected/7cc7fa32-7659-4410-8e03-86e6140f80e0-kube-api-access-2nxmw\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:08:01.182672 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.182375    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc7fa32-7659-4410-8e03-86e6140f80e0-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:08:01.182672 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.182385    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc7fa32-7659-4410-8e03-86e6140f80e0-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:08:01.717559 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.717524    2550 generic.go:356] "Generic (PLEG): container finished" podID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerID="08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929" exitCode=0
Jul 13 20:08:01.717871 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.717570    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"
Jul 13 20:08:01.717871 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.717611    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" event={"ID":"7cc7fa32-7659-4410-8e03-86e6140f80e0","Type":"ContainerDied","Data":"08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929"}
Jul 13 20:08:01.717871 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.717661    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft" event={"ID":"7cc7fa32-7659-4410-8e03-86e6140f80e0","Type":"ContainerDied","Data":"4da5fa7baed9349107c748c41e0b0d4e3e4f0f636c54f60952185a43b21b28e1"}
Jul 13 20:08:01.717871 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.717685    2550 scope.go:117] "RemoveContainer" containerID="08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929"
Jul 13 20:08:01.727389 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.727361    2550 scope.go:117] "RemoveContainer" containerID="38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2"
Jul 13 20:08:01.738183 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.738154    2550 scope.go:117] "RemoveContainer" containerID="08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929"
Jul 13 20:08:01.738780 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:08:01.738748    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929\": container with ID starting with 08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929 not found: ID does not exist" containerID="08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929"
Jul 13 20:08:01.738931 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.738843    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929"} err="failed to get container status \"08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929\": rpc error: code = NotFound desc = could not find container \"08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929\": container with ID starting with 08897f6b1fd9b491336c67ca35fe7b9320cee0eab000f460427569ceab90f929 not found: ID does not exist"
Jul 13 20:08:01.738931 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.738871    2550 scope.go:117] "RemoveContainer" containerID="38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2"
Jul 13 20:08:01.739289 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.739106    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"]
Jul 13 20:08:01.739289 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:08:01.739229    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2\": container with ID starting with 38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2 not found: ID does not exist" containerID="38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2"
Jul 13 20:08:01.739289 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.739262    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2"} err="failed to get container status \"38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2\": rpc error: code = NotFound desc = could not find container \"38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2\": container with ID starting with 38a7418f88ac82c3b6ee4a542cc770e619ab5279d01052da37b2bf2cb764b9e2 not found: ID does not exist"
Jul 13 20:08:01.741471 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:01.741452    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-3e52c5-openshift-default-54b64cf6d7-zwcft"]
Jul 13 20:08:03.544961 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:03.544928    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" path="/var/lib/kubelet/pods/7cc7fa32-7659-4410-8e03-86e6140f80e0/volumes"
Jul 13 20:08:04.824788 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.824756    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"]
Jul 13 20:08:04.825320 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.825301    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy"
Jul 13 20:08:04.825391 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.825321    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf11c4f-3045-4b5a-a426-bbc239029c54" containerName="istio-proxy"
Jul 13 20:08:04.825391 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.825332    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy"
Jul 13 20:08:04.825391 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.825338    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy"
Jul 13 20:08:04.825391 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.825350    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy"
Jul 13 20:08:04.825391 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.825355    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy"
Jul 13 20:08:04.825680 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.825421    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy"
Jul 13 20:08:04.825680 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.825430    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cc7fa32-7659-4410-8e03-86e6140f80e0" containerName="istio-proxy"
Jul 13 20:08:04.828933 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.828903    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:04.831634 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.831613    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-641463-openshift-default-dockercfg-jnwwt\""
Jul 13 20:08:04.840842 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.840798    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"]
Jul 13 20:08:04.921148 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.921111    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-data\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:04.921346 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.921160    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-certs\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:04.921346 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.921198    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-socket\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:04.921346 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.921283    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-token\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:04.921346 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.921341    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istiod-ca-cert\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:04.921546 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.921404    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-podinfo\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:04.921546 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.921428    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdqpp\" (UniqueName: \"kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-kube-api-access-vdqpp\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:04.921546 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.921520    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-envoy\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:04.921712 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:04.921550    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-credential-socket\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.022709 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.022671    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-data\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.022709 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.022713    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-certs\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023014 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.022734    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-socket\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023014 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.022760    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-token\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023014 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.022838    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istiod-ca-cert\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023014 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.022883    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-podinfo\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023014 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.022901    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdqpp\" (UniqueName: \"kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-kube-api-access-vdqpp\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023014 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.022957    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-envoy\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023014 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.022978    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-credential-socket\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023381 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.023139    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-data\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023381 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.023182    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-certs\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023381 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.023213    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-socket\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023381 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.023287    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-credential-socket\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.023782 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.023760    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istiod-ca-cert\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.025619 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.025584    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-envoy\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.025746 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.025712    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-podinfo\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.032014 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.031975    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-token\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.032201 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.032182    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdqpp\" (UniqueName: \"kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-kube-api-access-vdqpp\") pod \"e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") " pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.140863 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.140744    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:05.284231 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.284202    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"]
Jul 13 20:08:05.286750 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:08:05.286727    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5bc3d8_ab51_45c4_ad9c_1a788b23f620.slice/crio-dd7b52ca26273779883831118f2ace96420036027ee87547f99dffd5aa134e3a WatchSource:0}: Error finding container dd7b52ca26273779883831118f2ace96420036027ee87547f99dffd5aa134e3a: Status 404 returned error can't find the container with id dd7b52ca26273779883831118f2ace96420036027ee87547f99dffd5aa134e3a
Jul 13 20:08:05.289410 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.289376    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:08:05.289496 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.289442    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:08:05.289496 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.289473    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:08:05.743193 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.743144    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" event={"ID":"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620","Type":"ContainerStarted","Data":"f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8"}
Jul 13 20:08:05.743411 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.743220    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" event={"ID":"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620","Type":"ContainerStarted","Data":"dd7b52ca26273779883831118f2ace96420036027ee87547f99dffd5aa134e3a"}
Jul 13 20:08:05.765932 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:05.765865    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" podStartSLOduration=1.765839453 podStartE2EDuration="1.765839453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:08:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:08:05.764451957 +0000 UTC m=+2558.764942529" watchObservedRunningTime="2026-07-13 20:08:05.765839453 +0000 UTC m=+2558.766330008"
Jul 13 20:08:06.142331 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:06.142189    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:06.156512 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:06.156469    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:06.751822 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:06.751617    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:06.754280 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:06.754035    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:12.798873 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:12.798834    2550 generic.go:356] "Generic (PLEG): container finished" podID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerID="be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf" exitCode=0
Jul 13 20:08:12.799321 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:12.798893    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" event={"ID":"851b72c8-e542-4f1f-a998-3a24e960c14f","Type":"ContainerDied","Data":"be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf"}
Jul 13 20:08:12.799371 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:12.799335    2550 scope.go:117] "RemoveContainer" containerID="be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf"
Jul 13 20:08:12.800356 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:12.800327    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:08:12.800412 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:12.800396    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:08:12.800447 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:12.800428    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:08:13.701163 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:13.701108    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:08:13.806310 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:13.806276    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" event={"ID":"851b72c8-e542-4f1f-a998-3a24e960c14f","Type":"ContainerStarted","Data":"1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20"}
Jul 13 20:08:14.009152 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:14.009054    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:08:14.010178 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:14.010152    2550 patch_prober.go:28] interesting pod/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 13 20:08:14.010297 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:14.010199    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 13 20:08:15.009642 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:15.009602    2550 patch_prober.go:28] interesting pod/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 13 20:08:15.010079 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:15.009663    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 13 20:08:16.009151 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:16.009116    2550 patch_prober.go:28] interesting pod/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 13 20:08:16.009350 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:16.009176    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 13 20:08:17.009548 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:17.009507    2550 patch_prober.go:28] interesting pod/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 13 20:08:17.009967 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:17.009575    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 13 20:08:18.009455 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:18.009414    2550 patch_prober.go:28] interesting pod/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 13 20:08:18.009647 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:18.009476    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 13 20:08:19.013932 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:19.013896    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:08:19.014311 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:19.014288    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:08:19.014944 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:19.014924    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:08:22.793063 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:22.793018    2550 patch_prober.go:28] interesting pod/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 20:08:22.793483 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:22.793107    2550 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 20:08:23.862215 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:23.862119    2550 generic.go:356] "Generic (PLEG): container finished" podID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerID="f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8" exitCode=0
Jul 13 20:08:23.862215 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:23.862198    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" event={"ID":"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620","Type":"ContainerDied","Data":"f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8"}
Jul 13 20:08:23.862774 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:23.862746    2550 scope.go:117] "RemoveContainer" containerID="f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8"
Jul 13 20:08:23.863867 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:23.863838    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:08:23.863979 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:23.863906    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:08:23.863979 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:23.863939    2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 13 20:08:24.869388 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:24.869348    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" event={"ID":"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620","Type":"ContainerStarted","Data":"c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04"}
Jul 13 20:08:25.141552 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:25.141440    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:25.150994 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:25.150951    2550 patch_prober.go:28] interesting pod/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 20:08:25.151298 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:25.151261    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 20:08:26.141314 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:26.141269    2550 patch_prober.go:28] interesting pod/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 20:08:26.141986 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:26.141948    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 20:08:27.070734 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.070696    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"]
Jul 13 20:08:27.075514 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.075494    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.080480 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.080453    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"auth-test-model-939152-kserve-self-signed-certs\""
Jul 13 20:08:27.080480 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.080474    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"default-dockercfg-t52rd\""
Jul 13 20:08:27.080698 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.080454    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"kube-root-ca.crt\""
Jul 13 20:08:27.080698 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.080454    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"openshift-service-ca.crt\""
Jul 13 20:08:27.086117 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.086091    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"]
Jul 13 20:08:27.152781 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.152292    2550 patch_prober.go:28] interesting pod/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 20:08:27.152781 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.152377    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 20:08:27.163470 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.163431    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b28f6a6f-42a8-4106-af85-e865370292f0-tls-certs\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.163470 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.163470    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-tmp-dir\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.163725 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.163537    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-model-cache\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.163725 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.163563    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-home\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.163725 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.163633    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn2xg\" (UniqueName: \"kubernetes.io/projected/b28f6a6f-42a8-4106-af85-e865370292f0-kube-api-access-dn2xg\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.163725 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.163708    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-dshm\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.264634 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.264527    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-model-cache\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.264634 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.264614    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-home\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.264914 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.264647    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn2xg\" (UniqueName: \"kubernetes.io/projected/b28f6a6f-42a8-4106-af85-e865370292f0-kube-api-access-dn2xg\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.264914 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.264704    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-dshm\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.264914 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.264752    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b28f6a6f-42a8-4106-af85-e865370292f0-tls-certs\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.264914 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.264777    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-tmp-dir\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.265058 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.265038    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-model-cache\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.265097 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.265067    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-home\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.265132 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.265114    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-tmp-dir\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.267390 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.267367    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-dshm\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.267701 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.267674    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b28f6a6f-42a8-4106-af85-e865370292f0-tls-certs\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.274156 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.274127    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn2xg\" (UniqueName: \"kubernetes.io/projected/b28f6a6f-42a8-4106-af85-e865370292f0-kube-api-access-dn2xg\") pod \"auth-test-model-939152-kserve-746f9fcc75-np2lc\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") " pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.388719 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.388648    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"default-dockercfg-t52rd\""
Jul 13 20:08:27.396029 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.396010    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:27.585029 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.584998    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"]
Jul 13 20:08:27.588070 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:08:27.588029    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb28f6a6f_42a8_4106_af85_e865370292f0.slice/crio-317f62730fb8519dc6d0b5c8f921d4af9a5f4ba7b71099599141aa117afad76d WatchSource:0}: Error finding container 317f62730fb8519dc6d0b5c8f921d4af9a5f4ba7b71099599141aa117afad76d: Status 404 returned error can't find the container with id 317f62730fb8519dc6d0b5c8f921d4af9a5f4ba7b71099599141aa117afad76d
Jul 13 20:08:27.887296 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.887260    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc" event={"ID":"b28f6a6f-42a8-4106-af85-e865370292f0","Type":"ContainerStarted","Data":"688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5"}
Jul 13 20:08:27.887296 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.887301    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc" event={"ID":"b28f6a6f-42a8-4106-af85-e865370292f0","Type":"ContainerStarted","Data":"317f62730fb8519dc6d0b5c8f921d4af9a5f4ba7b71099599141aa117afad76d"}
Jul 13 20:08:27.906302 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:27.906249    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc" podStartSLOduration=0.90623222 podStartE2EDuration="906.23222ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:08:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:08:27.904995792 +0000 UTC m=+2580.905486353" watchObservedRunningTime="2026-07-13 20:08:27.90623222 +0000 UTC m=+2580.906722815"
Jul 13 20:08:28.142970 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:28.142867    2550 patch_prober.go:28] interesting pod/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 20:08:28.142970 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:28.142932    2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 20:08:29.144991 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:29.144956    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:29.145389 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:29.145270    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:29.145901 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:29.145878    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:08:37.396720 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:37.396678    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:37.397314 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:37.396741    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:37.409614 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:37.409581    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:08:37.949256 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:08:37.949223    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:10:27.640214 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:10:27.640135    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 20:10:27.647480 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:10:27.647454    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 20:11:15.072335 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:15.072293    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"]
Jul 13 20:11:30.093029 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.092962    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc" podUID="b28f6a6f-42a8-4106-af85-e865370292f0" containerName="main" containerID="cri-o://688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5" gracePeriod=45
Jul 13 20:11:30.356486 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.356423    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:11:30.513387 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.513342    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-model-cache\") pod \"b28f6a6f-42a8-4106-af85-e865370292f0\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") "
Jul 13 20:11:30.513387 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.513391    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-dshm\") pod \"b28f6a6f-42a8-4106-af85-e865370292f0\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") "
Jul 13 20:11:30.513654 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.513457    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-tmp-dir\") pod \"b28f6a6f-42a8-4106-af85-e865370292f0\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") "
Jul 13 20:11:30.513654 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.513491    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn2xg\" (UniqueName: \"kubernetes.io/projected/b28f6a6f-42a8-4106-af85-e865370292f0-kube-api-access-dn2xg\") pod \"b28f6a6f-42a8-4106-af85-e865370292f0\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") "
Jul 13 20:11:30.513654 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.513539    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-home\") pod \"b28f6a6f-42a8-4106-af85-e865370292f0\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") "
Jul 13 20:11:30.513654 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.513599    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b28f6a6f-42a8-4106-af85-e865370292f0-tls-certs\") pod \"b28f6a6f-42a8-4106-af85-e865370292f0\" (UID: \"b28f6a6f-42a8-4106-af85-e865370292f0\") "
Jul 13 20:11:30.513905 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.513698    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "b28f6a6f-42a8-4106-af85-e865370292f0" (UID: "b28f6a6f-42a8-4106-af85-e865370292f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:11:30.513905 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.513725    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b28f6a6f-42a8-4106-af85-e865370292f0" (UID: "b28f6a6f-42a8-4106-af85-e865370292f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:11:30.513905 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.513881    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-home" (OuterVolumeSpecName: "home") pod "b28f6a6f-42a8-4106-af85-e865370292f0" (UID: "b28f6a6f-42a8-4106-af85-e865370292f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:11:30.514088 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.514069    2550 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-model-cache\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:11:30.514125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.514097    2550 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-tmp-dir\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:11:30.514125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.514110    2550 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-home\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:11:30.515914 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.515890    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b28f6a6f-42a8-4106-af85-e865370292f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b28f6a6f-42a8-4106-af85-e865370292f0" (UID: "b28f6a6f-42a8-4106-af85-e865370292f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:11:30.516009 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.515922    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-dshm" (OuterVolumeSpecName: "dshm") pod "b28f6a6f-42a8-4106-af85-e865370292f0" (UID: "b28f6a6f-42a8-4106-af85-e865370292f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:11:30.516009 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.515938    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b28f6a6f-42a8-4106-af85-e865370292f0-kube-api-access-dn2xg" (OuterVolumeSpecName: "kube-api-access-dn2xg") pod "b28f6a6f-42a8-4106-af85-e865370292f0" (UID: "b28f6a6f-42a8-4106-af85-e865370292f0"). InnerVolumeSpecName "kube-api-access-dn2xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:11:30.615220 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.615121    2550 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b28f6a6f-42a8-4106-af85-e865370292f0-tls-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:11:30.615220 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.615154    2550 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b28f6a6f-42a8-4106-af85-e865370292f0-dshm\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:11:30.615220 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.615166    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn2xg\" (UniqueName: \"kubernetes.io/projected/b28f6a6f-42a8-4106-af85-e865370292f0-kube-api-access-dn2xg\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:11:30.841815 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.841758    2550 generic.go:356] "Generic (PLEG): container finished" podID="b28f6a6f-42a8-4106-af85-e865370292f0" containerID="688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5" exitCode=0
Jul 13 20:11:30.841995 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.841837    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"
Jul 13 20:11:30.841995 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.841840    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc" event={"ID":"b28f6a6f-42a8-4106-af85-e865370292f0","Type":"ContainerDied","Data":"688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5"}
Jul 13 20:11:30.841995 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.841884    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc" event={"ID":"b28f6a6f-42a8-4106-af85-e865370292f0","Type":"ContainerDied","Data":"317f62730fb8519dc6d0b5c8f921d4af9a5f4ba7b71099599141aa117afad76d"}
Jul 13 20:11:30.841995 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.841901    2550 scope.go:117] "RemoveContainer" containerID="688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5"
Jul 13 20:11:30.852730 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.852696    2550 scope.go:117] "RemoveContainer" containerID="688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5"
Jul 13 20:11:30.853062 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:11:30.853043    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5\": container with ID starting with 688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5 not found: ID does not exist" containerID="688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5"
Jul 13 20:11:30.853124 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.853072    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5"} err="failed to get container status \"688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5\": rpc error: code = NotFound desc = could not find container \"688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5\": container with ID starting with 688ca5a6c6c8611a9af712b4b4cdf869b8060cd7919a0a0f6c1b54a303539cb5 not found: ID does not exist"
Jul 13 20:11:30.869184 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.869100    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"]
Jul 13 20:11:30.877276 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.877240    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-939152/auth-test-model-939152-kserve-746f9fcc75-np2lc"]
Jul 13 20:11:30.893707 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.893678    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"]
Jul 13 20:11:30.894333 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.894317    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b28f6a6f-42a8-4106-af85-e865370292f0" containerName="main"
Jul 13 20:11:30.894381 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.894338    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="b28f6a6f-42a8-4106-af85-e865370292f0" containerName="main"
Jul 13 20:11:30.894473 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.894462    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="b28f6a6f-42a8-4106-af85-e865370292f0" containerName="main"
Jul 13 20:11:30.899549 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.899529    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:30.902643 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.902620    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"kube-root-ca.crt\""
Jul 13 20:11:30.902782 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.902694    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"openshift-service-ca.crt\""
Jul 13 20:11:30.902888 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.902874    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"default-dockercfg-t52rd\""
Jul 13 20:11:30.903375 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.903356    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-939152\"/\"sub-test-model-939152-kserve-self-signed-certs\""
Jul 13 20:11:30.905433 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:30.905414    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"]
Jul 13 20:11:31.019597 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.019560    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-home\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.019782 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.019623    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tls-certs\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.019782 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.019646    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrblt\" (UniqueName: \"kubernetes.io/projected/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-kube-api-access-wrblt\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.019782 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.019717    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-dshm\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.019782 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.019758    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-model-cache\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.019991 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.019793    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tmp-dir\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.121289 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.121186    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tls-certs\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.121289 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.121235    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrblt\" (UniqueName: \"kubernetes.io/projected/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-kube-api-access-wrblt\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.121792 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.121290    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-dshm\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.121792 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.121332    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-model-cache\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.121792 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.121356    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tmp-dir\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.121792 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.121437    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-home\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.122059 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.121841    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tmp-dir\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.122059 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.121894    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-model-cache\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.122059 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.121930    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-home\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.123775 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.123745    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-dshm\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.123974 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.123955    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tls-certs\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.130683 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.130659    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrblt\" (UniqueName: \"kubernetes.io/projected/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-kube-api-access-wrblt\") pod \"sub-test-model-939152-kserve-5ff967cdb9-b8vlh\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") " pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.209923 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.209880    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:31.354445 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.354417    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"]
Jul 13 20:11:31.356741 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:11:31.356714    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc52af8f0_6416_4b35_a1c4_42cf6b8e0f0f.slice/crio-6552cd01849f5e11550aee24679c64ebacf0c64f711a0ba67c7323bf963f4b6b WatchSource:0}: Error finding container 6552cd01849f5e11550aee24679c64ebacf0c64f711a0ba67c7323bf963f4b6b: Status 404 returned error can't find the container with id 6552cd01849f5e11550aee24679c64ebacf0c64f711a0ba67c7323bf963f4b6b
Jul 13 20:11:31.546240 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.546208    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b28f6a6f-42a8-4106-af85-e865370292f0" path="/var/lib/kubelet/pods/b28f6a6f-42a8-4106-af85-e865370292f0/volumes"
Jul 13 20:11:31.849089 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.849052    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh" event={"ID":"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f","Type":"ContainerStarted","Data":"8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5"}
Jul 13 20:11:31.849089 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.849092    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh" event={"ID":"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f","Type":"ContainerStarted","Data":"6552cd01849f5e11550aee24679c64ebacf0c64f711a0ba67c7323bf963f4b6b"}
Jul 13 20:11:31.869001 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:31.868944    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh" podStartSLOduration=1.8689259599999999 podStartE2EDuration="1.86892596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:11:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:11:31.866326108 +0000 UTC m=+2764.866816668" watchObservedRunningTime="2026-07-13 20:11:31.86892596 +0000 UTC m=+2764.869416521"
Jul 13 20:11:41.210435 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:41.210399    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:41.210887 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:41.210457    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:41.223251 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:41.223223    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:11:41.908927 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:11:41.908898    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:12:52.360727 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:12:52.360688    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"]
Jul 13 20:13:07.381566 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.381516    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh" podUID="c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" containerName="main" containerID="cri-o://8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5" gracePeriod=45
Jul 13 20:13:07.641034 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.640965    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:13:07.796142 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796104    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-dshm\") pod \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") "
Jul 13 20:13:07.796315 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796151    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrblt\" (UniqueName: \"kubernetes.io/projected/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-kube-api-access-wrblt\") pod \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") "
Jul 13 20:13:07.796315 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796184    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tmp-dir\") pod \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") "
Jul 13 20:13:07.796315 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796251    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tls-certs\") pod \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") "
Jul 13 20:13:07.796315 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796306    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-model-cache\") pod \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") "
Jul 13 20:13:07.796467 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796398    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-home\") pod \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\" (UID: \"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f\") "
Jul 13 20:13:07.796520 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796477    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" (UID: "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:13:07.796700 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796661    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-model-cache" (OuterVolumeSpecName: "model-cache") pod "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" (UID: "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:13:07.796834 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796701    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-home" (OuterVolumeSpecName: "home") pod "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" (UID: "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:13:07.796834 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796756    2550 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tmp-dir\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:13:07.796834 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.796780    2550 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-model-cache\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:13:07.798440 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.798414    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" (UID: "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:13:07.798525 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.798442    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-dshm" (OuterVolumeSpecName: "dshm") pod "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" (UID: "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:13:07.798525 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.798505    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-kube-api-access-wrblt" (OuterVolumeSpecName: "kube-api-access-wrblt") pod "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" (UID: "c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f"). InnerVolumeSpecName "kube-api-access-wrblt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:13:07.897474 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.897378    2550 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-home\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:13:07.897474 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.897413    2550 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-dshm\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:13:07.897474 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.897422    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrblt\" (UniqueName: \"kubernetes.io/projected/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-kube-api-access-wrblt\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:13:07.897474 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:07.897433    2550 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f-tls-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:13:08.357898 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:08.357866    2550 generic.go:356] "Generic (PLEG): container finished" podID="c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" containerID="8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5" exitCode=0
Jul 13 20:13:08.357898 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:08.357907    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"
Jul 13 20:13:08.358115 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:08.357958    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh" event={"ID":"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f","Type":"ContainerDied","Data":"8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5"}
Jul 13 20:13:08.358115 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:08.357997    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh" event={"ID":"c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f","Type":"ContainerDied","Data":"6552cd01849f5e11550aee24679c64ebacf0c64f711a0ba67c7323bf963f4b6b"}
Jul 13 20:13:08.358115 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:08.358014    2550 scope.go:117] "RemoveContainer" containerID="8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5"
Jul 13 20:13:08.367789 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:08.367770    2550 scope.go:117] "RemoveContainer" containerID="8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5"
Jul 13 20:13:08.368119 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:13:08.368099    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5\": container with ID starting with 8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5 not found: ID does not exist" containerID="8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5"
Jul 13 20:13:08.368171 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:08.368128    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5"} err="failed to get container status \"8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5\": rpc error: code = NotFound desc = could not find container \"8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5\": container with ID starting with 8cbaaf7e2f70d6b39abee6e66881c50b96305a3ddae88cda97a01493b93012d5 not found: ID does not exist"
Jul 13 20:13:08.379469 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:08.379444    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"]
Jul 13 20:13:08.381301 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:08.381282    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-939152/sub-test-model-939152-kserve-5ff967cdb9-b8vlh"]
Jul 13 20:13:09.545607 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:09.545567    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" path="/var/lib/kubelet/pods/c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f/volumes"
Jul 13 20:13:30.894018 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.893984    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"]
Jul 13 20:13:30.894493 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.894390    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" containerName="main"
Jul 13 20:13:30.894493 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.894403    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" containerName="main"
Jul 13 20:13:30.894493 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.894492    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="c52af8f0-6416-4b35-a1c4-42cf6b8e0f0f" containerName="main"
Jul 13 20:13:30.898664 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.898644    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:30.903269 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.903249    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-641463\"/\"kube-root-ca.crt\""
Jul 13 20:13:30.903394 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.903251    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-641463\"/\"openshift-service-ca.crt\""
Jul 13 20:13:30.903394 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.903286    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-641463\"/\"rate-test-model-641463-kserve-self-signed-certs\""
Jul 13 20:13:30.903394 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.903251    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-641463\"/\"default-dockercfg-tlzg5\""
Jul 13 20:13:30.909444 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.909423    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"]
Jul 13 20:13:30.920855 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.920825    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-model-cache\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:30.920973 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.920884    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-home\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:30.921021 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.920976    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8044705-0db3-45e4-86c1-d8baa0f60237-tls-certs\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:30.921067 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.921056    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-tmp-dir\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:30.921126 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.921108    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gkdd\" (UniqueName: \"kubernetes.io/projected/d8044705-0db3-45e4-86c1-d8baa0f60237-kube-api-access-2gkdd\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:30.921175 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:30.921161    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-dshm\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.022154 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.022115    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8044705-0db3-45e4-86c1-d8baa0f60237-tls-certs\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.022338 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.022213    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-tmp-dir\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.022338 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.022257    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gkdd\" (UniqueName: \"kubernetes.io/projected/d8044705-0db3-45e4-86c1-d8baa0f60237-kube-api-access-2gkdd\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.022338 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.022292    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-dshm\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.022338 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.022328    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-model-cache\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.022560 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.022357    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-home\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.022857 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.022794    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-tmp-dir\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.023184 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.022856    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-model-cache\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.023184 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.022886    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-home\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.024623 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.024605    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-dshm\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.025114 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.025092    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8044705-0db3-45e4-86c1-d8baa0f60237-tls-certs\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.033052 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.033021    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gkdd\" (UniqueName: \"kubernetes.io/projected/d8044705-0db3-45e4-86c1-d8baa0f60237-kube-api-access-2gkdd\") pod \"rate-test-model-641463-kserve-864774bf5f-nxkn7\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") " pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.209096 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.209060    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:31.362592 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.362444    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"]
Jul 13 20:13:31.365107 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:13:31.365071    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8044705_0db3_45e4_86c1_d8baa0f60237.slice/crio-f19222f61fbeff427e484a15dba269aa2ae318246f7e5a0e5483d0dd51b0d89f WatchSource:0}: Error finding container f19222f61fbeff427e484a15dba269aa2ae318246f7e5a0e5483d0dd51b0d89f: Status 404 returned error can't find the container with id f19222f61fbeff427e484a15dba269aa2ae318246f7e5a0e5483d0dd51b0d89f
Jul 13 20:13:31.481654 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.481565    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7" event={"ID":"d8044705-0db3-45e4-86c1-d8baa0f60237","Type":"ContainerStarted","Data":"4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3"}
Jul 13 20:13:31.481654 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.481609    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7" event={"ID":"d8044705-0db3-45e4-86c1-d8baa0f60237","Type":"ContainerStarted","Data":"f19222f61fbeff427e484a15dba269aa2ae318246f7e5a0e5483d0dd51b0d89f"}
Jul 13 20:13:31.504397 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:31.504346    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7" podStartSLOduration=1.5043284670000001 podStartE2EDuration="1.504328467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:13:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:13:31.501939007 +0000 UTC m=+2884.502429569" watchObservedRunningTime="2026-07-13 20:13:31.504328467 +0000 UTC m=+2884.504819026"
Jul 13 20:13:41.209674 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:41.209624    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:41.210217 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:41.209702    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:41.222159 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:41.222127    2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:13:41.545873 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:13:41.545783    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:14:18.969567 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:18.969515    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"]
Jul 13 20:14:33.991108 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:33.991059    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7" podUID="d8044705-0db3-45e4-86c1-d8baa0f60237" containerName="main" containerID="cri-o://4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3" gracePeriod=45
Jul 13 20:14:34.252005 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.251941    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:14:34.366459 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.366430    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-home\") pod \"d8044705-0db3-45e4-86c1-d8baa0f60237\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") "
Jul 13 20:14:34.366661 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.366481    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8044705-0db3-45e4-86c1-d8baa0f60237-tls-certs\") pod \"d8044705-0db3-45e4-86c1-d8baa0f60237\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") "
Jul 13 20:14:34.366661 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.366532    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-dshm\") pod \"d8044705-0db3-45e4-86c1-d8baa0f60237\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") "
Jul 13 20:14:34.366661 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.366574    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-tmp-dir\") pod \"d8044705-0db3-45e4-86c1-d8baa0f60237\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") "
Jul 13 20:14:34.366661 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.366640    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-model-cache\") pod \"d8044705-0db3-45e4-86c1-d8baa0f60237\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") "
Jul 13 20:14:34.366926 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.366678    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gkdd\" (UniqueName: \"kubernetes.io/projected/d8044705-0db3-45e4-86c1-d8baa0f60237-kube-api-access-2gkdd\") pod \"d8044705-0db3-45e4-86c1-d8baa0f60237\" (UID: \"d8044705-0db3-45e4-86c1-d8baa0f60237\") "
Jul 13 20:14:34.366926 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.366725    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-home" (OuterVolumeSpecName: "home") pod "d8044705-0db3-45e4-86c1-d8baa0f60237" (UID: "d8044705-0db3-45e4-86c1-d8baa0f60237"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:14:34.367044 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.366897    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8044705-0db3-45e4-86c1-d8baa0f60237" (UID: "d8044705-0db3-45e4-86c1-d8baa0f60237"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:14:34.367044 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.366960    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8044705-0db3-45e4-86c1-d8baa0f60237" (UID: "d8044705-0db3-45e4-86c1-d8baa0f60237"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:14:34.367164 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.367074    2550 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-tmp-dir\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:14:34.367164 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.367088    2550 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-model-cache\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:14:34.367164 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.367096    2550 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-home\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:14:34.369021 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.368989    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8044705-0db3-45e4-86c1-d8baa0f60237-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8044705-0db3-45e4-86c1-d8baa0f60237" (UID: "d8044705-0db3-45e4-86c1-d8baa0f60237"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:14:34.369139 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.369059    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-dshm" (OuterVolumeSpecName: "dshm") pod "d8044705-0db3-45e4-86c1-d8baa0f60237" (UID: "d8044705-0db3-45e4-86c1-d8baa0f60237"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:14:34.369189 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.369157    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8044705-0db3-45e4-86c1-d8baa0f60237-kube-api-access-2gkdd" (OuterVolumeSpecName: "kube-api-access-2gkdd") pod "d8044705-0db3-45e4-86c1-d8baa0f60237" (UID: "d8044705-0db3-45e4-86c1-d8baa0f60237"). InnerVolumeSpecName "kube-api-access-2gkdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:14:34.468477 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.468442    2550 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8044705-0db3-45e4-86c1-d8baa0f60237-dshm\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:14:34.468477 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.468475    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gkdd\" (UniqueName: \"kubernetes.io/projected/d8044705-0db3-45e4-86c1-d8baa0f60237-kube-api-access-2gkdd\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:14:34.468694 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.468489    2550 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8044705-0db3-45e4-86c1-d8baa0f60237-tls-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:14:34.778025 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.777989    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7481-139940044403744"]
Jul 13 20:14:34.778406 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.778392    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8044705-0db3-45e4-86c1-d8baa0f60237" containerName="main"
Jul 13 20:14:34.778455 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.778407    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8044705-0db3-45e4-86c1-d8baa0f60237" containerName="main"
Jul 13 20:14:34.778500 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.778490    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8044705-0db3-45e4-86c1-d8baa0f60237" containerName="main"
Jul 13 20:14:34.781761 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.781743    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-139940044403744"
Jul 13 20:14:34.785165 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.785144    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pt8zs\""
Jul 13 20:14:34.790070 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.790041    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7481-139940044403744"]
Jul 13 20:14:34.809839 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.809788    2550 generic.go:356] "Generic (PLEG): container finished" podID="d8044705-0db3-45e4-86c1-d8baa0f60237" containerID="4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3" exitCode=0
Jul 13 20:14:34.809839 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.809842    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"
Jul 13 20:14:34.810058 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.809870    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7" event={"ID":"d8044705-0db3-45e4-86c1-d8baa0f60237","Type":"ContainerDied","Data":"4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3"}
Jul 13 20:14:34.810058 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.809919    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7" event={"ID":"d8044705-0db3-45e4-86c1-d8baa0f60237","Type":"ContainerDied","Data":"f19222f61fbeff427e484a15dba269aa2ae318246f7e5a0e5483d0dd51b0d89f"}
Jul 13 20:14:34.810058 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.809942    2550 scope.go:117] "RemoveContainer" containerID="4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3"
Jul 13 20:14:34.820163 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.820135    2550 scope.go:117] "RemoveContainer" containerID="4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3"
Jul 13 20:14:34.820466 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:14:34.820447    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3\": container with ID starting with 4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3 not found: ID does not exist" containerID="4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3"
Jul 13 20:14:34.820531 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.820478    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3"} err="failed to get container status \"4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3\": rpc error: code = NotFound desc = could not find container \"4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3\": container with ID starting with 4e710d18b0e9e9601973713c048dcc7ad594806366220a58c1eb74acf75ad8b3 not found: ID does not exist"
Jul 13 20:14:34.832170 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.832132    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"]
Jul 13 20:14:34.837762 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.837733    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-641463/rate-test-model-641463-kserve-864774bf5f-nxkn7"]
Jul 13 20:14:34.973667 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:34.973626    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47w68\" (UniqueName: \"kubernetes.io/projected/6cb4bdd5-3503-4b58-9b3d-adc48b73da59-kube-api-access-47w68\") pod \"test-curl-7481-139940044403744\" (UID: \"6cb4bdd5-3503-4b58-9b3d-adc48b73da59\") " pod="opendatahub/test-curl-7481-139940044403744"
Jul 13 20:14:35.074555 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:35.074456    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47w68\" (UniqueName: \"kubernetes.io/projected/6cb4bdd5-3503-4b58-9b3d-adc48b73da59-kube-api-access-47w68\") pod \"test-curl-7481-139940044403744\" (UID: \"6cb4bdd5-3503-4b58-9b3d-adc48b73da59\") " pod="opendatahub/test-curl-7481-139940044403744"
Jul 13 20:14:35.083614 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:35.083582    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47w68\" (UniqueName: \"kubernetes.io/projected/6cb4bdd5-3503-4b58-9b3d-adc48b73da59-kube-api-access-47w68\") pod \"test-curl-7481-139940044403744\" (UID: \"6cb4bdd5-3503-4b58-9b3d-adc48b73da59\") " pod="opendatahub/test-curl-7481-139940044403744"
Jul 13 20:14:35.092340 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:35.092315    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-139940044403744"
Jul 13 20:14:35.232841 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:35.232797    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7481-139940044403744"]
Jul 13 20:14:35.234560 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:14:35.234537    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cb4bdd5_3503_4b58_9b3d_adc48b73da59.slice/crio-edf3aadf05e86fc1440d89b08608d9ce9abadfc14d6cb24696aa03c8de08d818 WatchSource:0}: Error finding container edf3aadf05e86fc1440d89b08608d9ce9abadfc14d6cb24696aa03c8de08d818: Status 404 returned error can't find the container with id edf3aadf05e86fc1440d89b08608d9ce9abadfc14d6cb24696aa03c8de08d818
Jul 13 20:14:35.236085 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:35.236063    2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 20:14:35.545213 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:35.545181    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8044705-0db3-45e4-86c1-d8baa0f60237" path="/var/lib/kubelet/pods/d8044705-0db3-45e4-86c1-d8baa0f60237/volumes"
Jul 13 20:14:35.817326 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:35.817215    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7481-139940044403744" event={"ID":"6cb4bdd5-3503-4b58-9b3d-adc48b73da59","Type":"ContainerStarted","Data":"edf3aadf05e86fc1440d89b08608d9ce9abadfc14d6cb24696aa03c8de08d818"}
Jul 13 20:14:36.825465 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:36.825429    2550 generic.go:356] "Generic (PLEG): container finished" podID="6cb4bdd5-3503-4b58-9b3d-adc48b73da59" containerID="0749cb694b29a4ae9a3afb152674a776a2b411b0760a2d3d94c3eb83036170db" exitCode=0
Jul 13 20:14:36.825840 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:36.825480    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7481-139940044403744" event={"ID":"6cb4bdd5-3503-4b58-9b3d-adc48b73da59","Type":"ContainerDied","Data":"0749cb694b29a4ae9a3afb152674a776a2b411b0760a2d3d94c3eb83036170db"}
Jul 13 20:14:37.972923 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:37.972892    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-139940044403744"
Jul 13 20:14:38.004087 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:38.004056    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47w68\" (UniqueName: \"kubernetes.io/projected/6cb4bdd5-3503-4b58-9b3d-adc48b73da59-kube-api-access-47w68\") pod \"6cb4bdd5-3503-4b58-9b3d-adc48b73da59\" (UID: \"6cb4bdd5-3503-4b58-9b3d-adc48b73da59\") "
Jul 13 20:14:38.006298 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:38.006267    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cb4bdd5-3503-4b58-9b3d-adc48b73da59-kube-api-access-47w68" (OuterVolumeSpecName: "kube-api-access-47w68") pod "6cb4bdd5-3503-4b58-9b3d-adc48b73da59" (UID: "6cb4bdd5-3503-4b58-9b3d-adc48b73da59"). InnerVolumeSpecName "kube-api-access-47w68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:14:38.009859 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:38.009838    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7481-139940044403744_6cb4bdd5-3503-4b58-9b3d-adc48b73da59/test-curl-7481-139940044403744/0.log"
Jul 13 20:14:38.035095 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:38.035061    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7481-139940044403744"]
Jul 13 20:14:38.039139 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:38.039112    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7481-139940044403744"]
Jul 13 20:14:38.105114 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:38.105021    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47w68\" (UniqueName: \"kubernetes.io/projected/6cb4bdd5-3503-4b58-9b3d-adc48b73da59-kube-api-access-47w68\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:14:38.836300 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:38.836272    2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edf3aadf05e86fc1440d89b08608d9ce9abadfc14d6cb24696aa03c8de08d818"
Jul 13 20:14:38.836300 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:38.836274    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7481-139940044403744"
Jul 13 20:14:38.846971 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:14:38.846937    2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7481-139940044403744\" is forbidden: User \"system:node:ip-10-0-143-201.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-201.ec2.internal' and this object" podUID="6cb4bdd5-3503-4b58-9b3d-adc48b73da59" pod="opendatahub/test-curl-7481-139940044403744"
Jul 13 20:14:39.545531 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:14:39.545492    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cb4bdd5-3503-4b58-9b3d-adc48b73da59" path="/var/lib/kubelet/pods/6cb4bdd5-3503-4b58-9b3d-adc48b73da59/volumes"
Jul 13 20:15:04.089036 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:04.088999    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"]
Jul 13 20:15:04.089565 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:04.089272    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy" containerID="cri-o://1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20" gracePeriod=30
Jul 13 20:15:09.361173 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.361101    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:15:09.421842 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.421783    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/851b72c8-e542-4f1f-a998-3a24e960c14f-istiod-ca-cert\") pod \"851b72c8-e542-4f1f-a998-3a24e960c14f\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") "
Jul 13 20:15:09.422048 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.421853    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-data\") pod \"851b72c8-e542-4f1f-a998-3a24e960c14f\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") "
Jul 13 20:15:09.422048 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.421874    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-certs\") pod \"851b72c8-e542-4f1f-a998-3a24e960c14f\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") "
Jul 13 20:15:09.422048 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.421893    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-token\") pod \"851b72c8-e542-4f1f-a998-3a24e960c14f\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") "
Jul 13 20:15:09.422048 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.421908    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-envoy\") pod \"851b72c8-e542-4f1f-a998-3a24e960c14f\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") "
Jul 13 20:15:09.422048 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.421952    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-podinfo\") pod \"851b72c8-e542-4f1f-a998-3a24e960c14f\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") "
Jul 13 20:15:09.422048 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.421985    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-socket\") pod \"851b72c8-e542-4f1f-a998-3a24e960c14f\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") "
Jul 13 20:15:09.422048 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.422019    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-credential-socket\") pod \"851b72c8-e542-4f1f-a998-3a24e960c14f\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") "
Jul 13 20:15:09.422418 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.422067    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8kwj\" (UniqueName: \"kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-kube-api-access-v8kwj\") pod \"851b72c8-e542-4f1f-a998-3a24e960c14f\" (UID: \"851b72c8-e542-4f1f-a998-3a24e960c14f\") "
Jul 13 20:15:09.422418 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.422194    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/851b72c8-e542-4f1f-a998-3a24e960c14f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "851b72c8-e542-4f1f-a998-3a24e960c14f" (UID: "851b72c8-e542-4f1f-a998-3a24e960c14f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:15:09.422418 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.422230    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "851b72c8-e542-4f1f-a998-3a24e960c14f" (UID: "851b72c8-e542-4f1f-a998-3a24e960c14f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:15:09.422575 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.422479    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/851b72c8-e542-4f1f-a998-3a24e960c14f-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:09.422575 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.422499    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:09.422662 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.422580    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "851b72c8-e542-4f1f-a998-3a24e960c14f" (UID: "851b72c8-e542-4f1f-a998-3a24e960c14f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:15:09.423125 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.422525    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "851b72c8-e542-4f1f-a998-3a24e960c14f" (UID: "851b72c8-e542-4f1f-a998-3a24e960c14f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:15:09.423558 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.423531    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-data" (OuterVolumeSpecName: "istio-data") pod "851b72c8-e542-4f1f-a998-3a24e960c14f" (UID: "851b72c8-e542-4f1f-a998-3a24e960c14f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:15:09.424463 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.424437    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "851b72c8-e542-4f1f-a998-3a24e960c14f" (UID: "851b72c8-e542-4f1f-a998-3a24e960c14f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:15:09.424588 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.424556    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-kube-api-access-v8kwj" (OuterVolumeSpecName: "kube-api-access-v8kwj") pod "851b72c8-e542-4f1f-a998-3a24e960c14f" (UID: "851b72c8-e542-4f1f-a998-3a24e960c14f"). InnerVolumeSpecName "kube-api-access-v8kwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:15:09.424767 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.424732    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "851b72c8-e542-4f1f-a998-3a24e960c14f" (UID: "851b72c8-e542-4f1f-a998-3a24e960c14f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 20:15:09.424841 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.424778    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-token" (OuterVolumeSpecName: "istio-token") pod "851b72c8-e542-4f1f-a998-3a24e960c14f" (UID: "851b72c8-e542-4f1f-a998-3a24e960c14f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:15:09.523308 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.523269    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8kwj\" (UniqueName: \"kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-kube-api-access-v8kwj\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:09.523308 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.523301    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:09.523308 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.523311    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:09.523308 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.523318    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:09.523590 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.523327    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/851b72c8-e542-4f1f-a998-3a24e960c14f-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:09.523590 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.523335    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:09.523590 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.523343    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/851b72c8-e542-4f1f-a998-3a24e960c14f-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:09.992910 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.992867    2550 generic.go:356] "Generic (PLEG): container finished" podID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerID="1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20" exitCode=0
Jul 13 20:15:09.993115 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.992931    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" event={"ID":"851b72c8-e542-4f1f-a998-3a24e960c14f","Type":"ContainerDied","Data":"1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20"}
Jul 13 20:15:09.993115 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.992935    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"
Jul 13 20:15:09.993115 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.993004    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf" event={"ID":"851b72c8-e542-4f1f-a998-3a24e960c14f","Type":"ContainerDied","Data":"0122476a53063da523a2d5774633edfd0fdef574945959736e10f5479a35714c"}
Jul 13 20:15:09.993115 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:09.993026    2550 scope.go:117] "RemoveContainer" containerID="1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20"
Jul 13 20:15:10.002083 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:10.002062    2550 scope.go:117] "RemoveContainer" containerID="be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf"
Jul 13 20:15:10.011251 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:10.011194    2550 scope.go:117] "RemoveContainer" containerID="1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20"
Jul 13 20:15:10.011890 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:15:10.011858    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20\": container with ID starting with 1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20 not found: ID does not exist" containerID="1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20"
Jul 13 20:15:10.012004 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:10.011899    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20"} err="failed to get container status \"1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20\": rpc error: code = NotFound desc = could not find container \"1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20\": container with ID starting with 1434ffae830a16acd751ffa98a8e6aea43a6e7747cae51b10f6d27a9e4b38c20 not found: ID does not exist"
Jul 13 20:15:10.012004 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:10.011920    2550 scope.go:117] "RemoveContainer" containerID="be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf"
Jul 13 20:15:10.012251 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:15:10.012234    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf\": container with ID starting with be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf not found: ID does not exist" containerID="be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf"
Jul 13 20:15:10.012297 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:10.012266    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf"} err="failed to get container status \"be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf\": rpc error: code = NotFound desc = could not find container \"be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf\": container with ID starting with be68ed9237d25b3bd98ddf0666718b5e7ea164280c444b1c6e107460dc499bcf not found: ID does not exist"
Jul 13 20:15:10.014183 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:10.014162    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"]
Jul 13 20:15:10.017701 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:10.017676    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-939152-openshift-default-7ccb5bd8d7-j6wgf"]
Jul 13 20:15:11.545208 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:11.545165    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" path="/var/lib/kubelet/pods/851b72c8-e542-4f1f-a998-3a24e960c14f/volumes"
Jul 13 20:15:27.674731 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:27.674701    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 20:15:27.681944 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:27.681920    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 20:15:30.259511 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:30.259479    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"]
Jul 13 20:15:30.259968 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:30.259703    2550 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy" containerID="cri-o://c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04" gracePeriod=30
Jul 13 20:15:35.522784 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.522719    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:15:35.681545 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.681509    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-credential-socket\") pod \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") "
Jul 13 20:15:35.681743 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.681581    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-socket\") pod \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") "
Jul 13 20:15:35.681743 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.681608    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-token\") pod \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") "
Jul 13 20:15:35.681743 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.681628    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdqpp\" (UniqueName: \"kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-kube-api-access-vdqpp\") pod \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") "
Jul 13 20:15:35.681743 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.681649    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-envoy\") pod \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") "
Jul 13 20:15:35.681743 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.681685    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-podinfo\") pod \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") "
Jul 13 20:15:35.681743 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.681712    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-certs\") pod \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") "
Jul 13 20:15:35.682102 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.681751    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istiod-ca-cert\") pod \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") "
Jul 13 20:15:35.682102 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.681793    2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-data\") pod \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\" (UID: \"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620\") "
Jul 13 20:15:35.682102 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.681864    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" (UID: "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:15:35.682274 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.682089    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" (UID: "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:15:35.682274 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.682166    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" (UID: "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:15:35.682274 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.682185    2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-credential-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:35.682712 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.682411    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" (UID: "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:15:35.682970 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.682857    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" (UID: "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:15:35.684262 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.684236    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" (UID: "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:15:35.684262 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.684241    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" (UID: "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:15:35.684402 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.684273    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" (UID: "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 20:15:35.684402 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.684239    2550 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-kube-api-access-vdqpp" (OuterVolumeSpecName: "kube-api-access-vdqpp") pod "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" (UID: "3d5bc3d8-ab51-45c4-ad9c-1a788b23f620"). InnerVolumeSpecName "kube-api-access-vdqpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:15:35.783195 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.783106    2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-socket\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:35.783195 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.783139    2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-token\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:35.783195 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.783148    2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdqpp\" (UniqueName: \"kubernetes.io/projected/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-kube-api-access-vdqpp\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:35.783195 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.783158    2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-envoy\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:35.783195 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.783166    2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-podinfo\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:35.783195 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.783173    2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-workload-certs\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:35.783195 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.783181    2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istiod-ca-cert\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:35.783195 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:35.783188    2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620-istio-data\") on node \"ip-10-0-143-201.ec2.internal\" DevicePath \"\""
Jul 13 20:15:36.127489 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.127400    2550 generic.go:356] "Generic (PLEG): container finished" podID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerID="c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04" exitCode=0
Jul 13 20:15:36.127622 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.127515    2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"
Jul 13 20:15:36.127622 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.127526    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" event={"ID":"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620","Type":"ContainerDied","Data":"c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04"}
Jul 13 20:15:36.127622 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.127581    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq" event={"ID":"3d5bc3d8-ab51-45c4-ad9c-1a788b23f620","Type":"ContainerDied","Data":"dd7b52ca26273779883831118f2ace96420036027ee87547f99dffd5aa134e3a"}
Jul 13 20:15:36.127622 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.127613    2550 scope.go:117] "RemoveContainer" containerID="c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04"
Jul 13 20:15:36.136123 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.136101    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65fb85bbdb-v77cs_1c52a024-2aea-4d93-b00e-cf752e5e5fe4/manager/0.log"
Jul 13 20:15:36.139287 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.139271    2550 scope.go:117] "RemoveContainer" containerID="f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8"
Jul 13 20:15:36.148100 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.148081    2550 scope.go:117] "RemoveContainer" containerID="c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04"
Jul 13 20:15:36.148356 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:15:36.148338    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04\": container with ID starting with c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04 not found: ID does not exist" containerID="c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04"
Jul 13 20:15:36.148396 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.148366    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04"} err="failed to get container status \"c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04\": rpc error: code = NotFound desc = could not find container \"c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04\": container with ID starting with c5ee9072dfaf79ebd4c5fc55f972124825be0c7e74119f646cacd3b5d7d48e04 not found: ID does not exist"
Jul 13 20:15:36.148396 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.148383    2550 scope.go:117] "RemoveContainer" containerID="f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8"
Jul 13 20:15:36.148591 ip-10-0-143-201 kubenswrapper[2550]: E0713 20:15:36.148575    2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8\": container with ID starting with f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8 not found: ID does not exist" containerID="f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8"
Jul 13 20:15:36.148644 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.148595    2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8"} err="failed to get container status \"f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8\": rpc error: code = NotFound desc = could not find container \"f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8\": container with ID starting with f74cd7193486ddcc3f6654f58fee31984ceffc579d21ff2209588e65d40aa2f8 not found: ID does not exist"
Jul 13 20:15:36.152605 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.152583    2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"]
Jul 13 20:15:36.158427 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.158405    2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-641463-openshift-default-744d8c69cf-ht9lq"]
Jul 13 20:15:36.767757 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.767727    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699d4944b8-925qn_b3481830-5625-4b05-8798-2d1267df65e2/copy-manifests/0.log"
Jul 13 20:15:36.775184 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:36.775157    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699d4944b8-925qn_b3481830-5625-4b05-8798-2d1267df65e2/manager/0.log"
Jul 13 20:15:37.133607 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:37.133514    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5fbf5b9f44-wjjxt_e22e4ab0-cc75-4edd-8a99-65fad275235b/maas-api/0.log"
Jul 13 20:15:37.246667 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:37.246637    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732865-c7xp2_b89edfef-b78a-413d-86f6-f363942980c1/cleanup/0.log"
Jul 13 20:15:37.351518 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:37.351486    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29732880-kxkgb_d16bcd19-610c-425f-9d1b-2abeda452041/cleanup/0.log"
Jul 13 20:15:37.551584 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:37.551539    2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" path="/var/lib/kubelet/pods/3d5bc3d8-ab51-45c4-ad9c-1a788b23f620/volumes"
Jul 13 20:15:37.997927 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:37.997896    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-66d7f166-5gdb5_cd5ac1c4-c77e-4925-89ff-cf422841a84b/revoke-keys/0.log"
Jul 13 20:15:38.342147 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:38.342066    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-ac3fa3ea-9x74n_51f5d87e-f511-471c-b358-779d130a4d2a/revoke-keys/0.log"
Jul 13 20:15:38.885930 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:38.885900    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-z9s5q_0656f015-2ccb-4493-a977-d03e89ed7e6a/postgres/0.log"
Jul 13 20:15:40.554789 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:40.554762    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-25brp_c5e2f441-54fd-4474-99ac-66e7614f283a/kuadrant-console-plugin/0.log"
Jul 13 20:15:41.735538 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:41.735503    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6996ff5f69-q2gkk_803feb63-4162-41e0-8ceb-2aabdf98cc70/kube-auth-proxy/0.log"
Jul 13 20:15:42.110444 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:42.110349    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-dh8wp_83d4faf8-6c53-48ae-94b3-23d1df0de01a/payload-processing/0.log"
Jul 13 20:15:42.691096 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:42.691065    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2vbvv_7441d2b9-4017-4d01-aebf-9759fc0001ec/main/0.log"
Jul 13 20:15:47.644366 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644327    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mmgjw/must-gather-f6dbv"]
Jul 13 20:15:47.644797 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644713    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cb4bdd5-3503-4b58-9b3d-adc48b73da59" containerName="test-curl-7481-139940044403744"
Jul 13 20:15:47.644797 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644724    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cb4bdd5-3503-4b58-9b3d-adc48b73da59" containerName="test-curl-7481-139940044403744"
Jul 13 20:15:47.644797 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644735    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy"
Jul 13 20:15:47.644797 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644742    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy"
Jul 13 20:15:47.644797 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644749    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy"
Jul 13 20:15:47.644797 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644756    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy"
Jul 13 20:15:47.644797 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644768    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy"
Jul 13 20:15:47.644797 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644773    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy"
Jul 13 20:15:47.645110 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644849    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy"
Jul 13 20:15:47.645110 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644859    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy"
Jul 13 20:15:47.645110 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644865    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d5bc3d8-ab51-45c4-ad9c-1a788b23f620" containerName="istio-proxy"
Jul 13 20:15:47.645110 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644871    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cb4bdd5-3503-4b58-9b3d-adc48b73da59" containerName="test-curl-7481-139940044403744"
Jul 13 20:15:47.645110 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644928    2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy"
Jul 13 20:15:47.645110 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644934    2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy"
Jul 13 20:15:47.645110 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.644994    2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="851b72c8-e542-4f1f-a998-3a24e960c14f" containerName="istio-proxy"
Jul 13 20:15:47.649573 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.649551    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmgjw/must-gather-f6dbv"
Jul 13 20:15:47.652996 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.652965    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmgjw\"/\"kube-root-ca.crt\""
Jul 13 20:15:47.653150 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.652966    2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mmgjw\"/\"default-dockercfg-tzzw6\""
Jul 13 20:15:47.653655 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.653635    2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mmgjw\"/\"openshift-service-ca.crt\""
Jul 13 20:15:47.660408 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.660377    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmgjw/must-gather-f6dbv"]
Jul 13 20:15:47.703765 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.703722    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb9x6\" (UniqueName: \"kubernetes.io/projected/6d838482-caf2-4c08-a1cd-6bc79679deb5-kube-api-access-xb9x6\") pod \"must-gather-f6dbv\" (UID: \"6d838482-caf2-4c08-a1cd-6bc79679deb5\") " pod="openshift-must-gather-mmgjw/must-gather-f6dbv"
Jul 13 20:15:47.704001 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.703790    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6d838482-caf2-4c08-a1cd-6bc79679deb5-must-gather-output\") pod \"must-gather-f6dbv\" (UID: \"6d838482-caf2-4c08-a1cd-6bc79679deb5\") " pod="openshift-must-gather-mmgjw/must-gather-f6dbv"
Jul 13 20:15:47.805170 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.805125    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb9x6\" (UniqueName: \"kubernetes.io/projected/6d838482-caf2-4c08-a1cd-6bc79679deb5-kube-api-access-xb9x6\") pod \"must-gather-f6dbv\" (UID: \"6d838482-caf2-4c08-a1cd-6bc79679deb5\") " pod="openshift-must-gather-mmgjw/must-gather-f6dbv"
Jul 13 20:15:47.805354 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.805179    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6d838482-caf2-4c08-a1cd-6bc79679deb5-must-gather-output\") pod \"must-gather-f6dbv\" (UID: \"6d838482-caf2-4c08-a1cd-6bc79679deb5\") " pod="openshift-must-gather-mmgjw/must-gather-f6dbv"
Jul 13 20:15:47.805527 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.805511    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6d838482-caf2-4c08-a1cd-6bc79679deb5-must-gather-output\") pod \"must-gather-f6dbv\" (UID: \"6d838482-caf2-4c08-a1cd-6bc79679deb5\") " pod="openshift-must-gather-mmgjw/must-gather-f6dbv"
Jul 13 20:15:47.814255 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.814217    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb9x6\" (UniqueName: \"kubernetes.io/projected/6d838482-caf2-4c08-a1cd-6bc79679deb5-kube-api-access-xb9x6\") pod \"must-gather-f6dbv\" (UID: \"6d838482-caf2-4c08-a1cd-6bc79679deb5\") " pod="openshift-must-gather-mmgjw/must-gather-f6dbv"
Jul 13 20:15:47.960600 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:47.960567    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmgjw/must-gather-f6dbv"
Jul 13 20:15:48.104426 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:48.104399    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmgjw/must-gather-f6dbv"]
Jul 13 20:15:48.106492 ip-10-0-143-201 kubenswrapper[2550]: W0713 20:15:48.106459    2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d838482_caf2_4c08_a1cd_6bc79679deb5.slice/crio-b15af53932af22088e72807d4c0e2baa5a2d6c3576f8124134ac4f8848f9b527 WatchSource:0}: Error finding container b15af53932af22088e72807d4c0e2baa5a2d6c3576f8124134ac4f8848f9b527: Status 404 returned error can't find the container with id b15af53932af22088e72807d4c0e2baa5a2d6c3576f8124134ac4f8848f9b527
Jul 13 20:15:48.192132 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:48.192092    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmgjw/must-gather-f6dbv" event={"ID":"6d838482-caf2-4c08-a1cd-6bc79679deb5","Type":"ContainerStarted","Data":"b15af53932af22088e72807d4c0e2baa5a2d6c3576f8124134ac4f8848f9b527"}
Jul 13 20:15:49.202448 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:49.202393    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmgjw/must-gather-f6dbv" event={"ID":"6d838482-caf2-4c08-a1cd-6bc79679deb5","Type":"ContainerStarted","Data":"90521d0547f1668542a1398ed8f7037e62c5b962201f887082652a51cdb62784"}
Jul 13 20:15:49.202968 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:49.202457    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmgjw/must-gather-f6dbv" event={"ID":"6d838482-caf2-4c08-a1cd-6bc79679deb5","Type":"ContainerStarted","Data":"c4a73950c9290eafb3b3973504501147ad8198f4f838c702a1b9895daf783674"}
Jul 13 20:15:49.220548 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:49.220479    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mmgjw/must-gather-f6dbv" podStartSLOduration=1.4595594539999999 podStartE2EDuration="2.220454888s" totalImagesPullingTime="760.895434ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:15:49.21824222 +0000 UTC m=+3022.218732781" watchObservedRunningTime="2026-07-13 20:15:49.220454888 +0000 UTC m=+3022.220945449"
Jul 13 20:15:50.484534 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:50.484486    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tpwr5_1f004726-0178-4641-a8bc-435b7858296d/global-pull-secret-syncer/0.log"
Jul 13 20:15:50.602073 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:50.602044    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t4vkw_d62f8808-e36a-481e-957c-197de3e85cf9/konnectivity-agent/0.log"
Jul 13 20:15:50.661720 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:50.661677    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-201.ec2.internal_1979fb683e265419a7ecbcfd0f890be8/haproxy/0.log"
Jul 13 20:15:55.515268 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:55.515218    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-25brp_c5e2f441-54fd-4474-99ac-66e7614f283a/kuadrant-console-plugin/0.log"
Jul 13 20:15:57.598259 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.598229    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63cef965-9f90-4862-9408-ba19b9c3f055/alertmanager/0.log"
Jul 13 20:15:57.621130 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.621104    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63cef965-9f90-4862-9408-ba19b9c3f055/config-reloader/0.log"
Jul 13 20:15:57.641478 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.641441    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63cef965-9f90-4862-9408-ba19b9c3f055/kube-rbac-proxy-web/0.log"
Jul 13 20:15:57.660614 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.660587    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63cef965-9f90-4862-9408-ba19b9c3f055/kube-rbac-proxy/0.log"
Jul 13 20:15:57.681447 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.681414    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63cef965-9f90-4862-9408-ba19b9c3f055/kube-rbac-proxy-metric/0.log"
Jul 13 20:15:57.704600 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.704571    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63cef965-9f90-4862-9408-ba19b9c3f055/prom-label-proxy/0.log"
Jul 13 20:15:57.724794 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.724749    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63cef965-9f90-4862-9408-ba19b9c3f055/init-config-reloader/0.log"
Jul 13 20:15:57.789289 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.789202    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sjbxl_400b2960-9f92-46fb-a078-e7c7b93f15d8/kube-state-metrics/0.log"
Jul 13 20:15:57.812646 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.812613    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sjbxl_400b2960-9f92-46fb-a078-e7c7b93f15d8/kube-rbac-proxy-main/0.log"
Jul 13 20:15:57.833034 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.832997    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-sjbxl_400b2960-9f92-46fb-a078-e7c7b93f15d8/kube-rbac-proxy-self/0.log"
Jul 13 20:15:57.906182 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:57.906127    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-7tpbl_f66364ef-e434-4389-80bf-6846db17b248/monitoring-plugin/0.log"
Jul 13 20:15:58.094563 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.094536    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjxw9_3600f7f8-8b8d-4129-83d0-b8d24172c46c/node-exporter/0.log"
Jul 13 20:15:58.130911 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.130880    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjxw9_3600f7f8-8b8d-4129-83d0-b8d24172c46c/kube-rbac-proxy/0.log"
Jul 13 20:15:58.156124 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.156097    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sjxw9_3600f7f8-8b8d-4129-83d0-b8d24172c46c/init-textfile/0.log"
Jul 13 20:15:58.282322 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.282265    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_628d8f49-e69d-48f3-895b-2612e26adf2c/prometheus/0.log"
Jul 13 20:15:58.304699 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.304671    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_628d8f49-e69d-48f3-895b-2612e26adf2c/config-reloader/0.log"
Jul 13 20:15:58.325682 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.325595    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_628d8f49-e69d-48f3-895b-2612e26adf2c/thanos-sidecar/0.log"
Jul 13 20:15:58.347007 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.346958    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_628d8f49-e69d-48f3-895b-2612e26adf2c/kube-rbac-proxy-web/0.log"
Jul 13 20:15:58.368157 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.368129    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_628d8f49-e69d-48f3-895b-2612e26adf2c/kube-rbac-proxy/0.log"
Jul 13 20:15:58.388428 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.388399    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_628d8f49-e69d-48f3-895b-2612e26adf2c/kube-rbac-proxy-thanos/0.log"
Jul 13 20:15:58.408533 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.408418    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_628d8f49-e69d-48f3-895b-2612e26adf2c/init-config-reloader/0.log"
Jul 13 20:15:58.472742 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.472691    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-b6s5w_41784ef4-2240-4fa9-8a42-aa3d22af202b/prometheus-operator-admission-webhook/0.log"
Jul 13 20:15:58.513511 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.513431    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c6c8f4664-p4xnf_4e21d8f1-81a4-4f34-be01-4701818ef7a6/telemeter-client/0.log"
Jul 13 20:15:58.534338 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.534295    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c6c8f4664-p4xnf_4e21d8f1-81a4-4f34-be01-4701818ef7a6/reload/0.log"
Jul 13 20:15:58.550144 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:15:58.550090    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c6c8f4664-p4xnf_4e21d8f1-81a4-4f34-be01-4701818ef7a6/kube-rbac-proxy/0.log"
Jul 13 20:16:00.563243 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:00.563206    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/1.log"
Jul 13 20:16:00.568418 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:00.568386    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-cgddw_c5fbbc82-5e10-45c2-91fd-6aa286ce7a8a/console-operator/2.log"
Jul 13 20:16:01.749436 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:01.749408    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-c4pxb_9ed17614-e3b8-4d1f-b8af-08c2f61f6348/volume-data-source-validator/0.log"
Jul 13 20:16:02.278112 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.278063    2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"]
Jul 13 20:16:02.283040 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.283009    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.292299 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.292264    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"]
Jul 13 20:16:02.390382 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.390336    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8p49\" (UniqueName: \"kubernetes.io/projected/572684e4-e141-4c31-97a8-14027dbf3d69-kube-api-access-n8p49\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.390727 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.390702    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-lib-modules\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.390923 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.390903    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-sys\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.391174 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.391154    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-proc\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.391358 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.391340    2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-podres\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.492507 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.492455    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8p49\" (UniqueName: \"kubernetes.io/projected/572684e4-e141-4c31-97a8-14027dbf3d69-kube-api-access-n8p49\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.492717 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.492528    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-lib-modules\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.492717 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.492555    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-sys\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.492717 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.492611    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-proc\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.492717 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.492649    2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-podres\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.492970 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.492895    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-podres\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.493117 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.493084    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-sys\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.493245 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.493221    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-lib-modules\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.493330 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.493298    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/572684e4-e141-4c31-97a8-14027dbf3d69-proc\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.502843 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.502791    2550 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8p49\" (UniqueName: \"kubernetes.io/projected/572684e4-e141-4c31-97a8-14027dbf3d69-kube-api-access-n8p49\") pod \"perf-node-gather-daemonset-f8fl5\" (UID: \"572684e4-e141-4c31-97a8-14027dbf3d69\") " pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.597045 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.596938    2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:02.778480 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.778441    2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"]
Jul 13 20:16:02.845127 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.844985    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-52dqm_7768e8b8-d5bd-461a-8fbb-694332e9c6a5/dns/0.log"
Jul 13 20:16:02.866655 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.866627    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-52dqm_7768e8b8-d5bd-461a-8fbb-694332e9c6a5/kube-rbac-proxy/0.log"
Jul 13 20:16:02.972996 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:02.972966    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5t7xt_e1e04b4b-28d6-4a1a-b2ad-6e9a136430aa/dns-node-resolver/0.log"
Jul 13 20:16:03.317181 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:03.317137    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5" event={"ID":"572684e4-e141-4c31-97a8-14027dbf3d69","Type":"ContainerStarted","Data":"3d7e2d6bea0997d270c43b235dabbc13125c04e910042e53e263a9b95a3ac7da"}
Jul 13 20:16:03.317399 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:03.317209    2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5" event={"ID":"572684e4-e141-4c31-97a8-14027dbf3d69","Type":"ContainerStarted","Data":"38ae45edbbd9815b9aa614bde105ba317db55542b11f3d694c756e7e3244b913"}
Jul 13 20:16:03.317399 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:03.317379    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:03.338945 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:03.338881    2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5" podStartSLOduration=1.338854397 podStartE2EDuration="1.338854397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:16:03.33595364 +0000 UTC m=+3036.336444201" watchObservedRunningTime="2026-07-13 20:16:03.338854397 +0000 UTC m=+3036.339344959"
Jul 13 20:16:03.573151 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:03.573064    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d7c594c84-pk6jl_506310dc-395f-4a2e-94b3-037160fc4003/registry/0.log"
Jul 13 20:16:03.592639 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:03.592610    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9wdt5_e9146574-0c5d-4830-9bfe-80972c84aa3c/node-ca/0.log"
Jul 13 20:16:04.799064 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:04.799038    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6996ff5f69-q2gkk_803feb63-4162-41e0-8ceb-2aabdf98cc70/kube-auth-proxy/0.log"
Jul 13 20:16:04.914518 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:04.914480    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-dh8wp_83d4faf8-6c53-48ae-94b3-23d1df0de01a/payload-processing/0.log"
Jul 13 20:16:05.634229 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:05.634198    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-x2m4m_a05b8244-83b1-4ece-b238-212ece39fc9f/serve-healthcheck-canary/0.log"
Jul 13 20:16:06.256672 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:06.256644    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nzv9n_ef79a2a0-c323-4350-8807-bb6ffe252c05/kube-rbac-proxy/0.log"
Jul 13 20:16:06.274615 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:06.274585    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nzv9n_ef79a2a0-c323-4350-8807-bb6ffe252c05/exporter/0.log"
Jul 13 20:16:06.294119 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:06.294088    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nzv9n_ef79a2a0-c323-4350-8807-bb6ffe252c05/extractor/0.log"
Jul 13 20:16:08.687737 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:08.687706    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65fb85bbdb-v77cs_1c52a024-2aea-4d93-b00e-cf752e5e5fe4/manager/0.log"
Jul 13 20:16:08.923721 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:08.923674    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699d4944b8-925qn_b3481830-5625-4b05-8798-2d1267df65e2/manager/0.log"
Jul 13 20:16:08.944940 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:08.944840    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-699d4944b8-925qn_b3481830-5625-4b05-8798-2d1267df65e2/copy-manifests/0.log"
Jul 13 20:16:09.337100 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:09.337022    2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mmgjw/perf-node-gather-daemonset-f8fl5"
Jul 13 20:16:10.116194 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:10.116150    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75894cfc5c-v7wvg_ffc70d20-b203-4f33-a8ef-74c57e9c9113/manager/0.log"
Jul 13 20:16:11.032858 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:11.032828    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6996ff5f69-q2gkk_803feb63-4162-41e0-8ceb-2aabdf98cc70/kube-auth-proxy/0.log"
Jul 13 20:16:11.138096 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:11.137980    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-dh8wp_83d4faf8-6c53-48ae-94b3-23d1df0de01a/payload-processing/0.log"
Jul 13 20:16:12.722422 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:12.722394    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6996ff5f69-q2gkk_803feb63-4162-41e0-8ceb-2aabdf98cc70/kube-auth-proxy/0.log"
Jul 13 20:16:12.809718 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:12.809638    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-dh8wp_83d4faf8-6c53-48ae-94b3-23d1df0de01a/payload-processing/0.log"
Jul 13 20:16:15.468171 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:15.468141    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-shsp2_f70f1fa9-d850-458e-9e69-bad1e3acc107/migrator/0.log"
Jul 13 20:16:15.486843 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:15.486797    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-shsp2_f70f1fa9-d850-458e-9e69-bad1e3acc107/graceful-termination/0.log"
Jul 13 20:16:17.031406 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:17.031381    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ndh6_5971a943-83fc-4fc6-8e13-02231e431039/kube-multus-additional-cni-plugins/0.log"
Jul 13 20:16:17.090523 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:17.090484    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ndh6_5971a943-83fc-4fc6-8e13-02231e431039/egress-router-binary-copy/0.log"
Jul 13 20:16:17.133029 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:17.132996    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ndh6_5971a943-83fc-4fc6-8e13-02231e431039/cni-plugins/0.log"
Jul 13 20:16:17.159305 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:17.159274    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ndh6_5971a943-83fc-4fc6-8e13-02231e431039/bond-cni-plugin/0.log"
Jul 13 20:16:17.181316 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:17.181283    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ndh6_5971a943-83fc-4fc6-8e13-02231e431039/routeoverride-cni/0.log"
Jul 13 20:16:17.202344 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:17.202316    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ndh6_5971a943-83fc-4fc6-8e13-02231e431039/whereabouts-cni-bincopy/0.log"
Jul 13 20:16:17.223229 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:17.223199    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ndh6_5971a943-83fc-4fc6-8e13-02231e431039/whereabouts-cni/0.log"
Jul 13 20:16:17.451096 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:17.451021    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cf2jg_ab3fc703-f07d-4028-bb65-3f88fcee9a95/kube-multus/0.log"
Jul 13 20:16:17.576471 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:17.576441    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4lsrh_1a004020-e409-46a4-8bab-8e560b477812/network-metrics-daemon/0.log"
Jul 13 20:16:17.596203 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:17.596174    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4lsrh_1a004020-e409-46a4-8bab-8e560b477812/kube-rbac-proxy/0.log"
Jul 13 20:16:18.750006 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:18.749978    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhqhc_e06de7bc-83db-43e5-9ac2-aea07b78ca90/ovn-controller/0.log"
Jul 13 20:16:18.763720 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:18.763693    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhqhc_e06de7bc-83db-43e5-9ac2-aea07b78ca90/ovn-acl-logging/0.log"
Jul 13 20:16:18.785863 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:18.785835    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhqhc_e06de7bc-83db-43e5-9ac2-aea07b78ca90/kube-rbac-proxy-node/0.log"
Jul 13 20:16:18.802826 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:18.802776    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhqhc_e06de7bc-83db-43e5-9ac2-aea07b78ca90/kube-rbac-proxy-ovn-metrics/0.log"
Jul 13 20:16:18.816518 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:18.816489    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhqhc_e06de7bc-83db-43e5-9ac2-aea07b78ca90/northd/0.log"
Jul 13 20:16:18.833212 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:18.833188    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhqhc_e06de7bc-83db-43e5-9ac2-aea07b78ca90/nbdb/0.log"
Jul 13 20:16:18.852365 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:18.852340    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhqhc_e06de7bc-83db-43e5-9ac2-aea07b78ca90/sbdb/0.log"
Jul 13 20:16:18.909072 ip-10-0-143-201 kubenswrapper[2550]: I0713 20:16:18.909033    2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lhqhc_e06de7bc-83db-43e5-9ac2-aea07b78ca90/ovnkube-controller/0.log"