Jul 13 21:19:46.948843 ip-10-0-143-189 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 21:19:46.948852 ip-10-0-143-189 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 21:19:46.948859 ip-10-0-143-189 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 21:19:46.949069 ip-10-0-143-189 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 21:19:57.158860 ip-10-0-143-189 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 13 21:19:57.158879 ip-10-0-143-189 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2da3808cacda425baf536e831d8f6b10 --
Jul 13 21:21:34.766660 ip-10-0-143-189 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 21:21:35.235262 ip-10-0-143-189 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 21:21:35.235262 ip-10-0-143-189 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 21:21:35.235262 ip-10-0-143-189 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 21:21:35.235262 ip-10-0-143-189 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 21:21:35.235262 ip-10-0-143-189 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 21:21:35.235262 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.228164    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240799    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240825    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240831    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240840    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240846    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240851    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240855    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240859    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240863    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240867    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240871    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240875    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240884    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240887    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240891    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240895    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240899    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240902    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240910    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:21:35.249830 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240914    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240921    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240926    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240930    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240938    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240941    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240946    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240951    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240955    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240964    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240973    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240978    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240983    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240991    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.240996    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241000    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241004    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241009    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241016    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:21:35.369182 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241020    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:21:35.306415 ip-10-0-143-189 systemd[1]: Started Kubernetes Kubelet.
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241026    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241031    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241036    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241044    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241048    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241052    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241056    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241060    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241063    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241071    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241075    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241079    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241084    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241088    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241092    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241100    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241104    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241108    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:21:35.445127 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241111    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241116    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241120    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241128    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241132    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241136    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241139    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241143    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241146    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241154    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241158    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241162    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241166    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241169    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241172    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241180    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241184    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241188    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241192    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:21:35.450061 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241196    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241199    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241209    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241213    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241217    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241220    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241224    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241241    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241245    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241251    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241254    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241262    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241267    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241271    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241276    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241279    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241283    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241291    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241295    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241299    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:21:35.452979 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241303    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241307    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.241311    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242683    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242694    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242699    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242708    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242713    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242717    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242721    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242725    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242733    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242737    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242742    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242747    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242751    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242759    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242763    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242768    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242771    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:21:35.453855 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242787    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242792    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242796    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242800    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242804    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242808    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242816    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242820    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242824    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242828    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242836    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242840    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242844    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242848    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242852    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242855    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242863    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242868    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242873    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242876    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:21:35.454530 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242880    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242884    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242891    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242895    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242899    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242903    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242908    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242912    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242920    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242924    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242928    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242934    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242938    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242947    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242953    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242957    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242962    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242970    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242974    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:21:35.455175 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242978    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242982    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242986    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242989    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.242997    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243002    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243006    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243010    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243014    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243017    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243025    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243029    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243033    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243037    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243041    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243046    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243054    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243058    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243062    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243065    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:21:35.455842 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243069    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243073    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243076    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243080    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243085    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243088    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243093    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243100    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243105    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243110    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243114    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243119    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243122    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243125    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243128    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243130    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243133    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243140    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243144    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243148    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:21:35.456496 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243152    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243156    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243162    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243902    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243915    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243920    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243925    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243929    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243938    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243942    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243946    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243950    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243954    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243963    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243967    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243971    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243976    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243980    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243988    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243994    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:21:35.457125 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.243998    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244002    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244005    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244014    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244019    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244023    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244027    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244031    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244034    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244043    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244047    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244051    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244057    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244062    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244070    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244076    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244081    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244084    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244089    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244093    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:21:35.457790 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244097    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244101    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244105    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244113    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244121    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244125    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244128    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244136    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244141    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244145    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244148    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244152    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244161    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244165    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244170    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244174    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244178    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244181    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244189    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244194    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:21:35.461653 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244198    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244202    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244206    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244209    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244217    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244221    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244225    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244229    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244233    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244236    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244244    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244249    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244254    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244259    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244263    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244271    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244279    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244284    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244288    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:21:35.469240 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244291    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244299    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244302    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244306    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244310    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244314    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244318    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244326    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244330    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244352    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244357    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244362    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244368    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244376    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244381    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244385    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244391    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244395    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244403    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:21:35.472699 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244408    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244411    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244415    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.244419    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244533    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244544    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244555    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244561    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244575    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244580    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244588    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244599    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244603    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244608    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244613    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244622    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244628    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244633    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244637    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244641    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244651    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244656    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244662    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244666    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 21:21:35.473903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244675    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244681    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244687    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244693    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244702    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244707    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244712    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244717    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244721    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244730    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244735    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244740    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244746    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244755    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244760    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244765    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244769    2575 flags.go:64] FLAG: --enable-server="true"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244773    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244786    2575 flags.go:64] FLAG: --event-burst="100"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244791    2575 flags.go:64] FLAG: --event-qps="50"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244795    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244800    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244804    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244814    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 21:21:35.475295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244818    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244823    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244827    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244831    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244836    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244843    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244847    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244852    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244856    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244861    2575 flags.go:64] FLAG: --feature-gates=""
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244867    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244871    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244876    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244880    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244885    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244890    2575 flags.go:64] FLAG: --help="false"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244899    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-143-189.ec2.internal"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244904    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244909    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244913    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244918    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244926    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244932    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 21:21:35.476504 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244936    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244940    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244945    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244951    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244956    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244959    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244968    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244972    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244977    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244982    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244990    2575 flags.go:64] FLAG: --lock-file=""
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.244995    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245000    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245004    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245019    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245027    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245032    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245036    2575 flags.go:64] FLAG: --logging-format="text"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245045    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245050    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245055    2575 flags.go:64] FLAG: --manifest-url=""
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245059    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245065    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245074    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245080    2575 flags.go:64] FLAG: --max-pods="110"
Jul 13 21:21:35.477783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245085    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245089    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245098    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245102    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245107    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245113    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245117    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245134    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245139    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245143    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245153    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245158    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245167    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245171    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245179    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245184    2575 flags.go:64] FLAG: --port="10250"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245189    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245193    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ec9ae7e76a9e56f3"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245198    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245206    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245211    2575 flags.go:64] FLAG: --register-node="true"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245218    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245224    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245233    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 13 21:21:35.479063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245238    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245243    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245249    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245253    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245262    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245267    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245271    2575 flags.go:64] FLAG: --runonce="false"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245276    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245280    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245288    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245293    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245297    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245302    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245306    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245315    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245319    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245324    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245328    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245333    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245358    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245363    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245371    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245380    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245385    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245389    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 21:21:35.480743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245399    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245404    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245409    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245413    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245419    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245424    2575 flags.go:64] FLAG: --v="2"
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245430    2575 flags.go:64] FLAG: --version="false"
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245441    2575 flags.go:64] FLAG: --vmodule=""
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245447    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.245453    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245663    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245669    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245674    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245678    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245686    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245690    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245694    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245698    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245702    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245706    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245714    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245718    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:21:35.486680 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245722    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245725    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245729    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245733    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245743    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245749    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245754    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245758    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245766    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245771    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245775    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245780    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245783    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245792    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245798    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245803    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245806    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245810    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245822    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245827    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:21:35.487956 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245833    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245837    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245845    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245850    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245855    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245859    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245863    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245867    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245872    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245876    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245879    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245887    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245891    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245895    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245899    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245903    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245914    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245917    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245921    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:21:35.489043 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245925    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245929    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245933    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245940    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245944    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245949    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245953    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245963    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245967    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245974    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245978    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245982    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245987    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245991    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.245994    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246002    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246006    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246012    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246017    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246021    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:21:35.490738 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246029    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246033    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246037    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246041    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246045    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246048    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246056    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246061    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246064    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246070    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246074    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246081    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246086    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246090    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246094    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246098    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246106    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246111    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246115    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246121    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:21:35.491521 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246124    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246127    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246136    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246140    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246144    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246150    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246153    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.246161    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.247187    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.254257    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.254276    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.254291    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.254298    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254393    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254399    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:21:35.492086 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254402    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254405    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254408    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254411    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254414    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254418    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254420    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254423    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254426    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254428    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254431    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254433    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254436    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254439    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254442    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254446    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254449    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254452    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254455    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:21:35.492542 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254458    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254461    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254463    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254466    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254470    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254473    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254476    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254479    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254486    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254489    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254491    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254494    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254496    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254499    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254501    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254504    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254507    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254509    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254512    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254515    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:21:35.493089 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254518    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254520    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254523    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254525    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254528    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254530    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254533    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254535    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254538    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254540    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254543    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254545    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254548    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254550    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254553    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254555    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254558    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254561    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254564    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254566    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:21:35.493701 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254569    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254572    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254575    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254577    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254580    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254582    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254585    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254587    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254590    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254592    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254595    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254597    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254600    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254602    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254605    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254608    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254611    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254613    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254615    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254618    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:21:35.494282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254621    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254623    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254626    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254629    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254631    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254634    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254636    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254639    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254642    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254647    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254650    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254653    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254656    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254659    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254668    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254671    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254675    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:21:35.494858 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254679    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.254684    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254811    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254815    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254819    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254822    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254824    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254827    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254830    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254833    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254836    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254838    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254841    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254843    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254846    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 21:21:35.495363 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254849    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254852    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254854    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254857    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254859    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254862    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254864    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254867    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254870    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254873    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254876    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254879    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254881    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254884    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254886    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254890    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254892    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254895    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254898    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 21:21:35.495917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254900    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254903    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254905    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254908    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254910    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254913    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254915    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254918    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254920    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254924    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254927    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254929    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254932    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254935    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254937    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254940    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254942    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254945    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254947    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254950    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 21:21:35.496487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254952    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254955    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254957    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254962    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254965    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254967    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254970    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254973    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254975    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254979    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254981    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254984    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254986    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254989    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254992    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254994    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254997    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.254999    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255002    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255004    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 21:21:35.497064 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255007    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255010    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255012    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255015    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255018    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255020    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255023    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255025    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255028    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255032    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255038    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255040    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255043    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255046    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255049    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255054    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255058    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255061    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255064    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255067    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 21:21:35.497652 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255069    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255072    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255077    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255080    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255083    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255086    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:35.255089    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.255094    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.255253    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.257251    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.258615    2575 server.go:1019] "Starting client certificate rotation"
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.258716    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.258754    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 21:21:35.501026 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.261430    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 21:21:35.501866 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.264959    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 21:21:35.501866 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.277396    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 13 21:21:35.501866 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.280417    2575 log.go:25] "Validated CRI v1 image API"
Jul 13 21:21:35.501866 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.281348    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 21:21:35.501866 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.283748    2575 fs.go:135] Filesystem UUIDs: map[3da76fdc-adcc-4c6e-8ef2-0841cb9e404b:/dev/nvme0n1p4 64fd51fe-288b-4e5b-99ff-aec19fb81e07:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 13 21:21:35.501866 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.283764    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 21:21:35.501866 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.289110    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.289168    2575 manager.go:216] Machine: {Timestamp:2026-07-13 21:21:35.288661208 +0000 UTC m=+0.377941352 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3090821 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2179f583c10b72fefd5b9f895827c6 SystemUUID:ec2179f5-83c1-0b72-fefd-5b9f895827c6 BootID:2da3808c-acda-425b-af53-6e831d8f6b10 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c1:1b:6c:e4:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c1:1b:6c:e4:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:55:b3:1a:19:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.289299    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.289390    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.290485    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.290510    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.291122    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.291132    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.291140    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.291150    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.292388    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.295680    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.295820    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.295849    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.295858    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.295875    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.295885    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.295894    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 21:21:35.503140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.296315    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.296350    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.298522    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.300235    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.300263    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.300428    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.300440    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.300445    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.300451    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.300459    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.300465    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.301005    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.301011    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.301017    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.301022    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.301031    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.301038    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.301777    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.301785    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.305418    2575 server.go:1268] "Started kubelet"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.305864    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.305694    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.306123    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.307261    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.311886    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.312581    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.312602    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.313174    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.313571    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.313900    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-189.ec2.internal.18c1f6430fe5d0ac  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-189.ec2.internal,UID:ip-10-0-143-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-189.ec2.internal,},FirstTimestamp:2026-07-13 21:21:35.305388204 +0000 UTC m=+0.394668352,LastTimestamp:2026-07-13 21:21:35.305388204 +0000 UTC m=+0.394668352,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-189.ec2.internal,}"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.316808    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.317036    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.317217    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.317464    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.317750    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.317763    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.317865    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.317873    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.318093    2575 factory.go:55] Registering systemd factory
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.318131    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.318402    2575 factory.go:153] Registering CRI-O factory
Jul 13 21:21:35.505263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.318417    2575 factory.go:223] Registration of the crio container factory successfully
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.318476    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.318501    2575 factory.go:103] Registering Raw factory
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.318516    2575 manager.go:1196] Started watching for new ooms in manager
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.319022    2575 manager.go:349] Starting recovery of all containers
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.322648    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.322760    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.329916    2575 manager.go:354] Recovery completed
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.334903    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.336916    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.336950    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.336960    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.337199    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lj8dk"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.337518    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.337532    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.337549    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.337551    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.338289    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.338311    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.338324    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.338878    2575 policy_none.go:49] "None policy: Start"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.338892    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.338902    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.339360    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-189.ec2.internal.18c1f64311c731a5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-189.ec2.internal,UID:ip-10-0-143-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-189.ec2.internal,},FirstTimestamp:2026-07-13 21:21:35.336935845 +0000 UTC m=+0.426215995,LastTimestamp:2026-07-13 21:21:35.336935845 +0000 UTC m=+0.426215995,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-189.ec2.internal,}"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.339900    2575 policy_none.go:47] "Start"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.345453    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lj8dk"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.348878    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-189.ec2.internal.18c1f64311c77cfd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-189.ec2.internal,UID:ip-10-0-143-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-189.ec2.internal,},FirstTimestamp:2026-07-13 21:21:35.336955133 +0000 UTC m=+0.426235276,LastTimestamp:2026-07-13 21:21:35.336955133 +0000 UTC m=+0.426235276,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-189.ec2.internal,}"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.383401    2575 manager.go:337] "Starting Device Plugin manager"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.383433    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.383443    2575 server.go:87] "Starting device plugin registration server"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.383695    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.383705    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 21:21:35.507390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.383801    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.383870    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.383879    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.384326    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.384390    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.461049    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.462631    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.462669    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.462697    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.462738    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.465193    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.484023    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.484924    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.484949    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.484959    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.484982    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-189.ec2.internal"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.496762    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-189.ec2.internal"
Jul 13 21:21:35.509706 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.496787    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-189.ec2.internal\": node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.518889    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.563553    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal"]
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.563628    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.564594    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.564618    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.564627    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.565875    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.566268    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.566290    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.566958    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.566977    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.566988    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.568065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.568092    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.568209    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.568221    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.568229    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.568940    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.568955    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:21:35.616381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:35.568963    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:21:35.631758 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.619864    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:35.737377 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.720143    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:35.869932 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.820504    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:36.005439 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:35.920997    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:36.128360 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:36.021504    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:36.128360 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:36.121926    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:36.205245 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:36.205207    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-189.ec2.internal\" not found" node="ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.210380 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:36.210356    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-189.ec2.internal\" not found" node="ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.222262 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:36.222246    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:36.260401 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.260289    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 21:21:36.260832 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.260524    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 21:21:36.299874 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.299683    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1510e5818da91f39e4176b6a7f0e5fd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-189.ec2.internal\" (UID: \"d1510e5818da91f39e4176b6a7f0e5fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.299956 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.299881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f5ff4bad180cb7365cb5574079465eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"7f5ff4bad180cb7365cb5574079465eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.299956 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.299903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5ff4bad180cb7365cb5574079465eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"7f5ff4bad180cb7365cb5574079465eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.322331 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:36.322294    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:36.349615 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.349560    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 21:16:36 +0000 UTC" deadline="2028-03-02 16:21:08.472429223 +0000 UTC"
Jul 13 21:21:36.349615 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.349613    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14346h59m32.122820512s"
Jul 13 21:21:36.401167 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.401131    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f5ff4bad180cb7365cb5574079465eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"7f5ff4bad180cb7365cb5574079465eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.401167 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.401165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5ff4bad180cb7365cb5574079465eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"7f5ff4bad180cb7365cb5574079465eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.401346 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.401188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1510e5818da91f39e4176b6a7f0e5fd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-189.ec2.internal\" (UID: \"d1510e5818da91f39e4176b6a7f0e5fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.401346 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.401237    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d1510e5818da91f39e4176b6a7f0e5fd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-189.ec2.internal\" (UID: \"d1510e5818da91f39e4176b6a7f0e5fd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.401346 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.401269    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f5ff4bad180cb7365cb5574079465eb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"7f5ff4bad180cb7365cb5574079465eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.401346 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.401272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f5ff4bad180cb7365cb5574079465eb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal\" (UID: \"7f5ff4bad180cb7365cb5574079465eb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.423431 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:36.423393    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:36.423431 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.423405    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 21:21:36.424481 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.424461    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 21:21:36.424574 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.424492    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 21:21:36.424574 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.424503    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeHasSufficientPID"
Jul 13 21:21:36.507107 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.507062    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.513307 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.513286    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.523584 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:36.523565    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:36.584240 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.584212    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:21:36.624476 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:36.624436    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-189.ec2.internal\" not found"
Jul 13 21:21:36.662449 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.662416    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:21:36.708958 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.708935    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:21:36.717879 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.717851    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.728542 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.728516    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 21:21:36.729772 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.729755    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal"
Jul 13 21:21:36.741915 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:36.741891    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 21:21:37.217154 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.217092    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5ff4bad180cb7365cb5574079465eb.slice/crio-132d616b56c273ee95dde0bd19bf629ab81b96017ca3c4485e56a5a0e5410e10 WatchSource:0}: Error finding container 132d616b56c273ee95dde0bd19bf629ab81b96017ca3c4485e56a5a0e5410e10: Status 404 returned error can't find the container with id 132d616b56c273ee95dde0bd19bf629ab81b96017ca3c4485e56a5a0e5410e10
Jul 13 21:21:37.226026 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.226005    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:21:37.232090 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.232063    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1510e5818da91f39e4176b6a7f0e5fd.slice/crio-f69693219b6fb3eee1da87b67d83f547e9fb92e5e5d783fda15cd06d64ede2dc WatchSource:0}: Error finding container f69693219b6fb3eee1da87b67d83f547e9fb92e5e5d783fda15cd06d64ede2dc: Status 404 returned error can't find the container with id f69693219b6fb3eee1da87b67d83f547e9fb92e5e5d783fda15cd06d64ede2dc
Jul 13 21:21:37.299380 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.299326    2575 apiserver.go:52] "Watching apiserver"
Jul 13 21:21:37.309220 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.309193    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 21:21:37.310280 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.310257    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-s877s","openshift-image-registry/node-ca-ntbrp","openshift-multus/multus-8csz2","openshift-multus/network-metrics-daemon-hhrns","openshift-network-diagnostics/network-check-target-p45dw","kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal","openshift-cluster-node-tuning-operator/tuned-82pq7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal","openshift-multus/multus-additional-cni-plugins-ffh5n","openshift-network-operator/iptables-alerter-grgng","openshift-ovn-kubernetes/ovnkube-node-67fcq","kube-system/global-pull-secret-syncer-89tsm","kube-system/konnectivity-agent-qwqgw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"]
Jul 13 21:21:37.313204 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.313180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.315650 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.315633    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:21:37.316232 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.316211    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d87qc\""
Jul 13 21:21:37.316315 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.316219    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 21:21:37.316861 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.316843    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:21:37.318247 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.318214    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 21:21:37.318247 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.318234    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.319278 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.319261    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 21:21:37.319464 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.319450    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 21:21:37.320232 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.320139    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kc6n4\""
Jul 13 21:21:37.320568 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.320552    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:37.320651 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.320630    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:37.320906 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.320888    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 21:21:37.321785 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.321762    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 21:21:37.321877 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.321787    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 21:21:37.321938 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.321888    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 21:21:37.322601 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.322585    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xvhtb\""
Jul 13 21:21:37.323002 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.322989    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:37.323089 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.323050    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:37.325406 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.325387    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.327789 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.327767    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 21:21:37.327898 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.327875    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.328008 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.327991    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 21:21:37.328101 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.328077    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 21:21:37.328253 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.328237    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pwlld\""
Jul 13 21:21:37.330443 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.330403    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.330443 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.330419    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7qwxx\""
Jul 13 21:21:37.330790 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.330773    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 21:21:37.330840 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.330824    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 21:21:37.331404 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.331383    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 21:21:37.332774 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.332755    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.332871 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.332836    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p2drv\""
Jul 13 21:21:37.333239 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.333217    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 21:21:37.333443 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.333404    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 21:21:37.335180 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.335161    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.335522 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.335368    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zqmlc\""
Jul 13 21:21:37.335767 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.335742    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 21:21:37.335874 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.335802    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 21:21:37.335874 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.335815    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 21:21:37.337630 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.337615    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:21:37.337836 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.337800    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 21:21:37.337955 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.337892    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.338473 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.338426    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 21:21:37.338579 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.338563    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4k7nl\""
Jul 13 21:21:37.341684 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.341659    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 21:21:37.341804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.341722    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 21:21:37.342457 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.342321    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:37.342457 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.342409    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:37.342746 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.342722    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 21:21:37.342880 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.342865    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 21:21:37.342880 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.342879    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 21:21:37.343078 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.343062    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dmk62\""
Jul 13 21:21:37.343163 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.343143    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 21:21:37.357963 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.357942    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpbrh"
Jul 13 21:21:37.366240 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.366220    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpbrh"
Jul 13 21:21:37.418032 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.417997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48866136-7857-4f79-b780-79b899f0a01d-agent-certs\") pod \"konnectivity-agent-qwqgw\" (UID: \"48866136-7857-4f79-b780-79b899f0a01d\") " pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:21:37.418159 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-cni-dir\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418265 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418250    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-var-lib-cni-multus\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418303 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-conf-dir\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418303 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-kubernetes\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.418394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418306    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-run\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.418394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-sys\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.418394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418371    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-os-release\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418523 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418397    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-socket-dir-parent\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418523 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-run-k8s-cni-cncf-io\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418523 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-var-lib-cni-bin\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418523 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418465    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-var-lib-kubelet\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.418652 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-systemd\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.418652 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418582    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-host\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.418652 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418605    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-system-cni-dir\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418652 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-cni-binary-copy\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418822 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418666    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-var-lib-kubelet\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418822 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-daemon-config\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418822 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418727    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-etc-kubernetes\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.418822 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-sysconfig\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.418822 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44672\" (UniqueName: \"kubernetes.io/projected/3bf723a5-732d-4d81-976c-adb2ae375faa-kube-api-access-44672\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.419008 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-run-netns\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.419008 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-hostroot\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.419008 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf9l4\" (UniqueName: \"kubernetes.io/projected/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-kube-api-access-wf9l4\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.419008 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-sysctl-d\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.419008 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-sysctl-conf\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.419008 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-tuned\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.419008 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418984    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 21:21:37.419008 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.418991    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48866136-7857-4f79-b780-79b899f0a01d-konnectivity-ca\") pod \"konnectivity-agent-qwqgw\" (UID: \"48866136-7857-4f79-b780-79b899f0a01d\") " pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:21:37.419283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.419012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk8jq\" (UniqueName: \"kubernetes.io/projected/3b829c24-392e-4a3a-98fe-1c4003581195-kube-api-access-hk8jq\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:37.419283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.419029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-modprobe-d\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.419283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.419051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3bf723a5-732d-4d81-976c-adb2ae375faa-tmp\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.419283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.419068    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-cnibin\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.419283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.419083    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-run-multus-certs\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.419283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.419104    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:37.419283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.419122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-lib-modules\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.467694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.467643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" event={"ID":"d1510e5818da91f39e4176b6a7f0e5fd","Type":"ContainerStarted","Data":"f69693219b6fb3eee1da87b67d83f547e9fb92e5e5d783fda15cd06d64ede2dc"}
Jul 13 21:21:37.468654 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.468627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" event={"ID":"7f5ff4bad180cb7365cb5574079465eb","Type":"ContainerStarted","Data":"132d616b56c273ee95dde0bd19bf629ab81b96017ca3c4485e56a5a0e5410e10"}
Jul 13 21:21:37.520022 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.519981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-daemon-config\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.520022 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520027    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-kubelet\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.520286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520051    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-systemd-units\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.520286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-etc-openvswitch\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.520286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520105    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-run-ovn\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.520286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520136    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-device-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.520286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-run-netns\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.520286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-hostroot\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.520286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520217    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-run-netns\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.520286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd4xh\" (UniqueName: \"kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh\") pod \"network-check-target-p45dw\" (UID: \"8ba8c95d-e476-4508-b7ca-1f1b701fb55a\") " pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:37.520286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520273    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-hostroot\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.520286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520275    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-cnibin\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520313    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-os-release\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3f84f41-9272-4f07-951f-8e5451436d80-host\") pod \"node-ca-ntbrp\" (UID: \"a3f84f41-9272-4f07-951f-8e5451436d80\") " pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-log-socket\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-run-ovn-kubernetes\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520433    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-sys-fs\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-tuned\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520490    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk8jq\" (UniqueName: \"kubernetes.io/projected/3b829c24-392e-4a3a-98fe-1c4003581195-kube-api-access-hk8jq\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg9h6\" (UniqueName: \"kubernetes.io/projected/a3f84f41-9272-4f07-951f-8e5451436d80-kube-api-access-kg9h6\") pod \"node-ca-ntbrp\" (UID: \"a3f84f41-9272-4f07-951f-8e5451436d80\") " pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520594    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a03093-bfaf-40cd-b141-1bee13064cb6-env-overrides\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-modprobe-d\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520647    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-daemon-config\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520670    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3bf723a5-732d-4d81-976c-adb2ae375faa-tmp\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ts6j\" (UniqueName: \"kubernetes.io/projected/0664a41e-a61a-4e72-afc3-c1ceb93a87d6-kube-api-access-8ts6j\") pod \"iptables-alerter-grgng\" (UID: \"0664a41e-a61a-4e72-afc3-c1ceb93a87d6\") " pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520768    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-var-lib-openvswitch\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.520804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520826    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520833    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-modprobe-d\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520849    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8625f4f-5b24-408d-affe-221341f4f56a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.520853    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520877    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-lib-modules\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.520902    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48866136-7857-4f79-b780-79b899f0a01d-agent-certs\") pod \"konnectivity-agent-qwqgw\" (UID: \"48866136-7857-4f79-b780-79b899f0a01d\") " pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.520948    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs podName:3b829c24-392e-4a3a-98fe-1c4003581195 nodeName:}" failed. No retries permitted until 2026-07-13 21:21:38.020904063 +0000 UTC m=+3.110184216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs") pod "network-metrics-daemon-hhrns" (UID: "3b829c24-392e-4a3a-98fe-1c4003581195") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521013    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-cni-dir\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521040    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-conf-dir\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521049    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-lib-modules\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521061    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-run-openvswitch\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521112    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-conf-dir\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a03093-bfaf-40cd-b141-1bee13064cb6-ovnkube-config\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-kubelet-config\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-kubernetes\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521200    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-cni-dir\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.521576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521215    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-run\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-sys\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-var-lib-cni-bin\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-kubernetes\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521288    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0664a41e-a61a-4e72-afc3-c1ceb93a87d6-iptables-alerter-script\") pod \"iptables-alerter-grgng\" (UID: \"0664a41e-a61a-4e72-afc3-c1ceb93a87d6\") " pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521292    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-run\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-sys\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-socket-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521322    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-var-lib-cni-bin\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-system-cni-dir\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-var-lib-kubelet\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-run-netns\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521445    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-var-lib-kubelet\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-dbus\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521490    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521507    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-registration-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-system-cni-dir\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.522352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-cni-binary-copy\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521601    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-system-cni-dir\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521639    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-var-lib-kubelet\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-etc-kubernetes\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521688    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-sysconfig\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521714    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44672\" (UniqueName: \"kubernetes.io/projected/3bf723a5-732d-4d81-976c-adb2ae375faa-kube-api-access-44672\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf9l4\" (UniqueName: \"kubernetes.io/projected/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-kube-api-access-wf9l4\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521744    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-etc-kubernetes\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a03093-bfaf-40cd-b141-1bee13064cb6-ovnkube-script-lib\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp42c\" (UniqueName: \"kubernetes.io/projected/c3a03093-bfaf-40cd-b141-1bee13064cb6-kube-api-access-kp42c\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521792    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521796    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-var-lib-kubelet\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a096c9e-9916-4b64-8232-4c990125ce94-hosts-file\") pod \"node-resolver-s877s\" (UID: \"1a096c9e-9916-4b64-8232-4c990125ce94\") " pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a096c9e-9916-4b64-8232-4c990125ce94-tmp-dir\") pod \"node-resolver-s877s\" (UID: \"1a096c9e-9916-4b64-8232-4c990125ce94\") " pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-sysctl-d\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0664a41e-a61a-4e72-afc3-c1ceb93a87d6-host-slash\") pod \"iptables-alerter-grgng\" (UID: \"0664a41e-a61a-4e72-afc3-c1ceb93a87d6\") " pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521917    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9stvc\" (UniqueName: \"kubernetes.io/projected/1a096c9e-9916-4b64-8232-4c990125ce94-kube-api-access-9stvc\") pod \"node-resolver-s877s\" (UID: \"1a096c9e-9916-4b64-8232-4c990125ce94\") " pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.523241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-sysctl-conf\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.521973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48866136-7857-4f79-b780-79b899f0a01d-konnectivity-ca\") pod \"konnectivity-agent-qwqgw\" (UID: \"48866136-7857-4f79-b780-79b899f0a01d\") " pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522010    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-cni-binary-copy\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522015    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3f84f41-9272-4f07-951f-8e5451436d80-serviceca\") pod \"node-ca-ntbrp\" (UID: \"a3f84f41-9272-4f07-951f-8e5451436d80\") " pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522056    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-cni-netd\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522087    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-cnibin\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-run-multus-certs\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522137    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-run-systemd\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-sysctl-d\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-cni-bin\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522175    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-sysctl-conf\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522224    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-cnibin\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8625f4f-5b24-408d-affe-221341f4f56a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522263    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-sysconfig\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522273    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-run-multus-certs\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s4lx\" (UniqueName: \"kubernetes.io/projected/e8625f4f-5b24-408d-affe-221341f4f56a-kube-api-access-4s4lx\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.524083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-var-lib-cni-multus\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a03093-bfaf-40cd-b141-1bee13064cb6-ovn-node-metrics-cert\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522357    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-var-lib-cni-multus\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk76m\" (UniqueName: \"kubernetes.io/projected/6cd53a2d-aac8-451f-8a30-089ef1c16835-kube-api-access-zk76m\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-os-release\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522438    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-socket-dir-parent\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-run-k8s-cni-cncf-io\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522475    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-os-release\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-slash\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522536    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8625f4f-5b24-408d-affe-221341f4f56a-cni-binary-copy\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522580    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-multus-socket-dir-parent\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522574    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-host-run-k8s-cni-cncf-io\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522617    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/48866136-7857-4f79-b780-79b899f0a01d-konnectivity-ca\") pod \"konnectivity-agent-qwqgw\" (UID: \"48866136-7857-4f79-b780-79b899f0a01d\") " pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522627    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522668    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-node-log\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-systemd\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522759    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-systemd\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.524934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-host\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.525463 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.522891    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bf723a5-732d-4d81-976c-adb2ae375faa-host\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.525463 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.524998    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3bf723a5-732d-4d81-976c-adb2ae375faa-etc-tuned\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.525463 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.525056    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3bf723a5-732d-4d81-976c-adb2ae375faa-tmp\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.525463 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.525245    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/48866136-7857-4f79-b780-79b899f0a01d-agent-certs\") pod \"konnectivity-agent-qwqgw\" (UID: \"48866136-7857-4f79-b780-79b899f0a01d\") " pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:21:37.531560 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.531533    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk8jq\" (UniqueName: \"kubernetes.io/projected/3b829c24-392e-4a3a-98fe-1c4003581195-kube-api-access-hk8jq\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:37.532239 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.532213    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf9l4\" (UniqueName: \"kubernetes.io/projected/2cacd420-bb4e-4dbb-a012-7ccdf4f901b7-kube-api-access-wf9l4\") pod \"multus-8csz2\" (UID: \"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7\") " pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.532390 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.532370    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44672\" (UniqueName: \"kubernetes.io/projected/3bf723a5-732d-4d81-976c-adb2ae375faa-kube-api-access-44672\") pod \"tuned-82pq7\" (UID: \"3bf723a5-732d-4d81-976c-adb2ae375faa\") " pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.623288 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623181    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-82pq7"
Jul 13 21:21:37.623288 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623191    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a03093-bfaf-40cd-b141-1bee13064cb6-ovnkube-script-lib\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.623545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp42c\" (UniqueName: \"kubernetes.io/projected/c3a03093-bfaf-40cd-b141-1bee13064cb6-kube-api-access-kp42c\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.623545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.623545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a096c9e-9916-4b64-8232-4c990125ce94-hosts-file\") pod \"node-resolver-s877s\" (UID: \"1a096c9e-9916-4b64-8232-4c990125ce94\") " pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.623545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a096c9e-9916-4b64-8232-4c990125ce94-tmp-dir\") pod \"node-resolver-s877s\" (UID: \"1a096c9e-9916-4b64-8232-4c990125ce94\") " pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.623545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0664a41e-a61a-4e72-afc3-c1ceb93a87d6-host-slash\") pod \"iptables-alerter-grgng\" (UID: \"0664a41e-a61a-4e72-afc3-c1ceb93a87d6\") " pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.623545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623457    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9stvc\" (UniqueName: \"kubernetes.io/projected/1a096c9e-9916-4b64-8232-4c990125ce94-kube-api-access-9stvc\") pod \"node-resolver-s877s\" (UID: \"1a096c9e-9916-4b64-8232-4c990125ce94\") " pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.623545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3f84f41-9272-4f07-951f-8e5451436d80-serviceca\") pod \"node-ca-ntbrp\" (UID: \"a3f84f41-9272-4f07-951f-8e5451436d80\") " pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.623545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-cni-netd\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.623545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623510    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a096c9e-9916-4b64-8232-4c990125ce94-hosts-file\") pod \"node-resolver-s877s\" (UID: \"1a096c9e-9916-4b64-8232-4c990125ce94\") " pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.623545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623528    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-run-systemd\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623549    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-etc-selinux\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623565    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-run-systemd\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-cni-bin\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623604    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623630    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8625f4f-5b24-408d-affe-221341f4f56a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623649    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s4lx\" (UniqueName: \"kubernetes.io/projected/e8625f4f-5b24-408d-affe-221341f4f56a-kube-api-access-4s4lx\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623674    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a03093-bfaf-40cd-b141-1bee13064cb6-ovn-node-metrics-cert\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623691    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk76m\" (UniqueName: \"kubernetes.io/projected/6cd53a2d-aac8-451f-8a30-089ef1c16835-kube-api-access-zk76m\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623704    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-cni-bin\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623717    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-slash\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623743    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a096c9e-9916-4b64-8232-4c990125ce94-tmp-dir\") pod \"node-resolver-s877s\" (UID: \"1a096c9e-9916-4b64-8232-4c990125ce94\") " pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8625f4f-5b24-408d-affe-221341f4f56a-cni-binary-copy\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623804    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0664a41e-a61a-4e72-afc3-c1ceb93a87d6-host-slash\") pod \"iptables-alerter-grgng\" (UID: \"0664a41e-a61a-4e72-afc3-c1ceb93a87d6\") " pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623748    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-slash\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623896    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-node-log\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.624086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-node-log\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-kubelet\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623952    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3a03093-bfaf-40cd-b141-1bee13064cb6-ovnkube-script-lib\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-systemd-units\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.623996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-etc-openvswitch\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624012    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-run-ovn\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-device-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-cni-netd\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.624042    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4xh\" (UniqueName: \"kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh\") pod \"network-check-target-p45dw\" (UID: \"8ba8c95d-e476-4508-b7ca-1f1b701fb55a\") " pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624101    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-kubelet\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624110    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-cnibin\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-systemd-units\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624056    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a3f84f41-9272-4f07-951f-8e5451436d80-serviceca\") pod \"node-ca-ntbrp\" (UID: \"a3f84f41-9272-4f07-951f-8e5451436d80\") " pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.624126    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret podName:4e67ebcf-f921-48f9-a5e7-80e0012b81d9 nodeName:}" failed. No retries permitted until 2026-07-13 21:21:38.12410678 +0000 UTC m=+3.213386912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret") pod "global-pull-secret-syncer-89tsm" (UID: "4e67ebcf-f921-48f9-a5e7-80e0012b81d9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624160    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-run-ovn\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.625168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624168    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-device-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624198    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-etc-openvswitch\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624239    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-cnibin\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624251    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e8625f4f-5b24-408d-affe-221341f4f56a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-os-release\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3f84f41-9272-4f07-951f-8e5451436d80-host\") pod \"node-ca-ntbrp\" (UID: \"a3f84f41-9272-4f07-951f-8e5451436d80\") " pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-log-socket\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624372    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e8625f4f-5b24-408d-affe-221341f4f56a-cni-binary-copy\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-run-ovn-kubernetes\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-os-release\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-sys-fs\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624412    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3f84f41-9272-4f07-951f-8e5451436d80-host\") pod \"node-ca-ntbrp\" (UID: \"a3f84f41-9272-4f07-951f-8e5451436d80\") " pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624448    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-run-ovn-kubernetes\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624411    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-log-socket\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624461    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg9h6\" (UniqueName: \"kubernetes.io/projected/a3f84f41-9272-4f07-951f-8e5451436d80-kube-api-access-kg9h6\") pod \"node-ca-ntbrp\" (UID: \"a3f84f41-9272-4f07-951f-8e5451436d80\") " pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624476    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-sys-fs\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a03093-bfaf-40cd-b141-1bee13064cb6-env-overrides\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624533    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ts6j\" (UniqueName: \"kubernetes.io/projected/0664a41e-a61a-4e72-afc3-c1ceb93a87d6-kube-api-access-8ts6j\") pod \"iptables-alerter-grgng\" (UID: \"0664a41e-a61a-4e72-afc3-c1ceb93a87d6\") " pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-var-lib-openvswitch\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8625f4f-5b24-408d-affe-221341f4f56a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-run-openvswitch\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-var-lib-openvswitch\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a03093-bfaf-40cd-b141-1bee13064cb6-ovnkube-config\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-kubelet-config\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624705    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-run-openvswitch\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0664a41e-a61a-4e72-afc3-c1ceb93a87d6-iptables-alerter-script\") pod \"iptables-alerter-grgng\" (UID: \"0664a41e-a61a-4e72-afc3-c1ceb93a87d6\") " pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624762    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-socket-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-system-cni-dir\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624815    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-run-netns\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624840    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-dbus\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624865    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.626962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624891    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-registration-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624967    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e8625f4f-5b24-408d-affe-221341f4f56a-system-cni-dir\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-registration-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.624987    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3a03093-bfaf-40cd-b141-1bee13064cb6-env-overrides\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.625036    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-kubelet-config\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.625057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3a03093-bfaf-40cd-b141-1bee13064cb6-host-run-netns\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.625126    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-dbus\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.625134    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e8625f4f-5b24-408d-affe-221341f4f56a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.625165    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-socket-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.625177    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6cd53a2d-aac8-451f-8a30-089ef1c16835-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.625186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3a03093-bfaf-40cd-b141-1bee13064cb6-ovnkube-config\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.625590    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0664a41e-a61a-4e72-afc3-c1ceb93a87d6-iptables-alerter-script\") pod \"iptables-alerter-grgng\" (UID: \"0664a41e-a61a-4e72-afc3-c1ceb93a87d6\") " pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.627490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.627168    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3a03093-bfaf-40cd-b141-1bee13064cb6-ovn-node-metrics-cert\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.629835 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.629817    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:21:37.634088 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.634069    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:21:37.634146 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.634094    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:21:37.634146 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.634108    2575 projected.go:196] Error preparing data for projected volume kube-api-access-wd4xh for pod openshift-network-diagnostics/network-check-target-p45dw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:37.634282 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:37.634187    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh podName:8ba8c95d-e476-4508-b7ca-1f1b701fb55a nodeName:}" failed. No retries permitted until 2026-07-13 21:21:38.134166282 +0000 UTC m=+3.223446433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wd4xh" (UniqueName: "kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh") pod "network-check-target-p45dw" (UID: "8ba8c95d-e476-4508-b7ca-1f1b701fb55a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:37.634512 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.634415    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf723a5_732d_4d81_976c_adb2ae375faa.slice/crio-44ca0f24d0ffed65b3c1802ac84f9c256dbcf3a5b1a873ca49c41c1ba3c4789a WatchSource:0}: Error finding container 44ca0f24d0ffed65b3c1802ac84f9c256dbcf3a5b1a873ca49c41c1ba3c4789a: Status 404 returned error can't find the container with id 44ca0f24d0ffed65b3c1802ac84f9c256dbcf3a5b1a873ca49c41c1ba3c4789a
Jul 13 21:21:37.636777 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.636725    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg9h6\" (UniqueName: \"kubernetes.io/projected/a3f84f41-9272-4f07-951f-8e5451436d80-kube-api-access-kg9h6\") pod \"node-ca-ntbrp\" (UID: \"a3f84f41-9272-4f07-951f-8e5451436d80\") " pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.636954 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.636886    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9stvc\" (UniqueName: \"kubernetes.io/projected/1a096c9e-9916-4b64-8232-4c990125ce94-kube-api-access-9stvc\") pod \"node-resolver-s877s\" (UID: \"1a096c9e-9916-4b64-8232-4c990125ce94\") " pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.636954 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.636900    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ts6j\" (UniqueName: \"kubernetes.io/projected/0664a41e-a61a-4e72-afc3-c1ceb93a87d6-kube-api-access-8ts6j\") pod \"iptables-alerter-grgng\" (UID: \"0664a41e-a61a-4e72-afc3-c1ceb93a87d6\") " pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.637339 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.637319    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk76m\" (UniqueName: \"kubernetes.io/projected/6cd53a2d-aac8-451f-8a30-089ef1c16835-kube-api-access-zk76m\") pod \"aws-ebs-csi-driver-node-qxjfm\" (UID: \"6cd53a2d-aac8-451f-8a30-089ef1c16835\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.637450 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.637363    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s4lx\" (UniqueName: \"kubernetes.io/projected/e8625f4f-5b24-408d-affe-221341f4f56a-kube-api-access-4s4lx\") pod \"multus-additional-cni-plugins-ffh5n\" (UID: \"e8625f4f-5b24-408d-affe-221341f4f56a\") " pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.637759 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.637733    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp42c\" (UniqueName: \"kubernetes.io/projected/c3a03093-bfaf-40cd-b141-1bee13064cb6-kube-api-access-kp42c\") pod \"ovnkube-node-67fcq\" (UID: \"c3a03093-bfaf-40cd-b141-1bee13064cb6\") " pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.639005 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.638983    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8csz2"
Jul 13 21:21:37.640621 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.640599    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48866136_7857_4f79_b780_79b899f0a01d.slice/crio-eb140be707e9b95a1348d933f7ffa4714f06ec04d1393676b9610f99ad263ca8 WatchSource:0}: Error finding container eb140be707e9b95a1348d933f7ffa4714f06ec04d1393676b9610f99ad263ca8: Status 404 returned error can't find the container with id eb140be707e9b95a1348d933f7ffa4714f06ec04d1393676b9610f99ad263ca8
Jul 13 21:21:37.645903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.645881    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm"
Jul 13 21:21:37.648980 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.648958    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cacd420_bb4e_4dbb_a012_7ccdf4f901b7.slice/crio-9158fc6d5661aa06b0d6ef0c04f310bd0e284d4202afcf569a08ab2a6185e391 WatchSource:0}: Error finding container 9158fc6d5661aa06b0d6ef0c04f310bd0e284d4202afcf569a08ab2a6185e391: Status 404 returned error can't find the container with id 9158fc6d5661aa06b0d6ef0c04f310bd0e284d4202afcf569a08ab2a6185e391
Jul 13 21:21:37.652186 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.652169    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ffh5n"
Jul 13 21:21:37.652285 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.652190    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 21:21:37.656130 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.656109    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd53a2d_aac8_451f_8a30_089ef1c16835.slice/crio-7979f3d4aae663c32a29b7199c3e2041487fce2083be04c044f733cefc1c5b8c WatchSource:0}: Error finding container 7979f3d4aae663c32a29b7199c3e2041487fce2083be04c044f733cefc1c5b8c: Status 404 returned error can't find the container with id 7979f3d4aae663c32a29b7199c3e2041487fce2083be04c044f733cefc1c5b8c
Jul 13 21:21:37.657367 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.657347    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s877s"
Jul 13 21:21:37.663473 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.663448    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ntbrp"
Jul 13 21:21:37.664030 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.664006    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8625f4f_5b24_408d_affe_221341f4f56a.slice/crio-f799bdf14dd4035e9fca8bc5f535fe5d20e862a941280f9b7bc2a91445a35f75 WatchSource:0}: Error finding container f799bdf14dd4035e9fca8bc5f535fe5d20e862a941280f9b7bc2a91445a35f75: Status 404 returned error can't find the container with id f799bdf14dd4035e9fca8bc5f535fe5d20e862a941280f9b7bc2a91445a35f75
Jul 13 21:21:37.669646 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.669617    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-grgng"
Jul 13 21:21:37.669903 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.669880    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a096c9e_9916_4b64_8232_4c990125ce94.slice/crio-c8f261fd4efc779a80ebbf87270ad077381833a04784b25bd6c42f13de9d8733 WatchSource:0}: Error finding container c8f261fd4efc779a80ebbf87270ad077381833a04784b25bd6c42f13de9d8733: Status 404 returned error can't find the container with id c8f261fd4efc779a80ebbf87270ad077381833a04784b25bd6c42f13de9d8733
Jul 13 21:21:37.672868 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.672847    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f84f41_9272_4f07_951f_8e5451436d80.slice/crio-3e2f3d4417226fcfba6dee6c9faa5d535e638e53eb808afb5383a93393f15083 WatchSource:0}: Error finding container 3e2f3d4417226fcfba6dee6c9faa5d535e638e53eb808afb5383a93393f15083: Status 404 returned error can't find the container with id 3e2f3d4417226fcfba6dee6c9faa5d535e638e53eb808afb5383a93393f15083
Jul 13 21:21:37.674334 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:37.674320    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:21:37.679843 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.679817    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0664a41e_a61a_4e72_afc3_c1ceb93a87d6.slice/crio-4818612e89f7c901c88c2fa6ab8f45989aa8155e8fd1ac43736a758cf2c96cae WatchSource:0}: Error finding container 4818612e89f7c901c88c2fa6ab8f45989aa8155e8fd1ac43736a758cf2c96cae: Status 404 returned error can't find the container with id 4818612e89f7c901c88c2fa6ab8f45989aa8155e8fd1ac43736a758cf2c96cae
Jul 13 21:21:37.684235 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:21:37.684213    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a03093_bfaf_40cd_b141_1bee13064cb6.slice/crio-08c03af7317514685f5485ac62bd1dbc1980f0ba3012372ac4c289546bee0f6d WatchSource:0}: Error finding container 08c03af7317514685f5485ac62bd1dbc1980f0ba3012372ac4c289546bee0f6d: Status 404 returned error can't find the container with id 08c03af7317514685f5485ac62bd1dbc1980f0ba3012372ac4c289546bee0f6d
Jul 13 21:21:38.029434 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.029327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:38.029619 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:38.029521    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:38.029692 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:38.029623    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs podName:3b829c24-392e-4a3a-98fe-1c4003581195 nodeName:}" failed. No retries permitted until 2026-07-13 21:21:39.029599045 +0000 UTC m=+4.118879183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs") pod "network-metrics-daemon-hhrns" (UID: "3b829c24-392e-4a3a-98fe-1c4003581195") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:38.130202 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.130161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:38.130411 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:38.130327    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:38.130496 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:38.130443    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret podName:4e67ebcf-f921-48f9-a5e7-80e0012b81d9 nodeName:}" failed. No retries permitted until 2026-07-13 21:21:39.130406199 +0000 UTC m=+4.219686358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret") pod "global-pull-secret-syncer-89tsm" (UID: "4e67ebcf-f921-48f9-a5e7-80e0012b81d9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:38.231317 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.231264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4xh\" (UniqueName: \"kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh\") pod \"network-check-target-p45dw\" (UID: \"8ba8c95d-e476-4508-b7ca-1f1b701fb55a\") " pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:38.231711 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:38.231534    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:21:38.231711 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:38.231566    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:21:38.231711 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:38.231580    2575 projected.go:196] Error preparing data for projected volume kube-api-access-wd4xh for pod openshift-network-diagnostics/network-check-target-p45dw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:38.231711 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:38.231651    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh podName:8ba8c95d-e476-4508-b7ca-1f1b701fb55a nodeName:}" failed. No retries permitted until 2026-07-13 21:21:39.231630194 +0000 UTC m=+4.320910348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd4xh" (UniqueName: "kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh") pod "network-check-target-p45dw" (UID: "8ba8c95d-e476-4508-b7ca-1f1b701fb55a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:38.370561 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.369692    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 21:16:38 +0000 UTC" deadline="2028-03-12 19:32:00.917426128 +0000 UTC"
Jul 13 21:21:38.370561 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.369758    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14590h10m22.547672062s"
Jul 13 21:21:38.464924 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.463958    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:38.464924 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:38.464116    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:38.496077 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.496022    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" event={"ID":"c3a03093-bfaf-40cd-b141-1bee13064cb6","Type":"ContainerStarted","Data":"08c03af7317514685f5485ac62bd1dbc1980f0ba3012372ac4c289546bee0f6d"}
Jul 13 21:21:38.509160 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.509097    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s877s" event={"ID":"1a096c9e-9916-4b64-8232-4c990125ce94","Type":"ContainerStarted","Data":"c8f261fd4efc779a80ebbf87270ad077381833a04784b25bd6c42f13de9d8733"}
Jul 13 21:21:38.528100 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.527982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffh5n" event={"ID":"e8625f4f-5b24-408d-affe-221341f4f56a","Type":"ContainerStarted","Data":"f799bdf14dd4035e9fca8bc5f535fe5d20e862a941280f9b7bc2a91445a35f75"}
Jul 13 21:21:38.536213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.536124    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8csz2" event={"ID":"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7","Type":"ContainerStarted","Data":"9158fc6d5661aa06b0d6ef0c04f310bd0e284d4202afcf569a08ab2a6185e391"}
Jul 13 21:21:38.547918 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.547875    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qwqgw" event={"ID":"48866136-7857-4f79-b780-79b899f0a01d","Type":"ContainerStarted","Data":"eb140be707e9b95a1348d933f7ffa4714f06ec04d1393676b9610f99ad263ca8"}
Jul 13 21:21:38.554616 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.554568    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82pq7" event={"ID":"3bf723a5-732d-4d81-976c-adb2ae375faa","Type":"ContainerStarted","Data":"44ca0f24d0ffed65b3c1802ac84f9c256dbcf3a5b1a873ca49c41c1ba3c4789a"}
Jul 13 21:21:38.569247 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.568904    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-grgng" event={"ID":"0664a41e-a61a-4e72-afc3-c1ceb93a87d6","Type":"ContainerStarted","Data":"4818612e89f7c901c88c2fa6ab8f45989aa8155e8fd1ac43736a758cf2c96cae"}
Jul 13 21:21:38.576877 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.576794    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ntbrp" event={"ID":"a3f84f41-9272-4f07-951f-8e5451436d80","Type":"ContainerStarted","Data":"3e2f3d4417226fcfba6dee6c9faa5d535e638e53eb808afb5383a93393f15083"}
Jul 13 21:21:38.592828 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:38.592703    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm" event={"ID":"6cd53a2d-aac8-451f-8a30-089ef1c16835","Type":"ContainerStarted","Data":"7979f3d4aae663c32a29b7199c3e2041487fce2083be04c044f733cefc1c5b8c"}
Jul 13 21:21:39.039812 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:39.039719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:39.040013 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:39.039971    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:39.040098 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:39.040045    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs podName:3b829c24-392e-4a3a-98fe-1c4003581195 nodeName:}" failed. No retries permitted until 2026-07-13 21:21:41.040022549 +0000 UTC m=+6.129302694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs") pod "network-metrics-daemon-hhrns" (UID: "3b829c24-392e-4a3a-98fe-1c4003581195") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:39.141674 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:39.140977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:39.141674 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:39.141217    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:39.141674 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:39.141283    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret podName:4e67ebcf-f921-48f9-a5e7-80e0012b81d9 nodeName:}" failed. No retries permitted until 2026-07-13 21:21:41.141263279 +0000 UTC m=+6.230543416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret") pod "global-pull-secret-syncer-89tsm" (UID: "4e67ebcf-f921-48f9-a5e7-80e0012b81d9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:39.242086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:39.241414    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4xh\" (UniqueName: \"kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh\") pod \"network-check-target-p45dw\" (UID: \"8ba8c95d-e476-4508-b7ca-1f1b701fb55a\") " pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:39.242086 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:39.241633    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:21:39.242086 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:39.241655    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:21:39.242086 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:39.241669    2575 projected.go:196] Error preparing data for projected volume kube-api-access-wd4xh for pod openshift-network-diagnostics/network-check-target-p45dw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:39.242086 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:39.241728    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh podName:8ba8c95d-e476-4508-b7ca-1f1b701fb55a nodeName:}" failed. No retries permitted until 2026-07-13 21:21:41.241708502 +0000 UTC m=+6.330988651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd4xh" (UniqueName: "kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh") pod "network-check-target-p45dw" (UID: "8ba8c95d-e476-4508-b7ca-1f1b701fb55a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:39.370956 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:39.370849    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 21:16:38 +0000 UTC" deadline="2028-04-19 12:40:04.14756413 +0000 UTC"
Jul 13 21:21:39.370956 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:39.370896    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15495h18m24.776673846s"
Jul 13 21:21:39.466034 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:39.466002    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:39.466234 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:39.466133    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:39.466595 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:39.466575    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:39.466711 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:39.466682    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:40.464479 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:40.463905    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:40.464479 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:40.464058    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:41.062756 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:41.062718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:41.062962 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:41.062895    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:41.063028 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:41.062966    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs podName:3b829c24-392e-4a3a-98fe-1c4003581195 nodeName:}" failed. No retries permitted until 2026-07-13 21:21:45.062943574 +0000 UTC m=+10.152223720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs") pod "network-metrics-daemon-hhrns" (UID: "3b829c24-392e-4a3a-98fe-1c4003581195") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:41.164399 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:41.163641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:41.164399 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:41.163938    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:41.164399 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:41.164010    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret podName:4e67ebcf-f921-48f9-a5e7-80e0012b81d9 nodeName:}" failed. No retries permitted until 2026-07-13 21:21:45.163990701 +0000 UTC m=+10.253270851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret") pod "global-pull-secret-syncer-89tsm" (UID: "4e67ebcf-f921-48f9-a5e7-80e0012b81d9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:41.264517 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:41.264474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4xh\" (UniqueName: \"kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh\") pod \"network-check-target-p45dw\" (UID: \"8ba8c95d-e476-4508-b7ca-1f1b701fb55a\") " pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:41.264696 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:41.264677    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:21:41.264761 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:41.264700    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:21:41.264761 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:41.264715    2575 projected.go:196] Error preparing data for projected volume kube-api-access-wd4xh for pod openshift-network-diagnostics/network-check-target-p45dw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:41.264889 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:41.264779    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh podName:8ba8c95d-e476-4508-b7ca-1f1b701fb55a nodeName:}" failed. No retries permitted until 2026-07-13 21:21:45.264758279 +0000 UTC m=+10.354038427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd4xh" (UniqueName: "kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh") pod "network-check-target-p45dw" (UID: "8ba8c95d-e476-4508-b7ca-1f1b701fb55a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:41.463783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:41.463694    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:41.463946 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:41.463854    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:41.464183 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:41.464159    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:41.464297 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:41.464274    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:42.463739 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:42.463701    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:42.464228 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:42.463869    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:43.463101 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:43.463065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:43.463303 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:43.463065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:43.463303 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:43.463223    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:43.463465 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:43.463322    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:44.464142 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:44.463467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:44.464142 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:44.463633    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:45.098317 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:45.098268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:45.098552 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:45.098480    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:45.098635 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:45.098576    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs podName:3b829c24-392e-4a3a-98fe-1c4003581195 nodeName:}" failed. No retries permitted until 2026-07-13 21:21:53.098551855 +0000 UTC m=+18.187832002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs") pod "network-metrics-daemon-hhrns" (UID: "3b829c24-392e-4a3a-98fe-1c4003581195") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:45.198948 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:45.198911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:45.199153 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:45.199087    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:45.199218 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:45.199177    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret podName:4e67ebcf-f921-48f9-a5e7-80e0012b81d9 nodeName:}" failed. No retries permitted until 2026-07-13 21:21:53.199153187 +0000 UTC m=+18.288433334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret") pod "global-pull-secret-syncer-89tsm" (UID: "4e67ebcf-f921-48f9-a5e7-80e0012b81d9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:45.299351 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:45.299303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4xh\" (UniqueName: \"kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh\") pod \"network-check-target-p45dw\" (UID: \"8ba8c95d-e476-4508-b7ca-1f1b701fb55a\") " pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:45.299554 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:45.299520    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:21:45.299554 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:45.299554    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:21:45.299715 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:45.299567    2575 projected.go:196] Error preparing data for projected volume kube-api-access-wd4xh for pod openshift-network-diagnostics/network-check-target-p45dw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:45.299715 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:45.299646    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh podName:8ba8c95d-e476-4508-b7ca-1f1b701fb55a nodeName:}" failed. No retries permitted until 2026-07-13 21:21:53.299623366 +0000 UTC m=+18.388903522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd4xh" (UniqueName: "kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh") pod "network-check-target-p45dw" (UID: "8ba8c95d-e476-4508-b7ca-1f1b701fb55a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:45.464625 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:45.464087    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:45.464625 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:45.464202    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:45.464625 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:45.464359    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:45.464625 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:45.464481    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:46.463449 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:46.463411    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:46.463658 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:46.463581    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:47.463297 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:47.463224    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:47.463825 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:47.463379    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:47.463825 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:47.463390    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:47.463825 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:47.463507    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:48.463598 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:48.463548    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:48.464067 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:48.463722    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:49.463291 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:49.463250    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:49.463291 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:49.463291    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:49.463519 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:49.463407    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:49.463572 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:49.463542    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:50.463189 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:50.463116    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:50.463611 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:50.463243    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:51.463274 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:51.463217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:51.463737 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:51.463283    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:51.463737 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:51.463385    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:51.463737 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:51.463441    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:52.463610 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:52.463562    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:52.464059 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:52.463707    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:53.161738 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:53.161683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:53.161976 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:53.161862    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:53.161976 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:53.161944    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs podName:3b829c24-392e-4a3a-98fe-1c4003581195 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:09.161922294 +0000 UTC m=+34.251202429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs") pod "network-metrics-daemon-hhrns" (UID: "3b829c24-392e-4a3a-98fe-1c4003581195") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:21:53.262944 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:53.262895    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:53.263138 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:53.263059    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:53.263201 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:53.263145    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret podName:4e67ebcf-f921-48f9-a5e7-80e0012b81d9 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:09.263123327 +0000 UTC m=+34.352403478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret") pod "global-pull-secret-syncer-89tsm" (UID: "4e67ebcf-f921-48f9-a5e7-80e0012b81d9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:21:53.363724 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:53.363681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4xh\" (UniqueName: \"kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh\") pod \"network-check-target-p45dw\" (UID: \"8ba8c95d-e476-4508-b7ca-1f1b701fb55a\") " pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:53.363915 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:53.363876    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:21:53.363915 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:53.363908    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:21:53.364032 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:53.363922    2575 projected.go:196] Error preparing data for projected volume kube-api-access-wd4xh for pod openshift-network-diagnostics/network-check-target-p45dw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:53.364032 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:53.363974    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh podName:8ba8c95d-e476-4508-b7ca-1f1b701fb55a nodeName:}" failed. No retries permitted until 2026-07-13 21:22:09.363960859 +0000 UTC m=+34.453241007 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd4xh" (UniqueName: "kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh") pod "network-check-target-p45dw" (UID: "8ba8c95d-e476-4508-b7ca-1f1b701fb55a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:21:53.463177 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:53.463097    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:53.463358 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:53.463097    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:53.463358 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:53.463236    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:53.463358 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:53.463313    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:54.463903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:54.463862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:54.464393 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:54.463981    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:55.464645 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:55.464602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:55.465033 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:55.464724    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:55.465033 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:55.464810    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:55.465033 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:55.464907    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:56.463074 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:56.463033    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:56.463251 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:56.463160    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:57.463140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:57.463103    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:57.463612 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:57.463278    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:57.463612 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:57.463313    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:57.463612 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:57.463412    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:58.463694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:58.463530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:21:58.463969 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:58.463787    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:21:58.649241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:58.649211    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" event={"ID":"d1510e5818da91f39e4176b6a7f0e5fd","Type":"ContainerStarted","Data":"89e5fe795e46bb25881de710fa972f8ae41c3b2a6ba7ebce8a0ecc4241a81f04"}
Jul 13 21:21:58.663517 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:58.663472    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-189.ec2.internal" podStartSLOduration=21.663457608 podStartE2EDuration="21.663457608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:21:58.663034524 +0000 UTC m=+23.752314679" watchObservedRunningTime="2026-07-13 21:21:58.663457608 +0000 UTC m=+23.752737760"
Jul 13 21:21:59.463914 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.463524    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:21:59.464542 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.463576    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:21:59.464542 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:59.464040    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:21:59.464542 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:21:59.464097    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:21:59.654440 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.654378    2575 generic.go:356] "Generic (PLEG): container finished" podID="e8625f4f-5b24-408d-affe-221341f4f56a" containerID="033e96cd0585615ab35b33c1c5f6b95dd1caf9e4e0a8aaec732ea8493475fc1a" exitCode=0
Jul 13 21:21:59.654629 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.654475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffh5n" event={"ID":"e8625f4f-5b24-408d-affe-221341f4f56a","Type":"ContainerDied","Data":"033e96cd0585615ab35b33c1c5f6b95dd1caf9e4e0a8aaec732ea8493475fc1a"}
Jul 13 21:21:59.656288 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.656262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8csz2" event={"ID":"2cacd420-bb4e-4dbb-a012-7ccdf4f901b7","Type":"ContainerStarted","Data":"e3987438b00e5ca7399b66f4fc43593a55702d2900bc526d9696d296512da43c"}
Jul 13 21:21:59.657926 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.657861    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qwqgw" event={"ID":"48866136-7857-4f79-b780-79b899f0a01d","Type":"ContainerStarted","Data":"e55917e0d89b72523ba170cdd60dba06b840464f24e1e42be2954c30be11e127"}
Jul 13 21:21:59.659748 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.659697    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-82pq7" event={"ID":"3bf723a5-732d-4d81-976c-adb2ae375faa","Type":"ContainerStarted","Data":"50924a5636a13e7a10fb3c9465d11c7db05acf23b921e43d92d5cb7307bb068f"}
Jul 13 21:21:59.661881 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.661859    2575 generic.go:356] "Generic (PLEG): container finished" podID="7f5ff4bad180cb7365cb5574079465eb" containerID="1986546ad5b8936f4b5a29e4f5d8d8ecfb0cc1ff1713789769123ad2ee5acc98" exitCode=0
Jul 13 21:21:59.661977 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.661934    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" event={"ID":"7f5ff4bad180cb7365cb5574079465eb","Type":"ContainerDied","Data":"1986546ad5b8936f4b5a29e4f5d8d8ecfb0cc1ff1713789769123ad2ee5acc98"}
Jul 13 21:21:59.664446 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.663698    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ntbrp" event={"ID":"a3f84f41-9272-4f07-951f-8e5451436d80","Type":"ContainerStarted","Data":"d879a33cf9efe310c1b2c66996ce1b684b102ea43f755b683dcde666bf21624f"}
Jul 13 21:21:59.665647 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.665624    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm" event={"ID":"6cd53a2d-aac8-451f-8a30-089ef1c16835","Type":"ContainerStarted","Data":"916457ff2a724b7bbdf359b7233474bbbd6d770abd5c0465ab04d7b3bc56a21f"}
Jul 13 21:21:59.669106 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.669088    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:21:59.669525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.669505    2575 generic.go:356] "Generic (PLEG): container finished" podID="c3a03093-bfaf-40cd-b141-1bee13064cb6" containerID="2d02d38c8e6ff8f8ff4424d783aa3335c78e6bb1898f05916b3bcad57070131f" exitCode=1
Jul 13 21:21:59.669594 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.669574    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" event={"ID":"c3a03093-bfaf-40cd-b141-1bee13064cb6","Type":"ContainerStarted","Data":"d92776e8bb0f95c699d84709401310b35886fc281ab67759c4da5c4bf8aa4a90"}
Jul 13 21:21:59.669676 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.669643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" event={"ID":"c3a03093-bfaf-40cd-b141-1bee13064cb6","Type":"ContainerStarted","Data":"61cc4c2ddba5835c6325807af9eb98a833331eb74352abd67ae7e470adbc4876"}
Jul 13 21:21:59.669752 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.669694    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" event={"ID":"c3a03093-bfaf-40cd-b141-1bee13064cb6","Type":"ContainerStarted","Data":"c625b1cbe32b8d41bffabaea2fe6602c883c6ffaeadb37987ee28ed1e9c837a4"}
Jul 13 21:21:59.669804 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.669756    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" event={"ID":"c3a03093-bfaf-40cd-b141-1bee13064cb6","Type":"ContainerStarted","Data":"a44f96105e84b6ec706bdbf00e5971fde5cb7c0b4fe3359df812a3ece722492b"}
Jul 13 21:21:59.669858 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.669806    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" event={"ID":"c3a03093-bfaf-40cd-b141-1bee13064cb6","Type":"ContainerDied","Data":"2d02d38c8e6ff8f8ff4424d783aa3335c78e6bb1898f05916b3bcad57070131f"}
Jul 13 21:21:59.669858 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.669853    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" event={"ID":"c3a03093-bfaf-40cd-b141-1bee13064cb6","Type":"ContainerStarted","Data":"30247b62b37dac19c5d7cf25bc310b43c6101c13d18148bcfa820abbd4d4ba39"}
Jul 13 21:21:59.671184 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.671161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s877s" event={"ID":"1a096c9e-9916-4b64-8232-4c990125ce94","Type":"ContainerStarted","Data":"0f3cd20d78d2a43b197fe1b7021bf9a7a449eed0e061112cb46d1ccd61ff7cf2"}
Jul 13 21:21:59.707940 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.707876    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qwqgw" podStartSLOduration=2.9066193399999998 podStartE2EDuration="23.70785296s" totalImagesPullingTime="20.80123362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:21:59.691598224 +0000 UTC m=+24.780878379" watchObservedRunningTime="2026-07-13 21:21:59.70785296 +0000 UTC m=+24.797133114"
Jul 13 21:21:59.721182 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.721128    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s877s" podStartSLOduration=2.970326087 podStartE2EDuration="23.721105951s" totalImagesPullingTime="20.750779864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:21:59.720715745 +0000 UTC m=+24.809995923" watchObservedRunningTime="2026-07-13 21:21:59.721105951 +0000 UTC m=+24.810386106"
Jul 13 21:21:59.721364 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.721276    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8csz2" podStartSLOduration=2.916008364 podStartE2EDuration="23.721268525s" totalImagesPullingTime="20.805260161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:21:59.707373767 +0000 UTC m=+24.796653921" watchObservedRunningTime="2026-07-13 21:21:59.721268525 +0000 UTC m=+24.810548679"
Jul 13 21:21:59.752195 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.752134    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-82pq7" podStartSLOduration=2.946666592 podStartE2EDuration="23.752112198s" totalImagesPullingTime="20.805445606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:21:59.752095984 +0000 UTC m=+24.841376139" watchObservedRunningTime="2026-07-13 21:21:59.752112198 +0000 UTC m=+24.841392353"
Jul 13 21:21:59.769222 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:21:59.768495    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ntbrp" podStartSLOduration=3.020303905 podStartE2EDuration="23.768473391s" totalImagesPullingTime="20.748169486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:21:59.767750045 +0000 UTC m=+24.857030202" watchObservedRunningTime="2026-07-13 21:21:59.768473391 +0000 UTC m=+24.857753545"
Jul 13 21:22:00.463156 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:00.463096    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:00.463428 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:00.463297    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:22:00.536389 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:00.536301    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 21:22:00.676171 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:00.676091    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" event={"ID":"7f5ff4bad180cb7365cb5574079465eb","Type":"ContainerStarted","Data":"c8d8e2c36b0b3ae86dd66640f03eddf0d3a50d4575136134eccdb1ed35b73027"}
Jul 13 21:22:00.677788 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:00.677712    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-grgng" event={"ID":"0664a41e-a61a-4e72-afc3-c1ceb93a87d6","Type":"ContainerStarted","Data":"f5090f798bd26c3283afd1088a2373815cd766385d7f878dd6ff018acec95b96"}
Jul 13 21:22:00.679713 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:00.679654    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm" event={"ID":"6cd53a2d-aac8-451f-8a30-089ef1c16835","Type":"ContainerStarted","Data":"eef0fa92742659a63cdbad0192f526ebf1e08ac32b5843228abd2e4f5c4f1d9e"}
Jul 13 21:22:00.696267 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:00.696215    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-189.ec2.internal" podStartSLOduration=23.696197163 podStartE2EDuration="23.696197163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:00.696109077 +0000 UTC m=+25.785389230" watchObservedRunningTime="2026-07-13 21:22:00.696197163 +0000 UTC m=+25.785477317"
Jul 13 21:22:00.711591 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:00.711524    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-grgng" podStartSLOduration=3.97113281 podStartE2EDuration="24.711505356s" totalImagesPullingTime="20.740372546s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:00.711008201 +0000 UTC m=+25.800288373" watchObservedRunningTime="2026-07-13 21:22:00.711505356 +0000 UTC m=+25.800785508"
Jul 13 21:22:01.397886 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:01.397779    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T21:22:00.536321833Z","UUID":"7cbee85f-16b4-4afa-bc44-81567b3f0cf2","Handler":null,"Name":"","Endpoint":""}
Jul 13 21:22:01.399468 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:01.399448    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 21:22:01.399594 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:01.399486    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 21:22:01.463674 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:01.463631    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:01.463884 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:01.463631    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:01.463884 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:01.463781    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:22:01.463884 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:01.463849    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:22:02.463929 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:02.463898    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:02.464444 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:02.464069    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:22:02.686118 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:02.686080    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm" event={"ID":"6cd53a2d-aac8-451f-8a30-089ef1c16835","Type":"ContainerStarted","Data":"8e4c936198602f49ffe1eb0aef8f0d020828f072dfdeeaf1a4dafd89213f64fd"}
Jul 13 21:22:02.688895 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:02.688873    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:22:02.689192 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:02.689172    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" event={"ID":"c3a03093-bfaf-40cd-b141-1bee13064cb6","Type":"ContainerStarted","Data":"f25d13de88b5edb36d0fb3c964f18ddecde80c981ef06710a32e4c5a97c82fee"}
Jul 13 21:22:02.704210 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:02.704164    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qxjfm" podStartSLOduration=3.041971641 podStartE2EDuration="26.704148508s" totalImagesPullingTime="23.662176867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:02.702446237 +0000 UTC m=+27.791726390" watchObservedRunningTime="2026-07-13 21:22:02.704148508 +0000 UTC m=+27.793428660"
Jul 13 21:22:03.463579 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:03.463357    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:03.463773 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:03.463395    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:03.463773 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:03.463682    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:22:03.463773 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:03.463722    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:22:03.923151 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:03.923113    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:22:03.923792 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:03.923771    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:22:04.462921 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.462882    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:04.463100 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:04.463002    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:22:04.697171 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.696995    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:22:04.697570 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.697547    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" event={"ID":"c3a03093-bfaf-40cd-b141-1bee13064cb6","Type":"ContainerStarted","Data":"14e61308ef7d548c708af7986ccab74377f6edc7ad0f14732e302f401dbc0c31"}
Jul 13 21:22:04.698047 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.697827    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:22:04.698047 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.698042    2575 scope.go:117] "RemoveContainer" containerID="2d02d38c8e6ff8f8ff4424d783aa3335c78e6bb1898f05916b3bcad57070131f"
Jul 13 21:22:04.699530 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.699502    2575 generic.go:356] "Generic (PLEG): container finished" podID="e8625f4f-5b24-408d-affe-221341f4f56a" containerID="ca80bc96869309df776f225b88742065020c6357232c482ed3504d044f6de183" exitCode=0
Jul 13 21:22:04.699613 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.699581    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffh5n" event={"ID":"e8625f4f-5b24-408d-affe-221341f4f56a","Type":"ContainerDied","Data":"ca80bc96869309df776f225b88742065020c6357232c482ed3504d044f6de183"}
Jul 13 21:22:04.699751 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.699735    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:22:04.700227 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.700206    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qwqgw"
Jul 13 21:22:04.714142 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.714119    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:22:04.746950 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:04.746926    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:22:05.464193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:05.464157    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:05.464915 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:05.464318    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:22:05.464915 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:05.464356    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:05.464915 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:05.464412    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:22:05.706078 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:05.706052    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:22:05.706562 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:05.706534    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" event={"ID":"c3a03093-bfaf-40cd-b141-1bee13064cb6","Type":"ContainerStarted","Data":"b2c6e244344171146760ee4f35ce6d05076c52c5fc3e96103924bbb98e98034b"}
Jul 13 21:22:05.706700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:05.706610    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:22:05.722465 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:05.722404    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:22:05.735400 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:05.735323    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq" podStartSLOduration=8.619795403 podStartE2EDuration="29.735302667s" totalImagesPullingTime="21.115507264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:05.733277213 +0000 UTC m=+30.822557385" watchObservedRunningTime="2026-07-13 21:22:05.735302667 +0000 UTC m=+30.824582823"
Jul 13 21:22:06.463801 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:06.463714    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:06.463974 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:06.463840    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:22:06.555543 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:06.555513    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-89tsm"]
Jul 13 21:22:06.556006 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:06.555633    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:06.556006 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:06.555726    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:22:06.559435 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:06.559408    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p45dw"]
Jul 13 21:22:06.559580 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:06.559529    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:06.559650 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:06.559611    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:22:06.560060 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:06.560037    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hhrns"]
Jul 13 21:22:06.710659 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:06.710629    2575 generic.go:356] "Generic (PLEG): container finished" podID="e8625f4f-5b24-408d-affe-221341f4f56a" containerID="29896f47594b4c99757ef5892345d3b03ed5e7219a600f3bd5b9b301edb0fc46" exitCode=0
Jul 13 21:22:06.710845 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:06.710660    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffh5n" event={"ID":"e8625f4f-5b24-408d-affe-221341f4f56a","Type":"ContainerDied","Data":"29896f47594b4c99757ef5892345d3b03ed5e7219a600f3bd5b9b301edb0fc46"}
Jul 13 21:22:06.710845 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:06.710779    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:06.710948 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:06.710897    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:22:08.463676 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:08.463612    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:08.464051 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:08.463695    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:08.464051 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:08.463805    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:08.464051 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:08.463803    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:22:08.464051 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:08.463897    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:22:08.464051 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:08.463991    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:22:08.717316 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:08.717229    2575 generic.go:356] "Generic (PLEG): container finished" podID="e8625f4f-5b24-408d-affe-221341f4f56a" containerID="ac3b8f56f68d69983e97cad86c6c9dcc3a268c41099a938288340e94f2f5074a" exitCode=0
Jul 13 21:22:08.717316 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:08.717277    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffh5n" event={"ID":"e8625f4f-5b24-408d-affe-221341f4f56a","Type":"ContainerDied","Data":"ac3b8f56f68d69983e97cad86c6c9dcc3a268c41099a938288340e94f2f5074a"}
Jul 13 21:22:09.187554 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:09.187524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:09.187731 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:09.187672    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:09.187780 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:09.187737    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs podName:3b829c24-392e-4a3a-98fe-1c4003581195 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:41.187722247 +0000 UTC m=+66.277002379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs") pod "network-metrics-daemon-hhrns" (UID: "3b829c24-392e-4a3a-98fe-1c4003581195") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 21:22:09.288732 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:09.288697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:09.288869 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:09.288839    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:09.289011 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:09.288918    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret podName:4e67ebcf-f921-48f9-a5e7-80e0012b81d9 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:41.288903044 +0000 UTC m=+66.378183175 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret") pod "global-pull-secret-syncer-89tsm" (UID: "4e67ebcf-f921-48f9-a5e7-80e0012b81d9") : object "kube-system"/"original-pull-secret" not registered
Jul 13 21:22:09.389231 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:09.389198    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4xh\" (UniqueName: \"kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh\") pod \"network-check-target-p45dw\" (UID: \"8ba8c95d-e476-4508-b7ca-1f1b701fb55a\") " pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:09.389416 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:09.389320    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 21:22:09.389416 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:09.389352    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 21:22:09.389416 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:09.389362    2575 projected.go:196] Error preparing data for projected volume kube-api-access-wd4xh for pod openshift-network-diagnostics/network-check-target-p45dw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:09.389416 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:09.389411    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh podName:8ba8c95d-e476-4508-b7ca-1f1b701fb55a nodeName:}" failed. No retries permitted until 2026-07-13 21:22:41.389397237 +0000 UTC m=+66.478677384 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wd4xh" (UniqueName: "kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh") pod "network-check-target-p45dw" (UID: "8ba8c95d-e476-4508-b7ca-1f1b701fb55a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 21:22:10.464063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:10.463832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:10.464518 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:10.464163    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p45dw" podUID="8ba8c95d-e476-4508-b7ca-1f1b701fb55a"
Jul 13 21:22:10.464518 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:10.463833    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:10.464518 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:10.463832    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:10.464518 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:10.464267    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhrns" podUID="3b829c24-392e-4a3a-98fe-1c4003581195"
Jul 13 21:22:10.464518 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:10.464330    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-89tsm" podUID="4e67ebcf-f921-48f9-a5e7-80e0012b81d9"
Jul 13 21:22:11.683881 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.683846    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-189.ec2.internal" event="NodeReady"
Jul 13 21:22:11.684264 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.684003    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 21:22:11.716404 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.716371    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84cc7589c4-w6jqn"]
Jul 13 21:22:11.719051 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.718978    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.722333 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.722281    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 21:22:11.722486 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.722385    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-58sx4\""
Jul 13 21:22:11.722486 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.722290    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 21:22:11.722921 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.722757    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 21:22:11.727669 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.727645    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 21:22:11.734137 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.734117    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84cc7589c4-w6jqn"]
Jul 13 21:22:11.738800 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.738774    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qs8p2"]
Jul 13 21:22:11.740595 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.740571    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7bl66"]
Jul 13 21:22:11.740705 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.740687    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:11.742266 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.742231    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7bl66"
Jul 13 21:22:11.743116 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.743100    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 21:22:11.743305 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.743290    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d9ws2\""
Jul 13 21:22:11.743408 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.743318    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 21:22:11.745252 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.745212    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 21:22:11.745252 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.745244    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 21:22:11.745436 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.745257    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 21:22:11.745436 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.745274    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hgkt5\""
Jul 13 21:22:11.749534 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.749473    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qs8p2"]
Jul 13 21:22:11.753089 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.753025    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7bl66"]
Jul 13 21:22:11.809975 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.809943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-image-registry-private-configuration\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.810141 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.809984    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-bound-sa-token\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.810141 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.810047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b61797e8-1217-4824-86d0-e7a4dfbf8714-ca-trust-extracted\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.810141 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.810099    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-certificates\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.810141 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.810131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j5w6\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-kube-api-access-6j5w6\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.810359 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.810171    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.810359 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.810219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-installation-pull-secrets\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.810359 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.810251    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-trusted-ca\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.911358 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911303    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-installation-pull-secrets\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.911564 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911377    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72c4z\" (UniqueName: \"kubernetes.io/projected/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-kube-api-access-72c4z\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:11.911564 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-trusted-ca\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.911564 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911508    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-tmp-dir\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:11.911727 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911564    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-image-registry-private-configuration\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.911727 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911597    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-bound-sa-token\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.911727 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cdb947b-b2b7-42ab-b5e7-7933641becf7-cert\") pod \"ingress-canary-7bl66\" (UID: \"0cdb947b-b2b7-42ab-b5e7-7933641becf7\") " pod="openshift-ingress-canary/ingress-canary-7bl66"
Jul 13 21:22:11.911727 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpdpt\" (UniqueName: \"kubernetes.io/projected/0cdb947b-b2b7-42ab-b5e7-7933641becf7-kube-api-access-gpdpt\") pod \"ingress-canary-7bl66\" (UID: \"0cdb947b-b2b7-42ab-b5e7-7933641becf7\") " pod="openshift-ingress-canary/ingress-canary-7bl66"
Jul 13 21:22:11.911727 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b61797e8-1217-4824-86d0-e7a4dfbf8714-ca-trust-extracted\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.911727 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-certificates\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.911989 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911738    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j5w6\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-kube-api-access-6j5w6\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.911989 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911756    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-config-volume\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:11.911989 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.911989 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.911789    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:11.912183 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:11.912016    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:22:11.912183 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:11.912032    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84cc7589c4-w6jqn: secret "image-registry-tls" not found
Jul 13 21:22:11.912183 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:11.912084    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls podName:b61797e8-1217-4824-86d0-e7a4dfbf8714 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:12.412064485 +0000 UTC m=+37.501344633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls") pod "image-registry-84cc7589c4-w6jqn" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714") : secret "image-registry-tls" not found
Jul 13 21:22:11.912319 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.912302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-certificates\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.912405 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.912378    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b61797e8-1217-4824-86d0-e7a4dfbf8714-ca-trust-extracted\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.912485 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.912468    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-trusted-ca\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.916329 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.916300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-image-registry-private-configuration\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.916693 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.916670    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-installation-pull-secrets\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.921924 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.921901    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-bound-sa-token\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:11.922521 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:11.922497    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j5w6\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-kube-api-access-6j5w6\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:12.013282 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.013192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cdb947b-b2b7-42ab-b5e7-7933641becf7-cert\") pod \"ingress-canary-7bl66\" (UID: \"0cdb947b-b2b7-42ab-b5e7-7933641becf7\") " pod="openshift-ingress-canary/ingress-canary-7bl66"
Jul 13 21:22:12.013282 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.013234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpdpt\" (UniqueName: \"kubernetes.io/projected/0cdb947b-b2b7-42ab-b5e7-7933641becf7-kube-api-access-gpdpt\") pod \"ingress-canary-7bl66\" (UID: \"0cdb947b-b2b7-42ab-b5e7-7933641becf7\") " pod="openshift-ingress-canary/ingress-canary-7bl66"
Jul 13 21:22:12.013521 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.013417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-config-volume\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:12.013521 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.013457    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:12.013521 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.013505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72c4z\" (UniqueName: \"kubernetes.io/projected/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-kube-api-access-72c4z\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:12.013664 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.013549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-tmp-dir\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:12.013664 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:12.013649    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:22:12.013763 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:12.013739    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls podName:db616dd4-a0c5-4beb-8c07-95de1e4b51f1 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:12.51371631 +0000 UTC m=+37.602996460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls") pod "dns-default-qs8p2" (UID: "db616dd4-a0c5-4beb-8c07-95de1e4b51f1") : secret "dns-default-metrics-tls" not found
Jul 13 21:22:12.013935 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.013883    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-tmp-dir\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:12.014123 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.014102    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-config-volume\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:12.015741 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.015720    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0cdb947b-b2b7-42ab-b5e7-7933641becf7-cert\") pod \"ingress-canary-7bl66\" (UID: \"0cdb947b-b2b7-42ab-b5e7-7933641becf7\") " pod="openshift-ingress-canary/ingress-canary-7bl66"
Jul 13 21:22:12.022876 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.022848    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72c4z\" (UniqueName: \"kubernetes.io/projected/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-kube-api-access-72c4z\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:12.022982 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.022934    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpdpt\" (UniqueName: \"kubernetes.io/projected/0cdb947b-b2b7-42ab-b5e7-7933641becf7-kube-api-access-gpdpt\") pod \"ingress-canary-7bl66\" (UID: \"0cdb947b-b2b7-42ab-b5e7-7933641becf7\") " pod="openshift-ingress-canary/ingress-canary-7bl66"
Jul 13 21:22:12.052065 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.051999    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:12.059928 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.059902    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7bl66"
Jul 13 21:22:12.167959 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.167911    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:12.327352 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.327293    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:12.416048 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.416004    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:12.416225 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:12.416154    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:22:12.416225 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:12.416173    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84cc7589c4-w6jqn: secret "image-registry-tls" not found
Jul 13 21:22:12.416310 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:12.416244    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls podName:b61797e8-1217-4824-86d0-e7a4dfbf8714 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:13.416227602 +0000 UTC m=+38.505507733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls") pod "image-registry-84cc7589c4-w6jqn" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714") : secret "image-registry-tls" not found
Jul 13 21:22:12.423263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.423229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:12.463626 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.463591    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:12.463626 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.463624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:12.463873 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.463624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:12.466757 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.466728    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r54dj\""
Jul 13 21:22:12.466917 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.466791    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 21:22:12.466917 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.466735    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 21:22:12.466917 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.466858    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tk42z\""
Jul 13 21:22:12.466917 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.466893    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 21:22:12.467547 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.467524    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 21:22:12.517507 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.517474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:12.517704 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:12.517661    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:22:12.517770 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:12.517757    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls podName:db616dd4-a0c5-4beb-8c07-95de1e4b51f1 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:13.517735663 +0000 UTC m=+38.607015812 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls") pod "dns-default-qs8p2" (UID: "db616dd4-a0c5-4beb-8c07-95de1e4b51f1") : secret "dns-default-metrics-tls" not found
Jul 13 21:22:12.523808 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.523783    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:12.987139 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:12.987098    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:13.043262 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:13.043229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:13.268117 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:13.267888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7bl66"]
Jul 13 21:22:13.272656 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:13.272630    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cdb947b_b2b7_42ab_b5e7_7933641becf7.slice/crio-8a7e052bff8c7ab8d8dc566893e97af012d2ff21fd05a143ac1869abf2409418 WatchSource:0}: Error finding container 8a7e052bff8c7ab8d8dc566893e97af012d2ff21fd05a143ac1869abf2409418: Status 404 returned error can't find the container with id 8a7e052bff8c7ab8d8dc566893e97af012d2ff21fd05a143ac1869abf2409418
Jul 13 21:22:13.383071 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:13.383027    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:13.427382 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:13.427353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:13.427489 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:13.427477    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:22:13.427525 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:13.427489    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84cc7589c4-w6jqn: secret "image-registry-tls" not found
Jul 13 21:22:13.427558 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:13.427537    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls podName:b61797e8-1217-4824-86d0-e7a4dfbf8714 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:15.427523679 +0000 UTC m=+40.516803811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls") pod "image-registry-84cc7589c4-w6jqn" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714") : secret "image-registry-tls" not found
Jul 13 21:22:13.483879 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:13.483842    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:13.527932 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:13.527828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:13.528055 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:13.527973    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:22:13.528055 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:13.528031    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls podName:db616dd4-a0c5-4beb-8c07-95de1e4b51f1 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:15.528016812 +0000 UTC m=+40.617296972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls") pod "dns-default-qs8p2" (UID: "db616dd4-a0c5-4beb-8c07-95de1e4b51f1") : secret "dns-default-metrics-tls" not found
Jul 13 21:22:13.732257 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:13.732225    2575 generic.go:356] "Generic (PLEG): container finished" podID="e8625f4f-5b24-408d-affe-221341f4f56a" containerID="221329bb5aa4b51a00c9918c7c2e9486628a51750758af606b3844d8de761fa2" exitCode=0
Jul 13 21:22:13.732457 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:13.732305    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffh5n" event={"ID":"e8625f4f-5b24-408d-affe-221341f4f56a","Type":"ContainerDied","Data":"221329bb5aa4b51a00c9918c7c2e9486628a51750758af606b3844d8de761fa2"}
Jul 13 21:22:13.733503 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:13.733470    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7bl66" event={"ID":"0cdb947b-b2b7-42ab-b5e7-7933641becf7","Type":"ContainerStarted","Data":"8a7e052bff8c7ab8d8dc566893e97af012d2ff21fd05a143ac1869abf2409418"}
Jul 13 21:22:14.739839 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:14.739804    2575 generic.go:356] "Generic (PLEG): container finished" podID="e8625f4f-5b24-408d-affe-221341f4f56a" containerID="4dc5eb6ea17050abaaeb220a804015d8548238ab28a76b4ad65deeb1d93715ef" exitCode=0
Jul 13 21:22:14.740608 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:14.739850    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffh5n" event={"ID":"e8625f4f-5b24-408d-affe-221341f4f56a","Type":"ContainerDied","Data":"4dc5eb6ea17050abaaeb220a804015d8548238ab28a76b4ad65deeb1d93715ef"}
Jul 13 21:22:15.441329 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:15.441298    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:15.441524 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:15.441445    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:22:15.441524 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:15.441466    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84cc7589c4-w6jqn: secret "image-registry-tls" not found
Jul 13 21:22:15.441605 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:15.441529    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls podName:b61797e8-1217-4824-86d0-e7a4dfbf8714 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:19.441511776 +0000 UTC m=+44.530791907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls") pod "image-registry-84cc7589c4-w6jqn" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714") : secret "image-registry-tls" not found
Jul 13 21:22:15.542760 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:15.542717    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:15.542943 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:15.542845    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:22:15.542943 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:15.542912    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls podName:db616dd4-a0c5-4beb-8c07-95de1e4b51f1 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:19.542894316 +0000 UTC m=+44.632174458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls") pod "dns-default-qs8p2" (UID: "db616dd4-a0c5-4beb-8c07-95de1e4b51f1") : secret "dns-default-metrics-tls" not found
Jul 13 21:22:15.746478 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:15.746397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ffh5n" event={"ID":"e8625f4f-5b24-408d-affe-221341f4f56a","Type":"ContainerStarted","Data":"c2c7dc10ce4cc0baa0e47e3cf38080c87bfcd0bd21e50daf70a91abcc9dd54c8"}
Jul 13 21:22:15.769699 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:15.769621    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ffh5n" podStartSLOduration=7.028981871 podStartE2EDuration="39.769602581s" totalImagesPullingTime="32.74062071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:15.767745449 +0000 UTC m=+40.857025603" watchObservedRunningTime="2026-07-13 21:22:15.769602581 +0000 UTC m=+40.858882735"
Jul 13 21:22:15.889409 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:15.889372    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:15.947163 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:15.947118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:16.120887 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:16.120850    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:16.221865 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:16.221832    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:16.499747 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:16.499719    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:16.600936 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:16.600898    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:16.750778 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:16.750701    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7bl66" event={"ID":"0cdb947b-b2b7-42ab-b5e7-7933641becf7","Type":"ContainerStarted","Data":"524469111c035dfb7e49086a3782532bb4a398a210f998c5bb527d25feead9f6"}
Jul 13 21:22:16.766997 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:16.766950    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7bl66" podStartSLOduration=2.604443049 podStartE2EDuration="5.766935113s" totalImagesPullingTime="3.162492064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:16.766472236 +0000 UTC m=+41.855752386" watchObservedRunningTime="2026-07-13 21:22:16.766935113 +0000 UTC m=+41.856215257"
Jul 13 21:22:17.653074 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.653040    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"]
Jul 13 21:22:17.675036 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.674207    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:17.675253 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.674103    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9"]
Jul 13 21:22:17.677143 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.677076    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 13 21:22:17.677143 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.677127    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:22:17.677304 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.677127    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 13 21:22:17.677304 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.677126    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 13 21:22:17.677418 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.677354    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4gd57\""
Jul 13 21:22:17.698252 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.698226    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"]
Jul 13 21:22:17.698386 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.698333    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9"
Jul 13 21:22:17.701162 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.700877    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:22:17.701162 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.700960    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 13 21:22:17.701331 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.701263    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wnb84\""
Jul 13 21:22:17.722436 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.722411    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"]
Jul 13 21:22:17.722525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.722475    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:17.724983 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.724963    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 21:22:17.724983 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.724974    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 13 21:22:17.726330 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.726176    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 21:22:17.726330 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.726201    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pslhm\""
Jul 13 21:22:17.734038 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.734021    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 13 21:22:17.742499 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.742482    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c7d7cf9fb-cs5pw"]
Jul 13 21:22:17.742608 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.742595    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:17.744950 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.744926    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 13 21:22:17.744950 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.744930    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:22:17.745102 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.744985    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-r8qs2\""
Jul 13 21:22:17.745102 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.744931    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 13 21:22:17.756450 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.756433    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"]
Jul 13 21:22:17.756736 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.756460    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9"]
Jul 13 21:22:17.756736 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.756473    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"]
Jul 13 21:22:17.756736 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.756491    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"]
Jul 13 21:22:17.756736 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.756511    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c7d7cf9fb-cs5pw"]
Jul 13 21:22:17.756736 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.756525    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc"]
Jul 13 21:22:17.756736 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.756533    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.758825 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.758804    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 13 21:22:17.759185 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.759159    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 13 21:22:17.759185 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.759172    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g2j29\""
Jul 13 21:22:17.759185 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.759179    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 13 21:22:17.759399 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.759193    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 21:22:17.759399 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.759230    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 21:22:17.759399 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.759177    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 13 21:22:17.778654 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.778633    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc"]
Jul 13 21:22:17.778767 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.778682    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-4s2vp"]
Jul 13 21:22:17.778837 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.778775    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc"
Jul 13 21:22:17.781259 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.781242    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7f6t5\""
Jul 13 21:22:17.802673 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.802650    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"]
Jul 13 21:22:17.802797 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.802761    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:17.805436 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.805412    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 13 21:22:17.805546 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.805460    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-l52bp\""
Jul 13 21:22:17.805546 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.805498    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 13 21:22:17.805546 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.805516    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 13 21:22:17.805727 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.805590    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:22:17.810473 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.810453    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 13 21:22:17.811482 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.811454    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:17.826791 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.826769    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-c2qb9"]
Jul 13 21:22:17.826885 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.826871    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:17.831288 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.831262    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 13 21:22:17.831392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.831284    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:22:17.831392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.831297    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2zqgp\""
Jul 13 21:22:17.831392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.831262    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 13 21:22:17.831481 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.831297    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 13 21:22:17.840926 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.840908    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"]
Jul 13 21:22:17.841021 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.841008    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:17.843811 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.843768    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 13 21:22:17.843811 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.843784    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rrszc\""
Jul 13 21:22:17.843980 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.843771    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 21:22:17.843980 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.843944    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 13 21:22:17.844088 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.843987    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 21:22:17.849474 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.849458    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 13 21:22:17.852867 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.852853    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"]
Jul 13 21:22:17.852925 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.852878    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-4s2vp"]
Jul 13 21:22:17.852925 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.852891    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"]
Jul 13 21:22:17.852925 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.852908    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-c2qb9"]
Jul 13 21:22:17.853010 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.852959    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:17.855177 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.855158    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 13 21:22:17.855258 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.855179    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7mxdk\""
Jul 13 21:22:17.855258 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.855189    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 13 21:22:17.860120 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860101    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab1b994-4573-4b8c-ab6b-0dca52fc98cb-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tqrlr\" (UID: \"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:17.860217 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:17.860217 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860163    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrxfc\" (UniqueName: \"kubernetes.io/projected/8ab1b994-4573-4b8c-ab6b-0dca52fc98cb-kube-api-access-hrxfc\") pod \"kube-storage-version-migrator-operator-799cb7f958-tqrlr\" (UID: \"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:17.860217 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.860389 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860280    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx9lc\" (UniqueName: \"kubernetes.io/projected/25abff9a-a168-4b5d-81fd-ff850378dbf6-kube-api-access-vx9lc\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:17.860389 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860316    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ab1b994-4573-4b8c-ab6b-0dca52fc98cb-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tqrlr\" (UID: \"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:17.860456 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.860456 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/25abff9a-a168-4b5d-81fd-ff850378dbf6-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:17.860567 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxxg6\" (UniqueName: \"kubernetes.io/projected/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-kube-api-access-dxxg6\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.860567 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-default-certificate\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.860567 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860526    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l8k7\" (UniqueName: \"kubernetes.io/projected/c3821d0f-b34c-423a-bc4f-2243cb4a174c-kube-api-access-4l8k7\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:17.860567 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860542    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-stats-auth\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.860709 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2csn2\" (UniqueName: \"kubernetes.io/projected/32fb6130-69ee-48f3-88a9-b08582803f42-kube-api-access-2csn2\") pod \"volume-data-source-validator-78495597f6-c74c9\" (UID: \"32fb6130-69ee-48f3-88a9-b08582803f42\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9"
Jul 13 21:22:17.860709 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.860624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:17.881018 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.880997    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:17.949426 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.949321    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:17.961387 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-default-certificate\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.961464 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961396    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l8k7\" (UniqueName: \"kubernetes.io/projected/c3821d0f-b34c-423a-bc4f-2243cb4a174c-kube-api-access-4l8k7\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:17.961464 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt4qz\" (UniqueName: \"kubernetes.io/projected/c81457da-0ba0-4053-b2e5-d5221a8c943c-kube-api-access-dt4qz\") pod \"service-ca-operator-7695fc6c8c-hlqnl\" (UID: \"c81457da-0ba0-4053-b2e5-d5221a8c943c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:17.961560 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ed7f6-38f8-4626-8467-00f1a732c497-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:17.961604 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-stats-auth\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.961604 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-serving-cert\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:17.961675 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961614    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zmjd\" (UniqueName: \"kubernetes.io/projected/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-kube-api-access-9zmjd\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:17.961724 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961678    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2csn2\" (UniqueName: \"kubernetes.io/projected/32fb6130-69ee-48f3-88a9-b08582803f42-kube-api-access-2csn2\") pod \"volume-data-source-validator-78495597f6-c74c9\" (UID: \"32fb6130-69ee-48f3-88a9-b08582803f42\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9"
Jul 13 21:22:17.961757 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c81457da-0ba0-4053-b2e5-d5221a8c943c-config\") pod \"service-ca-operator-7695fc6c8c-hlqnl\" (UID: \"c81457da-0ba0-4053-b2e5-d5221a8c943c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:17.961798 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:17.961848 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-config\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:17.961895 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/883ed7f6-38f8-4626-8467-00f1a732c497-serving-cert\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:17.961895 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:17.961988 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ed7f6-38f8-4626-8467-00f1a732c497-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:17.961988 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.961961    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/883ed7f6-38f8-4626-8467-00f1a732c497-snapshots\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:17.962083 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:17.962013    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 21:22:17.962125 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:17.962098    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls podName:c3821d0f-b34c-423a-bc4f-2243cb4a174c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:18.462075943 +0000 UTC m=+43.551356093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls") pod "cluster-samples-operator-65db858894-gqkhs" (UID: "c3821d0f-b34c-423a-bc4f-2243cb4a174c") : secret "samples-operator-tls" not found
Jul 13 21:22:17.962125 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962019    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab1b994-4573-4b8c-ab6b-0dca52fc98cb-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tqrlr\" (UID: \"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:17.962222 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962152    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mv9t\" (UniqueName: \"kubernetes.io/projected/9e797758-cabe-4857-b468-db1affe924f5-kube-api-access-5mv9t\") pod \"network-check-source-869dcfcdcd-tg2qc\" (UID: \"9e797758-cabe-4857-b468-db1affe924f5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc"
Jul 13 21:22:17.962222 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962205    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-trusted-ca\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:17.962320 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962237    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:17.962320 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962261    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxfc\" (UniqueName: \"kubernetes.io/projected/8ab1b994-4573-4b8c-ab6b-0dca52fc98cb-kube-api-access-hrxfc\") pod \"kube-storage-version-migrator-operator-799cb7f958-tqrlr\" (UID: \"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:17.962320 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.962320 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962310    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed0a11bd-06f9-4058-bd40-a411090cfc56-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:17.962525 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:17.962352    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:17.962525 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:17.962405    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls podName:25abff9a-a168-4b5d-81fd-ff850378dbf6 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:18.462388717 +0000 UTC m=+43.551668866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gxhht" (UID: "25abff9a-a168-4b5d-81fd-ff850378dbf6") : secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:17.962525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962354    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx9lc\" (UniqueName: \"kubernetes.io/projected/25abff9a-a168-4b5d-81fd-ff850378dbf6-kube-api-access-vx9lc\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:17.962525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962440    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ab1b994-4573-4b8c-ab6b-0dca52fc98cb-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tqrlr\" (UID: \"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:17.962525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.962525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962492    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv67c\" (UniqueName: \"kubernetes.io/projected/883ed7f6-38f8-4626-8467-00f1a732c497-kube-api-access-cv67c\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:17.962801 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962529    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/25abff9a-a168-4b5d-81fd-ff850378dbf6-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:17.962801 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962549    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c81457da-0ba0-4053-b2e5-d5221a8c943c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hlqnl\" (UID: \"c81457da-0ba0-4053-b2e5-d5221a8c943c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:17.962801 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:17.962561    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:18.462547682 +0000 UTC m=+43.551827829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : configmap references non-existent config key: service-ca.crt
Jul 13 21:22:17.962801 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:17.962708    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 21:22:17.962801 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:17.962748    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:18.462733499 +0000 UTC m=+43.552013644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : secret "router-metrics-certs-default" not found
Jul 13 21:22:17.963039 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/883ed7f6-38f8-4626-8467-00f1a732c497-tmp\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:17.963039 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.962981    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxxg6\" (UniqueName: \"kubernetes.io/projected/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-kube-api-access-dxxg6\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.963208 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.963186    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8ab1b994-4573-4b8c-ab6b-0dca52fc98cb-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-tqrlr\" (UID: \"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:17.963555 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.963532    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/25abff9a-a168-4b5d-81fd-ff850378dbf6-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:17.965161 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.965141    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8ab1b994-4573-4b8c-ab6b-0dca52fc98cb-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-tqrlr\" (UID: \"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:17.965271 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.965252    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-stats-auth\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.965422 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.965405    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-default-certificate\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.970821 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.970798    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l8k7\" (UniqueName: \"kubernetes.io/projected/c3821d0f-b34c-423a-bc4f-2243cb4a174c-kube-api-access-4l8k7\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:17.971508 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.971489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2csn2\" (UniqueName: \"kubernetes.io/projected/32fb6130-69ee-48f3-88a9-b08582803f42-kube-api-access-2csn2\") pod \"volume-data-source-validator-78495597f6-c74c9\" (UID: \"32fb6130-69ee-48f3-88a9-b08582803f42\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9"
Jul 13 21:22:17.971611 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.971552    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrxfc\" (UniqueName: \"kubernetes.io/projected/8ab1b994-4573-4b8c-ab6b-0dca52fc98cb-kube-api-access-hrxfc\") pod \"kube-storage-version-migrator-operator-799cb7f958-tqrlr\" (UID: \"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:17.971787 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.971770    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx9lc\" (UniqueName: \"kubernetes.io/projected/25abff9a-a168-4b5d-81fd-ff850378dbf6-kube-api-access-vx9lc\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:17.972167 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.972150    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxxg6\" (UniqueName: \"kubernetes.io/projected/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-kube-api-access-dxxg6\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:17.985083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:17.985062    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"
Jul 13 21:22:18.007746 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.007720    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9"
Jul 13 21:22:18.050157 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.050129    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:18.065392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-trusted-ca\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:18.065392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed0a11bd-06f9-4058-bd40-a411090cfc56-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:18.065392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065227    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv67c\" (UniqueName: \"kubernetes.io/projected/883ed7f6-38f8-4626-8467-00f1a732c497-kube-api-access-cv67c\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.065392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c81457da-0ba0-4053-b2e5-d5221a8c943c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hlqnl\" (UID: \"c81457da-0ba0-4053-b2e5-d5221a8c943c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:18.065392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065291    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/883ed7f6-38f8-4626-8467-00f1a732c497-tmp\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.065392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt4qz\" (UniqueName: \"kubernetes.io/projected/c81457da-0ba0-4053-b2e5-d5221a8c943c-kube-api-access-dt4qz\") pod \"service-ca-operator-7695fc6c8c-hlqnl\" (UID: \"c81457da-0ba0-4053-b2e5-d5221a8c943c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:18.065392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-trusted-ca\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:18.065766 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065399    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ed7f6-38f8-4626-8467-00f1a732c497-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.065766 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-serving-cert\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:18.065766 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065477    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zmjd\" (UniqueName: \"kubernetes.io/projected/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-kube-api-access-9zmjd\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:18.065766 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065515    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c81457da-0ba0-4053-b2e5-d5221a8c943c-config\") pod \"service-ca-operator-7695fc6c8c-hlqnl\" (UID: \"c81457da-0ba0-4053-b2e5-d5221a8c943c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:18.065766 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:18.065766 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-config\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:18.065766 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065634    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/883ed7f6-38f8-4626-8467-00f1a732c497-serving-cert\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.065766 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065718    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ed7f6-38f8-4626-8467-00f1a732c497-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.065766 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/883ed7f6-38f8-4626-8467-00f1a732c497-snapshots\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.066116 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065780    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mv9t\" (UniqueName: \"kubernetes.io/projected/9e797758-cabe-4857-b468-db1affe924f5-kube-api-access-5mv9t\") pod \"network-check-source-869dcfcdcd-tg2qc\" (UID: \"9e797758-cabe-4857-b468-db1affe924f5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc"
Jul 13 21:22:18.066116 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.065785    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/883ed7f6-38f8-4626-8467-00f1a732c497-tmp\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.066198 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.066114    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 21:22:18.066244 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.066211    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert podName:ed0a11bd-06f9-4058-bd40-a411090cfc56 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:18.566191007 +0000 UTC m=+43.655471140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rhbzx" (UID: "ed0a11bd-06f9-4058-bd40-a411090cfc56") : secret "networking-console-plugin-cert" not found
Jul 13 21:22:18.066940 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.066387    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ed7f6-38f8-4626-8467-00f1a732c497-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.066940 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.066437    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/883ed7f6-38f8-4626-8467-00f1a732c497-snapshots\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.066940 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.066686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/883ed7f6-38f8-4626-8467-00f1a732c497-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.066940 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.066899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-config\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:18.067269 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.067230    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ed0a11bd-06f9-4058-bd40-a411090cfc56-nginx-conf\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:18.067358 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.067290    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c81457da-0ba0-4053-b2e5-d5221a8c943c-config\") pod \"service-ca-operator-7695fc6c8c-hlqnl\" (UID: \"c81457da-0ba0-4053-b2e5-d5221a8c943c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:18.068587 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.068564    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c81457da-0ba0-4053-b2e5-d5221a8c943c-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hlqnl\" (UID: \"c81457da-0ba0-4053-b2e5-d5221a8c943c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:18.068906 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.068884    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-serving-cert\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:18.069175 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.069156    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/883ed7f6-38f8-4626-8467-00f1a732c497-serving-cert\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.074419 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.074392    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv67c\" (UniqueName: \"kubernetes.io/projected/883ed7f6-38f8-4626-8467-00f1a732c497-kube-api-access-cv67c\") pod \"insights-operator-68d9dd94cf-c2qb9\" (UID: \"883ed7f6-38f8-4626-8467-00f1a732c497\") " pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.075514 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.075489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt4qz\" (UniqueName: \"kubernetes.io/projected/c81457da-0ba0-4053-b2e5-d5221a8c943c-kube-api-access-dt4qz\") pod \"service-ca-operator-7695fc6c8c-hlqnl\" (UID: \"c81457da-0ba0-4053-b2e5-d5221a8c943c\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:18.075655 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.075576    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zmjd\" (UniqueName: \"kubernetes.io/projected/fe01c8d4-4ca1-4a78-ba03-93c77e5ab482-kube-api-access-9zmjd\") pod \"console-operator-7866497494-4s2vp\" (UID: \"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482\") " pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:18.076018 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.075993    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mv9t\" (UniqueName: \"kubernetes.io/projected/9e797758-cabe-4857-b468-db1affe924f5-kube-api-access-5mv9t\") pod \"network-check-source-869dcfcdcd-tg2qc\" (UID: \"9e797758-cabe-4857-b468-db1affe924f5\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc"
Jul 13 21:22:18.087747 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.087673    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc"
Jul 13 21:22:18.114070 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.113896    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:18.141774 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.141469    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"
Jul 13 21:22:18.150713 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.150068    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9"
Jul 13 21:22:18.152119 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.152073    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:18.197372 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.196373    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr"]
Jul 13 21:22:18.202459 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:18.201843    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab1b994_4573_4b8c_ab6b_0dca52fc98cb.slice/crio-1f37bbc441ee72478525678793c734410e6a70ee1a5e0d54087633543846643d WatchSource:0}: Error finding container 1f37bbc441ee72478525678793c734410e6a70ee1a5e0d54087633543846643d: Status 404 returned error can't find the container with id 1f37bbc441ee72478525678793c734410e6a70ee1a5e0d54087633543846643d
Jul 13 21:22:18.223051 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.222980    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9"]
Jul 13 21:22:18.229911 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:18.229878    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32fb6130_69ee_48f3_88a9_b08582803f42.slice/crio-cb7b67c832b5f89dfb0fefaa59eae4aeac36b0113e1e34f8527bb19d027826ef WatchSource:0}: Error finding container cb7b67c832b5f89dfb0fefaa59eae4aeac36b0113e1e34f8527bb19d027826ef: Status 404 returned error can't find the container with id cb7b67c832b5f89dfb0fefaa59eae4aeac36b0113e1e34f8527bb19d027826ef
Jul 13 21:22:18.264084 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.263878    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:18.307161 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.307136    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc"]
Jul 13 21:22:18.309657 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:18.309596    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e797758_cabe_4857_b468_db1affe924f5.slice/crio-f8f801471e7ce10c00c0012b8a666bfe74ec590c31e5c582aee2a103e173c94c WatchSource:0}: Error finding container f8f801471e7ce10c00c0012b8a666bfe74ec590c31e5c582aee2a103e173c94c: Status 404 returned error can't find the container with id f8f801471e7ce10c00c0012b8a666bfe74ec590c31e5c582aee2a103e173c94c
Jul 13 21:22:18.310473 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.310451    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-4s2vp"]
Jul 13 21:22:18.313893 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:18.313869    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe01c8d4_4ca1_4a78_ba03_93c77e5ab482.slice/crio-c6db5fb99e7447d08af2bd0a005372e6fc5bcf183b810cffd6afab1c1b9c994f WatchSource:0}: Error finding container c6db5fb99e7447d08af2bd0a005372e6fc5bcf183b810cffd6afab1c1b9c994f: Status 404 returned error can't find the container with id c6db5fb99e7447d08af2bd0a005372e6fc5bcf183b810cffd6afab1c1b9c994f
Jul 13 21:22:18.336063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.335981    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl"]
Jul 13 21:22:18.338359 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:18.338319    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc81457da_0ba0_4053_b2e5_d5221a8c943c.slice/crio-26ddb2646caab62ca5d3f789c4853b0ec47c39a512b7af826f41032b9c0aa75f WatchSource:0}: Error finding container 26ddb2646caab62ca5d3f789c4853b0ec47c39a512b7af826f41032b9c0aa75f: Status 404 returned error can't find the container with id 26ddb2646caab62ca5d3f789c4853b0ec47c39a512b7af826f41032b9c0aa75f
Jul 13 21:22:18.366836 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.366799    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-c2qb9"]
Jul 13 21:22:18.369487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:18.369465    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883ed7f6_38f8_4626_8467_00f1a732c497.slice/crio-0d0aeb9ab7b8ff42707c0dab6a69ece93b40cde218bacb650f9a5c3a1eec248b WatchSource:0}: Error finding container 0d0aeb9ab7b8ff42707c0dab6a69ece93b40cde218bacb650f9a5c3a1eec248b: Status 404 returned error can't find the container with id 0d0aeb9ab7b8ff42707c0dab6a69ece93b40cde218bacb650f9a5c3a1eec248b
Jul 13 21:22:18.470205 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.470125    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:18.470205 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.470156    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:18.470205 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.470182    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:18.470496 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.470267    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:18.470496 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.470283    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 21:22:18.470496 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.470319    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:19.470297322 +0000 UTC m=+44.559577468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : configmap references non-existent config key: service-ca.crt
Jul 13 21:22:18.470496 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.470370    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls podName:25abff9a-a168-4b5d-81fd-ff850378dbf6 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:19.470360387 +0000 UTC m=+44.559640525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gxhht" (UID: "25abff9a-a168-4b5d-81fd-ff850378dbf6") : secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:18.470496 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.470388    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:19.470377603 +0000 UTC m=+44.559657741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : secret "router-metrics-certs-default" not found
Jul 13 21:22:18.470496 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.470487    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:18.470726 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.470577    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 21:22:18.470726 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.470625    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls podName:c3821d0f-b34c-423a-bc4f-2243cb4a174c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:19.470610107 +0000 UTC m=+44.559890261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls") pod "cluster-samples-operator-65db858894-gqkhs" (UID: "c3821d0f-b34c-423a-bc4f-2243cb4a174c") : secret "samples-operator-tls" not found
Jul 13 21:22:18.571149 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.571116    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:18.571281 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.571216    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 21:22:18.571281 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:18.571263    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert podName:ed0a11bd-06f9-4058-bd40-a411090cfc56 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:19.571250292 +0000 UTC m=+44.660530422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rhbzx" (UID: "ed0a11bd-06f9-4058-bd40-a411090cfc56") : secret "networking-console-plugin-cert" not found
Jul 13 21:22:18.756069 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.755991    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc" event={"ID":"9e797758-cabe-4857-b468-db1affe924f5","Type":"ContainerStarted","Data":"f8f801471e7ce10c00c0012b8a666bfe74ec590c31e5c582aee2a103e173c94c"}
Jul 13 21:22:18.757217 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.757186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr" event={"ID":"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb","Type":"ContainerStarted","Data":"1f37bbc441ee72478525678793c734410e6a70ee1a5e0d54087633543846643d"}
Jul 13 21:22:18.758245 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.758217    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4s2vp" event={"ID":"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482","Type":"ContainerStarted","Data":"c6db5fb99e7447d08af2bd0a005372e6fc5bcf183b810cffd6afab1c1b9c994f"}
Jul 13 21:22:18.759276 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.759255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9" event={"ID":"32fb6130-69ee-48f3-88a9-b08582803f42","Type":"ContainerStarted","Data":"cb7b67c832b5f89dfb0fefaa59eae4aeac36b0113e1e34f8527bb19d027826ef"}
Jul 13 21:22:18.760318 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.760300    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9" event={"ID":"883ed7f6-38f8-4626-8467-00f1a732c497","Type":"ContainerStarted","Data":"0d0aeb9ab7b8ff42707c0dab6a69ece93b40cde218bacb650f9a5c3a1eec248b"}
Jul 13 21:22:18.761248 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:18.761230    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl" event={"ID":"c81457da-0ba0-4053-b2e5-d5221a8c943c","Type":"ContainerStarted","Data":"26ddb2646caab62ca5d3f789c4853b0ec47c39a512b7af826f41032b9c0aa75f"}
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:19.489256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:19.489311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:19.489372    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:19.489420    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:19.489512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.489660    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.489731    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls podName:c3821d0f-b34c-423a-bc4f-2243cb4a174c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:21.489711344 +0000 UTC m=+46.578991495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls") pod "cluster-samples-operator-65db858894-gqkhs" (UID: "c3821d0f-b34c-423a-bc4f-2243cb4a174c") : secret "samples-operator-tls" not found
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.490162    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.490212    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls podName:25abff9a-a168-4b5d-81fd-ff850378dbf6 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:21.490196693 +0000 UTC m=+46.579476841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gxhht" (UID: "25abff9a-a168-4b5d-81fd-ff850378dbf6") : secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.490277    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:21.490266794 +0000 UTC m=+46.579546957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : configmap references non-existent config key: service-ca.crt
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.490332    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.490384    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:21.490373189 +0000 UTC m=+46.579653323 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : secret "router-metrics-certs-default" not found
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.490443    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.490453    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84cc7589c4-w6jqn: secret "image-registry-tls" not found
Jul 13 21:22:19.490512 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.490480    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls podName:b61797e8-1217-4824-86d0-e7a4dfbf8714 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:27.490470421 +0000 UTC m=+52.579750566 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls") pod "image-registry-84cc7589c4-w6jqn" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714") : secret "image-registry-tls" not found
Jul 13 21:22:19.591349 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:19.590593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:19.591349 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:19.590662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:19.591349 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.590818    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 21:22:19.591349 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.590882    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert podName:ed0a11bd-06f9-4058-bd40-a411090cfc56 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:21.590861524 +0000 UTC m=+46.680141659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rhbzx" (UID: "ed0a11bd-06f9-4058-bd40-a411090cfc56") : secret "networking-console-plugin-cert" not found
Jul 13 21:22:19.591349 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.591257    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:22:19.591349 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:19.591300    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls podName:db616dd4-a0c5-4beb-8c07-95de1e4b51f1 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:27.591286782 +0000 UTC m=+52.680566913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls") pod "dns-default-qs8p2" (UID: "db616dd4-a0c5-4beb-8c07-95de1e4b51f1") : secret "dns-default-metrics-tls" not found
Jul 13 21:22:20.770686 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:20.770590    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9" event={"ID":"32fb6130-69ee-48f3-88a9-b08582803f42","Type":"ContainerStarted","Data":"026a649971542bbc656ef6af613fab3f2addd372ebc15ed20d085b754f34bf3e"}
Jul 13 21:22:20.788131 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:20.788074    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c74c9" podStartSLOduration=1.729559445 podStartE2EDuration="3.788054154s" totalImagesPullingTime="2.058494709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:20.786221138 +0000 UTC m=+45.875501294" watchObservedRunningTime="2026-07-13 21:22:20.788054154 +0000 UTC m=+45.877334308"
Jul 13 21:22:20.863467 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:20.863431    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:20.921867 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:20.921830    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:21.510131 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:21.510097    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:21.510318 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:21.510222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:21.510318 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:21.510274    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 21:22:21.510462 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:21.510367    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 21:22:21.510462 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:21.510394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:21.510462 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:21.510408    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:25.510387382 +0000 UTC m=+50.599667514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : secret "router-metrics-certs-default" not found
Jul 13 21:22:21.510462 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:21.510434    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls podName:c3821d0f-b34c-423a-bc4f-2243cb4a174c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:25.510425119 +0000 UTC m=+50.599705255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls") pod "cluster-samples-operator-65db858894-gqkhs" (UID: "c3821d0f-b34c-423a-bc4f-2243cb4a174c") : secret "samples-operator-tls" not found
Jul 13 21:22:21.510668 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:21.510468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:21.510668 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:21.510475    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:21.510668 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:21.510523    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls podName:25abff9a-a168-4b5d-81fd-ff850378dbf6 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:25.51050711 +0000 UTC m=+50.599787267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gxhht" (UID: "25abff9a-a168-4b5d-81fd-ff850378dbf6") : secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:21.510668 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:21.510570    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:25.510559601 +0000 UTC m=+50.599839763 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : configmap references non-existent config key: service-ca.crt
Jul 13 21:22:21.611305 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:21.611262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:21.611500 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:21.611439    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 21:22:21.611566 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:21.611508    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert podName:ed0a11bd-06f9-4058-bd40-a411090cfc56 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:25.611492857 +0000 UTC m=+50.700773008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rhbzx" (UID: "ed0a11bd-06f9-4058-bd40-a411090cfc56") : secret "networking-console-plugin-cert" not found
Jul 13 21:22:25.548466 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.548424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:25.548984 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.548474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:25.548984 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.548517    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:25.548984 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:25.548596    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:25.548984 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.548626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:25.548984 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:25.548658    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls podName:25abff9a-a168-4b5d-81fd-ff850378dbf6 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:33.548639374 +0000 UTC m=+58.637919504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gxhht" (UID: "25abff9a-a168-4b5d-81fd-ff850378dbf6") : secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:25.548984 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:25.548692    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 21:22:25.548984 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:25.548708    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:33.548680477 +0000 UTC m=+58.637960611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : configmap references non-existent config key: service-ca.crt
Jul 13 21:22:25.548984 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:25.548731    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls podName:c3821d0f-b34c-423a-bc4f-2243cb4a174c nodeName:}" failed. No retries permitted until 2026-07-13 21:22:33.548720128 +0000 UTC m=+58.638000278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls") pod "cluster-samples-operator-65db858894-gqkhs" (UID: "c3821d0f-b34c-423a-bc4f-2243cb4a174c") : secret "samples-operator-tls" not found
Jul 13 21:22:25.548984 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:25.548766    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 21:22:25.548984 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:25.548794    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:33.54878628 +0000 UTC m=+58.638066425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : secret "router-metrics-certs-default" not found
Jul 13 21:22:25.649913 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.649871    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:25.650108 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:25.650042    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 21:22:25.650174 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:25.650125    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert podName:ed0a11bd-06f9-4058-bd40-a411090cfc56 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:33.650104883 +0000 UTC m=+58.739385027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rhbzx" (UID: "ed0a11bd-06f9-4058-bd40-a411090cfc56") : secret "networking-console-plugin-cert" not found
Jul 13 21:22:25.786740 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.786700    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc" event={"ID":"9e797758-cabe-4857-b468-db1affe924f5","Type":"ContainerStarted","Data":"5ad20724fc5292b024b622e2de86fb15ea09f8f9eceb7de70c02ffdce59206d6"}
Jul 13 21:22:25.788369 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.788314    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr" event={"ID":"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb","Type":"ContainerStarted","Data":"08167b6e9c6a7c88771fbf1a8464129c24d1e40041b13fe19f207b309200d66a"}
Jul 13 21:22:25.790293 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.790269    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/0.log"
Jul 13 21:22:25.790425 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.790310    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe01c8d4-4ca1-4a78-ba03-93c77e5ab482" containerID="bd92e1983129507a25787a975d7efa82fd5a8de063f7a11f4357a28ae9efe2b1" exitCode=255
Jul 13 21:22:25.790425 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.790415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4s2vp" event={"ID":"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482","Type":"ContainerDied","Data":"bd92e1983129507a25787a975d7efa82fd5a8de063f7a11f4357a28ae9efe2b1"}
Jul 13 21:22:25.790672 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.790655    2575 scope.go:117] "RemoveContainer" containerID="bd92e1983129507a25787a975d7efa82fd5a8de063f7a11f4357a28ae9efe2b1"
Jul 13 21:22:25.792316 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.792294    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9" event={"ID":"883ed7f6-38f8-4626-8467-00f1a732c497","Type":"ContainerStarted","Data":"149ad6b8ed15d930a7d705e7c92f06fc41ed54a387bc9398852d3e0281ee0262"}
Jul 13 21:22:25.794647 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.794627    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl" event={"ID":"c81457da-0ba0-4053-b2e5-d5221a8c943c","Type":"ContainerStarted","Data":"87429fa925231002f690f359f2f1f856e9a11d57cd7caa260aa14df29c1f335b"}
Jul 13 21:22:25.811826 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.811776    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tg2qc" podStartSLOduration=2.250259942 podStartE2EDuration="8.811755991s" totalImagesPullingTime="6.561496049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:25.81023361 +0000 UTC m=+50.899513758" watchObservedRunningTime="2026-07-13 21:22:25.811755991 +0000 UTC m=+50.901036145"
Jul 13 21:22:25.840159 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.840101    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl" podStartSLOduration=2.31956863 podStartE2EDuration="8.840079414s" totalImagesPullingTime="6.520510784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:25.839515011 +0000 UTC m=+50.928795164" watchObservedRunningTime="2026-07-13 21:22:25.840079414 +0000 UTC m=+50.929359569"
Jul 13 21:22:25.857592 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.857540    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr" podStartSLOduration=2.202593599 podStartE2EDuration="8.857519576s" totalImagesPullingTime="6.654925977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:25.855609646 +0000 UTC m=+50.944889800" watchObservedRunningTime="2026-07-13 21:22:25.857519576 +0000 UTC m=+50.946799730"
Jul 13 21:22:25.878052 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:25.876755    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9" podStartSLOduration=2.387631318 podStartE2EDuration="8.876732324s" totalImagesPullingTime="6.489101006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:25.876020333 +0000 UTC m=+50.965300490" watchObservedRunningTime="2026-07-13 21:22:25.876732324 +0000 UTC m=+50.966012476"
Jul 13 21:22:26.351094 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.351057    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z4gw5"]
Jul 13 21:22:26.359650 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.359621    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.362614 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.362576    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fxsvw\""
Jul 13 21:22:26.362830 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.362809    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 21:22:26.363073 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.363013    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 21:22:26.366543 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.366177    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z4gw5"]
Jul 13 21:22:26.434509 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.434468    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:26.459074 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.459034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.459241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.459193    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8df1d10b-fd51-42f3-8df4-290226630026-crio-socket\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.459299 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.459240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k4hv\" (UniqueName: \"kubernetes.io/projected/8df1d10b-fd51-42f3-8df4-290226630026-kube-api-access-7k4hv\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.459356 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.459305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8df1d10b-fd51-42f3-8df4-290226630026-data-volume\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.459404 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.459352    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.536653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.536604    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:26.560776 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.560733    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k4hv\" (UniqueName: \"kubernetes.io/projected/8df1d10b-fd51-42f3-8df4-290226630026-kube-api-access-7k4hv\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.561208 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.560798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8df1d10b-fd51-42f3-8df4-290226630026-data-volume\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.561208 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.560836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.561208 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.560994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.561208 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:26.561087    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 21:22:26.561208 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:26.561099    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 21:22:26.561208 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:26.561156    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls podName:8df1d10b-fd51-42f3-8df4-290226630026 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:27.061140126 +0000 UTC m=+52.150420273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4gw5" (UID: "8df1d10b-fd51-42f3-8df4-290226630026") : secret "insights-runtime-extractor-tls" not found
Jul 13 21:22:26.561208 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:26.561178    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm podName:8df1d10b-fd51-42f3-8df4-290226630026 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:27.061170889 +0000 UTC m=+52.150451020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z4gw5" (UID: "8df1d10b-fd51-42f3-8df4-290226630026") : configmap "kube-rbac-proxy" not found
Jul 13 21:22:26.561208 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.561188    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8df1d10b-fd51-42f3-8df4-290226630026-data-volume\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.561624 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.561230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8df1d10b-fd51-42f3-8df4-290226630026-crio-socket\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.561624 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.561402    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8df1d10b-fd51-42f3-8df4-290226630026-crio-socket\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.569538 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.569509    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw"]
Jul 13 21:22:26.577764 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.577735    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k4hv\" (UniqueName: \"kubernetes.io/projected/8df1d10b-fd51-42f3-8df4-290226630026-kube-api-access-7k4hv\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:26.588283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.588252    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw"]
Jul 13 21:22:26.588456 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.588378    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw"
Jul 13 21:22:26.591153 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.591132    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 13 21:22:26.591269 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.591214    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 13 21:22:26.591269 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.591140    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pt4rp\""
Jul 13 21:22:26.628446 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.628361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:26.662456 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.662421    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74l2k\" (UniqueName: \"kubernetes.io/projected/d5b5a43d-4e87-46c8-9df3-c2ba39890cca-kube-api-access-74l2k\") pod \"migrator-7f59b54f6c-hkpzw\" (UID: \"d5b5a43d-4e87-46c8-9df3-c2ba39890cca\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw"
Jul 13 21:22:26.684388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.684360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:26.763261 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.763229    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74l2k\" (UniqueName: \"kubernetes.io/projected/d5b5a43d-4e87-46c8-9df3-c2ba39890cca-kube-api-access-74l2k\") pod \"migrator-7f59b54f6c-hkpzw\" (UID: \"d5b5a43d-4e87-46c8-9df3-c2ba39890cca\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw"
Jul 13 21:22:26.771239 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.771206    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74l2k\" (UniqueName: \"kubernetes.io/projected/d5b5a43d-4e87-46c8-9df3-c2ba39890cca-kube-api-access-74l2k\") pod \"migrator-7f59b54f6c-hkpzw\" (UID: \"d5b5a43d-4e87-46c8-9df3-c2ba39890cca\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw"
Jul 13 21:22:26.773220 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.773188    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:26.802099 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.802072    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:22:26.802547 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.802527    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/0.log"
Jul 13 21:22:26.802666 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.802564    2575 generic.go:356] "Generic (PLEG): container finished" podID="fe01c8d4-4ca1-4a78-ba03-93c77e5ab482" containerID="f33f1cc30ea805f4284d865c3b3395f5d57fd17fc220a0f7a4109d92722eeda9" exitCode=255
Jul 13 21:22:26.802666 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.802647    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4s2vp" event={"ID":"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482","Type":"ContainerDied","Data":"f33f1cc30ea805f4284d865c3b3395f5d57fd17fc220a0f7a4109d92722eeda9"}
Jul 13 21:22:26.802772 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.802733    2575 scope.go:117] "RemoveContainer" containerID="bd92e1983129507a25787a975d7efa82fd5a8de063f7a11f4357a28ae9efe2b1"
Jul 13 21:22:26.803213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.803161    2575 scope.go:117] "RemoveContainer" containerID="f33f1cc30ea805f4284d865c3b3395f5d57fd17fc220a0f7a4109d92722eeda9"
Jul 13 21:22:26.803379 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:26.803333    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4s2vp_openshift-console-operator(fe01c8d4-4ca1-4a78-ba03-93c77e5ab482)\"" pod="openshift-console-operator/console-operator-7866497494-4s2vp" podUID="fe01c8d4-4ca1-4a78-ba03-93c77e5ab482"
Jul 13 21:22:26.831567 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.831532    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:26.896505 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.896417    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:26.899193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:26.899169    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw"
Jul 13 21:22:27.006181 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.006137    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:27.046099 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.046070    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw"]
Jul 13 21:22:27.048592 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:27.048565    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b5a43d_4e87_46c8_9df3_c2ba39890cca.slice/crio-4ebf2e9088ffc5fad705963d8e459af907117d9470185d03f08b66f2f886cfdf WatchSource:0}: Error finding container 4ebf2e9088ffc5fad705963d8e459af907117d9470185d03f08b66f2f886cfdf: Status 404 returned error can't find the container with id 4ebf2e9088ffc5fad705963d8e459af907117d9470185d03f08b66f2f886cfdf
Jul 13 21:22:27.066924 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.066894    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:27.067052 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.066963    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:27.067052 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:27.067027    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 21:22:27.067165 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:27.067084    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 21:22:27.067165 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:27.067114    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm podName:8df1d10b-fd51-42f3-8df4-290226630026 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:28.067089115 +0000 UTC m=+53.156369274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z4gw5" (UID: "8df1d10b-fd51-42f3-8df4-290226630026") : configmap "kube-rbac-proxy" not found
Jul 13 21:22:27.067165 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:27.067135    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls podName:8df1d10b-fd51-42f3-8df4-290226630026 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:28.06712521 +0000 UTC m=+53.156405343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4gw5" (UID: "8df1d10b-fd51-42f3-8df4-290226630026") : secret "insights-runtime-extractor-tls" not found
Jul 13 21:22:27.106303 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.106267    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:27.278149 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.278069    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:27.374194 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.374158    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log" limit=1024
Jul 13 21:22:27.546719 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.546649    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s877s_1a096c9e-9916-4b64-8232-4c990125ce94/dns-node-resolver/0.log"
Jul 13 21:22:27.570584 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.570554    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:27.570933 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:27.570710    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 21:22:27.570933 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:27.570728    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84cc7589c4-w6jqn: secret "image-registry-tls" not found
Jul 13 21:22:27.570933 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:27.570786    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls podName:b61797e8-1217-4824-86d0-e7a4dfbf8714 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:43.570766243 +0000 UTC m=+68.660046390 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls") pod "image-registry-84cc7589c4-w6jqn" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714") : secret "image-registry-tls" not found
Jul 13 21:22:27.672076 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.672042    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:27.672244 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:27.672168    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 21:22:27.672244 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:27.672227    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls podName:db616dd4-a0c5-4beb-8c07-95de1e4b51f1 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:43.67221212 +0000 UTC m=+68.761492271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls") pod "dns-default-qs8p2" (UID: "db616dd4-a0c5-4beb-8c07-95de1e4b51f1") : secret "dns-default-metrics-tls" not found
Jul 13 21:22:27.807717 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.807683    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:22:27.808108 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.808082    2575 scope.go:117] "RemoveContainer" containerID="f33f1cc30ea805f4284d865c3b3395f5d57fd17fc220a0f7a4109d92722eeda9"
Jul 13 21:22:27.808304 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:27.808278    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4s2vp_openshift-console-operator(fe01c8d4-4ca1-4a78-ba03-93c77e5ab482)\"" pod="openshift-console-operator/console-operator-7866497494-4s2vp" podUID="fe01c8d4-4ca1-4a78-ba03-93c77e5ab482"
Jul 13 21:22:27.809094 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:27.809064    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw" event={"ID":"d5b5a43d-4e87-46c8-9df3-c2ba39890cca","Type":"ContainerStarted","Data":"4ebf2e9088ffc5fad705963d8e459af907117d9470185d03f08b66f2f886cfdf"}
Jul 13 21:22:28.075839 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.075752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:28.075839 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.075829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:28.076053 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:28.075922    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 21:22:28.076053 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:28.075947    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 21:22:28.076053 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:28.076009    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls podName:8df1d10b-fd51-42f3-8df4-290226630026 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:30.07598386 +0000 UTC m=+55.165263998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4gw5" (UID: "8df1d10b-fd51-42f3-8df4-290226630026") : secret "insights-runtime-extractor-tls" not found
Jul 13 21:22:28.076053 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:28.076039    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm podName:8df1d10b-fd51-42f3-8df4-290226630026 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:30.076027511 +0000 UTC m=+55.165307647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z4gw5" (UID: "8df1d10b-fd51-42f3-8df4-290226630026") : configmap "kube-rbac-proxy" not found
Jul 13 21:22:28.114826 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.114795    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:28.114977 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.114874    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:28.747885 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.747864    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ntbrp_a3f84f41-9272-4f07-951f-8e5451436d80/node-ca/0.log"
Jul 13 21:22:28.813459 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.813431    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw" event={"ID":"d5b5a43d-4e87-46c8-9df3-c2ba39890cca","Type":"ContainerStarted","Data":"e68272599a376163cf97512e3bce2648a6b9baa71821015c6ade91fcf9efda50"}
Jul 13 21:22:28.813813 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.813794    2575 scope.go:117] "RemoveContainer" containerID="f33f1cc30ea805f4284d865c3b3395f5d57fd17fc220a0f7a4109d92722eeda9"
Jul 13 21:22:28.814004 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:28.813982    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4s2vp_openshift-console-operator(fe01c8d4-4ca1-4a78-ba03-93c77e5ab482)\"" pod="openshift-console-operator/console-operator-7866497494-4s2vp" podUID="fe01c8d4-4ca1-4a78-ba03-93c77e5ab482"
Jul 13 21:22:28.873616 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.873589    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-f9td8"]
Jul 13 21:22:28.896886 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.896854    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-f9td8"]
Jul 13 21:22:28.897019 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.896948    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:28.899674 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.899642    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 13 21:22:28.899785 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.899672    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5s2nd\""
Jul 13 21:22:28.899785 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.899680    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 13 21:22:28.900706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.900688    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 13 21:22:28.900788 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.900724    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 13 21:22:28.983541 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.983448    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5nbr\" (UniqueName: \"kubernetes.io/projected/adb53543-47ca-4f57-831d-5b912df4ff90-kube-api-access-t5nbr\") pod \"service-ca-79f68b9f4f-f9td8\" (UID: \"adb53543-47ca-4f57-831d-5b912df4ff90\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:28.983717 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.983613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/adb53543-47ca-4f57-831d-5b912df4ff90-signing-key\") pod \"service-ca-79f68b9f4f-f9td8\" (UID: \"adb53543-47ca-4f57-831d-5b912df4ff90\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:28.983717 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:28.983698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/adb53543-47ca-4f57-831d-5b912df4ff90-signing-cabundle\") pod \"service-ca-79f68b9f4f-f9td8\" (UID: \"adb53543-47ca-4f57-831d-5b912df4ff90\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:29.084488 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.084446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/adb53543-47ca-4f57-831d-5b912df4ff90-signing-cabundle\") pod \"service-ca-79f68b9f4f-f9td8\" (UID: \"adb53543-47ca-4f57-831d-5b912df4ff90\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:29.084655 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.084547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5nbr\" (UniqueName: \"kubernetes.io/projected/adb53543-47ca-4f57-831d-5b912df4ff90-kube-api-access-t5nbr\") pod \"service-ca-79f68b9f4f-f9td8\" (UID: \"adb53543-47ca-4f57-831d-5b912df4ff90\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:29.084712 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.084681    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/adb53543-47ca-4f57-831d-5b912df4ff90-signing-key\") pod \"service-ca-79f68b9f4f-f9td8\" (UID: \"adb53543-47ca-4f57-831d-5b912df4ff90\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:29.085087 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.085068    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/adb53543-47ca-4f57-831d-5b912df4ff90-signing-cabundle\") pod \"service-ca-79f68b9f4f-f9td8\" (UID: \"adb53543-47ca-4f57-831d-5b912df4ff90\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:29.087017 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.086995    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/adb53543-47ca-4f57-831d-5b912df4ff90-signing-key\") pod \"service-ca-79f68b9f4f-f9td8\" (UID: \"adb53543-47ca-4f57-831d-5b912df4ff90\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:29.092476 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.092456    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5nbr\" (UniqueName: \"kubernetes.io/projected/adb53543-47ca-4f57-831d-5b912df4ff90-kube-api-access-t5nbr\") pod \"service-ca-79f68b9f4f-f9td8\" (UID: \"adb53543-47ca-4f57-831d-5b912df4ff90\") " pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:29.148857 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.148819    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bl66_0cdb947b-b2b7-42ab-b5e7-7933641becf7/serve-healthcheck-canary/0.log"
Jul 13 21:22:29.206387 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.206321    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8"
Jul 13 21:22:29.347850 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.347822    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-f9td8"]
Jul 13 21:22:29.351012 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:29.350986    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb53543_47ca_4f57_831d_5b912df4ff90.slice/crio-d1ad51fe72dd5e9f868dbdcd4adb0ff63f2330f38775ebbacd83ce63ddd9d3c7 WatchSource:0}: Error finding container d1ad51fe72dd5e9f868dbdcd4adb0ff63f2330f38775ebbacd83ce63ddd9d3c7: Status 404 returned error can't find the container with id d1ad51fe72dd5e9f868dbdcd4adb0ff63f2330f38775ebbacd83ce63ddd9d3c7
Jul 13 21:22:29.818358 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.818307    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8" event={"ID":"adb53543-47ca-4f57-831d-5b912df4ff90","Type":"ContainerStarted","Data":"c7de5640b9c0bbc2a00f4d8d3decd37d35530998444b02a997a30c52886b3260"}
Jul 13 21:22:29.818814 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.818385    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8" event={"ID":"adb53543-47ca-4f57-831d-5b912df4ff90","Type":"ContainerStarted","Data":"d1ad51fe72dd5e9f868dbdcd4adb0ff63f2330f38775ebbacd83ce63ddd9d3c7"}
Jul 13 21:22:29.820003 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.819977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw" event={"ID":"d5b5a43d-4e87-46c8-9df3-c2ba39890cca","Type":"ContainerStarted","Data":"78f9473892c6dd0be3dac89a9d6578b63ec2d25b1cc39e8808b277ef59fd798a"}
Jul 13 21:22:29.834492 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.834452    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-f9td8" podStartSLOduration=1.834436424 podStartE2EDuration="1.834436424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:29.833670579 +0000 UTC m=+54.922950751" watchObservedRunningTime="2026-07-13 21:22:29.834436424 +0000 UTC m=+54.923716584"
Jul 13 21:22:29.848078 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:29.848037    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hkpzw" podStartSLOduration=2.2083824 podStartE2EDuration="3.848024023s" totalImagesPullingTime="1.639641623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:29.847086536 +0000 UTC m=+54.936366689" watchObservedRunningTime="2026-07-13 21:22:29.848024023 +0000 UTC m=+54.937304175"
Jul 13 21:22:30.095175 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:30.095084    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:30.095332 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:30.095268    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:30.095448 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:30.095428    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 21:22:30.095521 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:30.095495    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls podName:8df1d10b-fd51-42f3-8df4-290226630026 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:34.095479642 +0000 UTC m=+59.184759772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4gw5" (UID: "8df1d10b-fd51-42f3-8df4-290226630026") : secret "insights-runtime-extractor-tls" not found
Jul 13 21:22:30.095730 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:30.095707    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8df1d10b-fd51-42f3-8df4-290226630026-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:33.628728 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:33.628695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:33.629155 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:33.628756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:33.629155 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:33.628786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:33.629155 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:33.628811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:33.629155 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:33.628865    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:33.629155 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:33.628897    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 21:22:33.629155 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:33.628941    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:49.628927094 +0000 UTC m=+74.718207225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : secret "router-metrics-certs-default" not found
Jul 13 21:22:33.629155 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:33.628953    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls podName:25abff9a-a168-4b5d-81fd-ff850378dbf6 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:49.628947078 +0000 UTC m=+74.718227209 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-gxhht" (UID: "25abff9a-a168-4b5d-81fd-ff850378dbf6") : secret "cluster-monitoring-operator-tls" not found
Jul 13 21:22:33.629155 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:33.628962    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle podName:1e9dcb4a-fc5c-4225-8408-451aa5bf4b22 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:49.62895727 +0000 UTC m=+74.718237401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle") pod "router-default-6c7d7cf9fb-cs5pw" (UID: "1e9dcb4a-fc5c-4225-8408-451aa5bf4b22") : configmap references non-existent config key: service-ca.crt
Jul 13 21:22:33.631238 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:33.631218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c3821d0f-b34c-423a-bc4f-2243cb4a174c-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-gqkhs\" (UID: \"c3821d0f-b34c-423a-bc4f-2243cb4a174c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:33.650518 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:33.650496    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"
Jul 13 21:22:33.729836 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:33.729783    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:33.730439 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:33.730060    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 13 21:22:33.730439 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:33.730356    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert podName:ed0a11bd-06f9-4058-bd40-a411090cfc56 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:49.730317594 +0000 UTC m=+74.819597729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-rhbzx" (UID: "ed0a11bd-06f9-4058-bd40-a411090cfc56") : secret "networking-console-plugin-cert" not found
Jul 13 21:22:33.780172 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:33.780142    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs"]
Jul 13 21:22:33.834104 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:33.834073    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs" event={"ID":"c3821d0f-b34c-423a-bc4f-2243cb4a174c","Type":"ContainerStarted","Data":"6b5b3c18d8d5d5bbc7a6da704fb49900ceb00471ad794d00755f18a87ab524c0"}
Jul 13 21:22:34.133886 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:34.133846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:34.134037 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:34.134008    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 21:22:34.134097 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:34.134077    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls podName:8df1d10b-fd51-42f3-8df4-290226630026 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:42.134061157 +0000 UTC m=+67.223341288 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z4gw5" (UID: "8df1d10b-fd51-42f3-8df4-290226630026") : secret "insights-runtime-extractor-tls" not found
Jul 13 21:22:36.845449 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:36.845412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs" event={"ID":"c3821d0f-b34c-423a-bc4f-2243cb4a174c","Type":"ContainerStarted","Data":"05f0b5975263d728462b66f0ae68154c8f57e6a34585ed7aae1aca8c0f1ad383"}
Jul 13 21:22:36.845936 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:36.845463    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs" event={"ID":"c3821d0f-b34c-423a-bc4f-2243cb4a174c","Type":"ContainerStarted","Data":"ae2ba17249ece80b69449c4497b943b565b9134006828db873d9fff7d29f8066"}
Jul 13 21:22:36.863405 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:36.863332    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-gqkhs" podStartSLOduration=17.513961964 podStartE2EDuration="19.863317325s" totalImagesPullingTime="2.349355361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:36.862267508 +0000 UTC m=+61.951547663" watchObservedRunningTime="2026-07-13 21:22:36.863317325 +0000 UTC m=+61.952597501"
Jul 13 21:22:37.727546 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:37.727521    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-67fcq"
Jul 13 21:22:41.194063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.194023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:41.196924 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.196904    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 21:22:41.207578 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.207550    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b829c24-392e-4a3a-98fe-1c4003581195-metrics-certs\") pod \"network-metrics-daemon-hhrns\" (UID: \"3b829c24-392e-4a3a-98fe-1c4003581195\") " pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:41.287180 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.287146    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tk42z\""
Jul 13 21:22:41.294454 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.294431    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhrns"
Jul 13 21:22:41.294822 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.294805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:41.297493 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.297469    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 21:22:41.308476 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.308446    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e67ebcf-f921-48f9-a5e7-80e0012b81d9-original-pull-secret\") pod \"global-pull-secret-syncer-89tsm\" (UID: \"4e67ebcf-f921-48f9-a5e7-80e0012b81d9\") " pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:41.396066 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.396034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd4xh\" (UniqueName: \"kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh\") pod \"network-check-target-p45dw\" (UID: \"8ba8c95d-e476-4508-b7ca-1f1b701fb55a\") " pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:41.398653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.398625    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd4xh\" (UniqueName: \"kubernetes.io/projected/8ba8c95d-e476-4508-b7ca-1f1b701fb55a-kube-api-access-wd4xh\") pod \"network-check-target-p45dw\" (UID: \"8ba8c95d-e476-4508-b7ca-1f1b701fb55a\") " pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:41.425825 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.425788    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hhrns"]
Jul 13 21:22:41.428810 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:41.428787    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b829c24_392e_4a3a_98fe_1c4003581195.slice/crio-2196716dc062aa8b4227f15d462b13e038666bb71daed8c3cebe0302d55d9520 WatchSource:0}: Error finding container 2196716dc062aa8b4227f15d462b13e038666bb71daed8c3cebe0302d55d9520: Status 404 returned error can't find the container with id 2196716dc062aa8b4227f15d462b13e038666bb71daed8c3cebe0302d55d9520
Jul 13 21:22:41.579488 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.579460    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r54dj\""
Jul 13 21:22:41.586918 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.586898    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:41.590427 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.590403    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-89tsm"
Jul 13 21:22:41.726938 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.726898    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p45dw"]
Jul 13 21:22:41.729796 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:41.729765    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba8c95d_e476_4508_b7ca_1f1b701fb55a.slice/crio-4530bbf0d31d64ac159a1700d2c7ca3e8caa042bb44d6a703624c416ea5a6933 WatchSource:0}: Error finding container 4530bbf0d31d64ac159a1700d2c7ca3e8caa042bb44d6a703624c416ea5a6933: Status 404 returned error can't find the container with id 4530bbf0d31d64ac159a1700d2c7ca3e8caa042bb44d6a703624c416ea5a6933
Jul 13 21:22:41.742874 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.742837    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-89tsm"]
Jul 13 21:22:41.745709 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:41.745667    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e67ebcf_f921_48f9_a5e7_80e0012b81d9.slice/crio-126efef02f5fd0da281a51dc187dc78e6e694c209bed7d6a63251ba0783cddb1 WatchSource:0}: Error finding container 126efef02f5fd0da281a51dc187dc78e6e694c209bed7d6a63251ba0783cddb1: Status 404 returned error can't find the container with id 126efef02f5fd0da281a51dc187dc78e6e694c209bed7d6a63251ba0783cddb1
Jul 13 21:22:41.862521 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.862429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-89tsm" event={"ID":"4e67ebcf-f921-48f9-a5e7-80e0012b81d9","Type":"ContainerStarted","Data":"126efef02f5fd0da281a51dc187dc78e6e694c209bed7d6a63251ba0783cddb1"}
Jul 13 21:22:41.863690 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.863668    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hhrns" event={"ID":"3b829c24-392e-4a3a-98fe-1c4003581195","Type":"ContainerStarted","Data":"2196716dc062aa8b4227f15d462b13e038666bb71daed8c3cebe0302d55d9520"}
Jul 13 21:22:41.865128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.865101    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p45dw" event={"ID":"8ba8c95d-e476-4508-b7ca-1f1b701fb55a","Type":"ContainerStarted","Data":"0c90c6087a3afeec428500a0b4f3d5fc32977b6bfc96a451db1f449855c80f1e"}
Jul 13 21:22:41.865199 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.865142    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p45dw" event={"ID":"8ba8c95d-e476-4508-b7ca-1f1b701fb55a","Type":"ContainerStarted","Data":"4530bbf0d31d64ac159a1700d2c7ca3e8caa042bb44d6a703624c416ea5a6933"}
Jul 13 21:22:41.865263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.865231    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:22:41.883291 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:41.883234    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p45dw" podStartSLOduration=65.883216474 podStartE2EDuration="1m5.883216474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:41.882217637 +0000 UTC m=+66.971497808" watchObservedRunningTime="2026-07-13 21:22:41.883216474 +0000 UTC m=+66.972496624"
Jul 13 21:22:42.204165 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:42.204076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:42.206659 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:42.206638    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8df1d10b-fd51-42f3-8df4-290226630026-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z4gw5\" (UID: \"8df1d10b-fd51-42f3-8df4-290226630026\") " pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:42.276011 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:42.275977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fxsvw\""
Jul 13 21:22:42.284260 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:42.284236    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z4gw5"
Jul 13 21:22:42.459922 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:42.459824    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z4gw5"]
Jul 13 21:22:42.586638 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:42.586591    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df1d10b_fd51_42f3_8df4_290226630026.slice/crio-ceebab6168c53187e4ef113c4097c92956592f690cabbd77cf8d17788c86a416 WatchSource:0}: Error finding container ceebab6168c53187e4ef113c4097c92956592f690cabbd77cf8d17788c86a416: Status 404 returned error can't find the container with id ceebab6168c53187e4ef113c4097c92956592f690cabbd77cf8d17788c86a416
Jul 13 21:22:42.872003 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:42.871966    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hhrns" event={"ID":"3b829c24-392e-4a3a-98fe-1c4003581195","Type":"ContainerStarted","Data":"e28b3389340531e4551cec69f1baef4d9f5a164e4f95a887e57ca23c6e25db4d"}
Jul 13 21:22:42.872198 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:42.872035    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hhrns" event={"ID":"3b829c24-392e-4a3a-98fe-1c4003581195","Type":"ContainerStarted","Data":"0f34b1a13d433758aa1db2a9cedd6a9ee6672f8b8346f7e7c5bbfdb4943efb15"}
Jul 13 21:22:42.873584 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:42.873552    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4gw5" event={"ID":"8df1d10b-fd51-42f3-8df4-290226630026","Type":"ContainerStarted","Data":"ceebab6168c53187e4ef113c4097c92956592f690cabbd77cf8d17788c86a416"}
Jul 13 21:22:42.889159 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:42.889102    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hhrns" podStartSLOduration=65.706176085 podStartE2EDuration="1m6.889083552s" totalImagesPullingTime="1.182907467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:42.887604275 +0000 UTC m=+67.976884453" watchObservedRunningTime="2026-07-13 21:22:42.889083552 +0000 UTC m=+67.978363709"
Jul 13 21:22:43.463866 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.463834    2575 scope.go:117] "RemoveContainer" containerID="f33f1cc30ea805f4284d865c3b3395f5d57fd17fc220a0f7a4109d92722eeda9"
Jul 13 21:22:43.618116 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.617380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:43.621796 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.621763    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") pod \"image-registry-84cc7589c4-w6jqn\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") " pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:43.718220 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.718136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:43.721013 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.720982    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db616dd4-a0c5-4beb-8c07-95de1e4b51f1-metrics-tls\") pod \"dns-default-qs8p2\" (UID: \"db616dd4-a0c5-4beb-8c07-95de1e4b51f1\") " pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:43.834449 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.834408    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-58sx4\""
Jul 13 21:22:43.841732 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.841692    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:43.855284 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.855259    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d9ws2\""
Jul 13 21:22:43.862662 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.862628    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:43.880535 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.880505    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:22:43.880707 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.880622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4s2vp" event={"ID":"fe01c8d4-4ca1-4a78-ba03-93c77e5ab482","Type":"ContainerStarted","Data":"4d87e5916a51cff46419ce31620e132bc4f2d2a743ad4a3ace9d7c139ea38f29"}
Jul 13 21:22:43.881358 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.881317    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:43.905769 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:43.904979    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-4s2vp" podStartSLOduration=20.360000516 podStartE2EDuration="26.904954348s" totalImagesPullingTime="6.544953832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:43.903757746 +0000 UTC m=+68.993037921" watchObservedRunningTime="2026-07-13 21:22:43.904954348 +0000 UTC m=+68.994234501"
Jul 13 21:22:44.011518 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:44.011482    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84cc7589c4-w6jqn"]
Jul 13 21:22:44.015700 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:44.013865    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb61797e8_1217_4824_86d0_e7a4dfbf8714.slice/crio-9367c00ab8443d68270bc817114d6a51635413711b132732bae38df6eb5adf5c WatchSource:0}: Error finding container 9367c00ab8443d68270bc817114d6a51635413711b132732bae38df6eb5adf5c: Status 404 returned error can't find the container with id 9367c00ab8443d68270bc817114d6a51635413711b132732bae38df6eb5adf5c
Jul 13 21:22:44.031121 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:44.031096    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qs8p2"]
Jul 13 21:22:44.034384 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:44.034333    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb616dd4_a0c5_4beb_8c07_95de1e4b51f1.slice/crio-6b65536cb6bf8845004ac91e364725e4cd0435ff42fbd3ad07fd6da0f7661296 WatchSource:0}: Error finding container 6b65536cb6bf8845004ac91e364725e4cd0435ff42fbd3ad07fd6da0f7661296: Status 404 returned error can't find the container with id 6b65536cb6bf8845004ac91e364725e4cd0435ff42fbd3ad07fd6da0f7661296
Jul 13 21:22:44.517525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:44.517231    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-4s2vp"
Jul 13 21:22:44.888448 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:44.888405    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn" event={"ID":"b61797e8-1217-4824-86d0-e7a4dfbf8714","Type":"ContainerStarted","Data":"1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a"}
Jul 13 21:22:44.888633 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:44.888473    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn" event={"ID":"b61797e8-1217-4824-86d0-e7a4dfbf8714","Type":"ContainerStarted","Data":"9367c00ab8443d68270bc817114d6a51635413711b132732bae38df6eb5adf5c"}
Jul 13 21:22:44.888633 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:44.888497    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:22:44.890095 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:44.890060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qs8p2" event={"ID":"db616dd4-a0c5-4beb-8c07-95de1e4b51f1","Type":"ContainerStarted","Data":"6b65536cb6bf8845004ac91e364725e4cd0435ff42fbd3ad07fd6da0f7661296"}
Jul 13 21:22:44.912196 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:44.912136    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn" podStartSLOduration=68.912111251 podStartE2EDuration="1m8.912111251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:44.911640574 +0000 UTC m=+70.000920753" watchObservedRunningTime="2026-07-13 21:22:44.912111251 +0000 UTC m=+70.001391405"
Jul 13 21:22:49.678357 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.678295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:49.678357 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.678361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:49.678873 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.678401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:49.679245 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.679215    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-service-ca-bundle\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:49.681111 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.681083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/25abff9a-a168-4b5d-81fd-ff850378dbf6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-gxhht\" (UID: \"25abff9a-a168-4b5d-81fd-ff850378dbf6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:49.681236 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.681166    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1e9dcb4a-fc5c-4225-8408-451aa5bf4b22-metrics-certs\") pod \"router-default-6c7d7cf9fb-cs5pw\" (UID: \"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22\") " pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:49.779248 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.779220    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:49.781611 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.781588    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ed0a11bd-06f9-4058-bd40-a411090cfc56-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-rhbzx\" (UID: \"ed0a11bd-06f9-4058-bd40-a411090cfc56\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:49.833365 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.833305    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pslhm\""
Jul 13 21:22:49.841427 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.841406    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"
Jul 13 21:22:49.867543 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.867515    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g2j29\""
Jul 13 21:22:49.875046 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.875017    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:49.913470 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.913429    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4gw5" event={"ID":"8df1d10b-fd51-42f3-8df4-290226630026","Type":"ContainerStarted","Data":"f782f64dbf79b322cf07a767423cd8e54f2ef82386b89cd94ece75a5291fe713"}
Jul 13 21:22:49.913617 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.913510    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4gw5" event={"ID":"8df1d10b-fd51-42f3-8df4-290226630026","Type":"ContainerStarted","Data":"a475b24efc2db01c48056b519cbceff215a980c06b4c2c71cd835371102dfcff"}
Jul 13 21:22:49.915699 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.915610    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qs8p2" event={"ID":"db616dd4-a0c5-4beb-8c07-95de1e4b51f1","Type":"ContainerStarted","Data":"76733d898a8e0096752f4e3f5284fe2928b506a17c29b34254385a8033496297"}
Jul 13 21:22:49.915699 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.915671    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qs8p2" event={"ID":"db616dd4-a0c5-4beb-8c07-95de1e4b51f1","Type":"ContainerStarted","Data":"69f7f63ec9462884109dfec472dcbf71609328799059167955e9bcb2ab2c2801"}
Jul 13 21:22:49.916255 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.915990    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:22:49.917990 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.917962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-89tsm" event={"ID":"4e67ebcf-f921-48f9-a5e7-80e0012b81d9","Type":"ContainerStarted","Data":"bc76b5714ede493377539a0aae2ea5bd54550b2fd171f0aeb94af4a0a03287d7"}
Jul 13 21:22:49.937307 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.936657    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qs8p2" podStartSLOduration=33.948884254 podStartE2EDuration="38.936636294s" totalImagesPullingTime="4.98775204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:49.936227967 +0000 UTC m=+75.025508121" watchObservedRunningTime="2026-07-13 21:22:49.936636294 +0000 UTC m=+75.025916443"
Jul 13 21:22:49.953867 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.953808    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-89tsm" podStartSLOduration=66.68323835 podStartE2EDuration="1m13.953788997s" totalImagesPullingTime="7.270550647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:49.953071309 +0000 UTC m=+75.042351463" watchObservedRunningTime="2026-07-13 21:22:49.953788997 +0000 UTC m=+75.043069151"
Jul 13 21:22:49.964241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.964026    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7mxdk\""
Jul 13 21:22:49.972220 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.972191    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"
Jul 13 21:22:49.981301 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:49.981272    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht"]
Jul 13 21:22:49.983942 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:49.983883    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25abff9a_a168_4b5d_81fd_ff850378dbf6.slice/crio-18ab3afa99688dd513d159d7de310f09536b789e61c2b32975393c31bcb29e6e WatchSource:0}: Error finding container 18ab3afa99688dd513d159d7de310f09536b789e61c2b32975393c31bcb29e6e: Status 404 returned error can't find the container with id 18ab3afa99688dd513d159d7de310f09536b789e61c2b32975393c31bcb29e6e
Jul 13 21:22:50.020824 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:50.020625    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c7d7cf9fb-cs5pw"]
Jul 13 21:22:50.023411 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:50.023386    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9dcb4a_fc5c_4225_8408_451aa5bf4b22.slice/crio-a4ff46f80475e79c35186bd37d5a0052e59c22fcef0454319ad684e977c07151 WatchSource:0}: Error finding container a4ff46f80475e79c35186bd37d5a0052e59c22fcef0454319ad684e977c07151: Status 404 returned error can't find the container with id a4ff46f80475e79c35186bd37d5a0052e59c22fcef0454319ad684e977c07151
Jul 13 21:22:50.110281 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:50.110251    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-rhbzx"]
Jul 13 21:22:50.113482 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:50.113450    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0a11bd_06f9_4058_bd40_a411090cfc56.slice/crio-93d91147467c554a405533292df2609c96b759fe4cf0749eecea3d539143196d WatchSource:0}: Error finding container 93d91147467c554a405533292df2609c96b759fe4cf0749eecea3d539143196d: Status 404 returned error can't find the container with id 93d91147467c554a405533292df2609c96b759fe4cf0749eecea3d539143196d
Jul 13 21:22:50.925590 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:50.925433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw" event={"ID":"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22","Type":"ContainerStarted","Data":"326c4042d02860abdd8745cc0883d970c7f1ab0854bef8aee874156eefce11ef"}
Jul 13 21:22:50.925590 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:50.925497    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw" event={"ID":"1e9dcb4a-fc5c-4225-8408-451aa5bf4b22","Type":"ContainerStarted","Data":"a4ff46f80475e79c35186bd37d5a0052e59c22fcef0454319ad684e977c07151"}
Jul 13 21:22:50.928033 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:50.927956    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht" event={"ID":"25abff9a-a168-4b5d-81fd-ff850378dbf6","Type":"ContainerStarted","Data":"18ab3afa99688dd513d159d7de310f09536b789e61c2b32975393c31bcb29e6e"}
Jul 13 21:22:50.930617 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:50.930153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx" event={"ID":"ed0a11bd-06f9-4058-bd40-a411090cfc56","Type":"ContainerStarted","Data":"93d91147467c554a405533292df2609c96b759fe4cf0749eecea3d539143196d"}
Jul 13 21:22:51.798300 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.798238    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw" podStartSLOduration=34.798214429 podStartE2EDuration="34.798214429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:50.951766982 +0000 UTC m=+76.041047136" watchObservedRunningTime="2026-07-13 21:22:51.798214429 +0000 UTC m=+76.887494617"
Jul 13 21:22:51.799722 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.799690    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"]
Jul 13 21:22:51.803060 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.802970    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"]
Jul 13 21:22:51.803230 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.803061    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"
Jul 13 21:22:51.806366 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.806324    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:51.807592 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.807568    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 21:22:51.807708 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.807641    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-br6mc\""
Jul 13 21:22:51.807899 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.807881    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 21:22:51.808753 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.808732    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 13 21:22:51.808753 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.808729    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 21:22:51.810889 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.810775    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 13 21:22:51.811167 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.811146    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 13 21:22:51.811399 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.811382    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 13 21:22:51.811476 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.811399    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 13 21:22:51.820358 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.820310    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"]
Jul 13 21:22:51.823112 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.822031    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"]
Jul 13 21:22:51.827752 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.826774    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"]
Jul 13 21:22:51.827752 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.826893    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:51.831119 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.831094    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 13 21:22:51.853706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.853661    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"]
Jul 13 21:22:51.876049 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.876011    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:51.878925 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.878899    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:51.902662 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.902628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9b0e69c8-8a6c-48b7-8540-e6efde1dd028-klusterlet-config\") pod \"klusterlet-addon-workmgr-76b7985d4f-xqqc9\" (UID: \"9b0e69c8-8a6c-48b7-8540-e6efde1dd028\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:51.902662 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.902670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:51.902886 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.902702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28jdc\" (UniqueName: \"kubernetes.io/projected/13a6d918-eed6-4b27-aa8a-7eabe47daaf3-kube-api-access-28jdc\") pod \"managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44\" (UID: \"13a6d918-eed6-4b27-aa8a-7eabe47daaf3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"
Jul 13 21:22:51.902886 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.902725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-hub\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:51.902886 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.902750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch4kt\" (UniqueName: \"kubernetes.io/projected/33a88660-7119-4ad8-8f7e-50478c1b9bd6-kube-api-access-ch4kt\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:51.903042 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.902882    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a88660-7119-4ad8-8f7e-50478c1b9bd6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:51.903042 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.902934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b0e69c8-8a6c-48b7-8540-e6efde1dd028-tmp\") pod \"klusterlet-addon-workmgr-76b7985d4f-xqqc9\" (UID: \"9b0e69c8-8a6c-48b7-8540-e6efde1dd028\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:51.903042 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.903017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tr45\" (UniqueName: \"kubernetes.io/projected/9b0e69c8-8a6c-48b7-8540-e6efde1dd028-kube-api-access-7tr45\") pod \"klusterlet-addon-workmgr-76b7985d4f-xqqc9\" (UID: \"9b0e69c8-8a6c-48b7-8540-e6efde1dd028\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:51.903183 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.903063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:51.903183 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.903095    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13a6d918-eed6-4b27-aa8a-7eabe47daaf3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44\" (UID: \"13a6d918-eed6-4b27-aa8a-7eabe47daaf3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"
Jul 13 21:22:51.903183 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.903143    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-ca\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:51.934614 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.934527    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:51.935119 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.935097    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-ldhch"]
Jul 13 21:22:51.939658 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.939635    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c7d7cf9fb-cs5pw"
Jul 13 21:22:51.939787 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.939713    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-ldhch"
Jul 13 21:22:51.943841 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.943814    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 21:22:51.944167 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.943850    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 21:22:51.944594 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.944571    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bq6rv\""
Jul 13 21:22:51.961046 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:51.961018    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-ldhch"]
Jul 13 21:22:52.003928 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.003897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b0e69c8-8a6c-48b7-8540-e6efde1dd028-tmp\") pod \"klusterlet-addon-workmgr-76b7985d4f-xqqc9\" (UID: \"9b0e69c8-8a6c-48b7-8540-e6efde1dd028\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:52.003928 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.003941    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tr45\" (UniqueName: \"kubernetes.io/projected/9b0e69c8-8a6c-48b7-8540-e6efde1dd028-kube-api-access-7tr45\") pod \"klusterlet-addon-workmgr-76b7985d4f-xqqc9\" (UID: \"9b0e69c8-8a6c-48b7-8540-e6efde1dd028\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:52.004180 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.003969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.004180 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.004068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13a6d918-eed6-4b27-aa8a-7eabe47daaf3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44\" (UID: \"13a6d918-eed6-4b27-aa8a-7eabe47daaf3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"
Jul 13 21:22:52.004180 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.004116    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-ca\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.004353 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.004190    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppslj\" (UniqueName: \"kubernetes.io/projected/ed09acd4-0a9b-4e4b-b72c-335b78fc60c1-kube-api-access-ppslj\") pod \"downloads-68c9cbb497-ldhch\" (UID: \"ed09acd4-0a9b-4e4b-b72c-335b78fc60c1\") " pod="openshift-console/downloads-68c9cbb497-ldhch"
Jul 13 21:22:52.004353 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.004266    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9b0e69c8-8a6c-48b7-8540-e6efde1dd028-klusterlet-config\") pod \"klusterlet-addon-workmgr-76b7985d4f-xqqc9\" (UID: \"9b0e69c8-8a6c-48b7-8540-e6efde1dd028\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:52.004353 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.004310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.004585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.004358    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b0e69c8-8a6c-48b7-8540-e6efde1dd028-tmp\") pod \"klusterlet-addon-workmgr-76b7985d4f-xqqc9\" (UID: \"9b0e69c8-8a6c-48b7-8540-e6efde1dd028\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:52.004585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.004375    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28jdc\" (UniqueName: \"kubernetes.io/projected/13a6d918-eed6-4b27-aa8a-7eabe47daaf3-kube-api-access-28jdc\") pod \"managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44\" (UID: \"13a6d918-eed6-4b27-aa8a-7eabe47daaf3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"
Jul 13 21:22:52.004585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.004402    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-hub\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.004585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.004424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch4kt\" (UniqueName: \"kubernetes.io/projected/33a88660-7119-4ad8-8f7e-50478c1b9bd6-kube-api-access-ch4kt\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.004585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.004472    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a88660-7119-4ad8-8f7e-50478c1b9bd6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.005434 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.005390    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a88660-7119-4ad8-8f7e-50478c1b9bd6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.007525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.007482    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.007838 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.007780    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.007838 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.007809    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-hub\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.007838 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.007819    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13a6d918-eed6-4b27-aa8a-7eabe47daaf3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44\" (UID: \"13a6d918-eed6-4b27-aa8a-7eabe47daaf3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"
Jul 13 21:22:52.008059 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.007989    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9b0e69c8-8a6c-48b7-8540-e6efde1dd028-klusterlet-config\") pod \"klusterlet-addon-workmgr-76b7985d4f-xqqc9\" (UID: \"9b0e69c8-8a6c-48b7-8540-e6efde1dd028\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:52.008911 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.008888    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/33a88660-7119-4ad8-8f7e-50478c1b9bd6-ca\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.023566 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.023536    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch4kt\" (UniqueName: \"kubernetes.io/projected/33a88660-7119-4ad8-8f7e-50478c1b9bd6-kube-api-access-ch4kt\") pod \"cluster-proxy-proxy-agent-5fb75b4795-zztcm\" (UID: \"33a88660-7119-4ad8-8f7e-50478c1b9bd6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.023765 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.023737    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tr45\" (UniqueName: \"kubernetes.io/projected/9b0e69c8-8a6c-48b7-8540-e6efde1dd028-kube-api-access-7tr45\") pod \"klusterlet-addon-workmgr-76b7985d4f-xqqc9\" (UID: \"9b0e69c8-8a6c-48b7-8540-e6efde1dd028\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:52.024320 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.024295    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28jdc\" (UniqueName: \"kubernetes.io/projected/13a6d918-eed6-4b27-aa8a-7eabe47daaf3-kube-api-access-28jdc\") pod \"managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44\" (UID: \"13a6d918-eed6-4b27-aa8a-7eabe47daaf3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"
Jul 13 21:22:52.105148 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.105107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppslj\" (UniqueName: \"kubernetes.io/projected/ed09acd4-0a9b-4e4b-b72c-335b78fc60c1-kube-api-access-ppslj\") pod \"downloads-68c9cbb497-ldhch\" (UID: \"ed09acd4-0a9b-4e4b-b72c-335b78fc60c1\") " pod="openshift-console/downloads-68c9cbb497-ldhch"
Jul 13 21:22:52.128209 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.128145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppslj\" (UniqueName: \"kubernetes.io/projected/ed09acd4-0a9b-4e4b-b72c-335b78fc60c1-kube-api-access-ppslj\") pod \"downloads-68c9cbb497-ldhch\" (UID: \"ed09acd4-0a9b-4e4b-b72c-335b78fc60c1\") " pod="openshift-console/downloads-68c9cbb497-ldhch"
Jul 13 21:22:52.129831 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.129796    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"
Jul 13 21:22:52.136785 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.136742    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"
Jul 13 21:22:52.153722 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.153684    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:22:52.251358 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:52.251315    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-ldhch"
Jul 13 21:22:53.298490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.298461    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-ldhch"]
Jul 13 21:22:53.300611 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:53.300585    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded09acd4_0a9b_4e4b_b72c_335b78fc60c1.slice/crio-5726835bc1564589597e9faee8c0c8e928ea996af2c5737afb2ecff4e2210547 WatchSource:0}: Error finding container 5726835bc1564589597e9faee8c0c8e928ea996af2c5737afb2ecff4e2210547: Status 404 returned error can't find the container with id 5726835bc1564589597e9faee8c0c8e928ea996af2c5737afb2ecff4e2210547
Jul 13 21:22:53.532412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.532376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"]
Jul 13 21:22:53.537327 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.537176    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44"]
Jul 13 21:22:53.537461 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:53.537369    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b0e69c8_8a6c_48b7_8540_e6efde1dd028.slice/crio-d6578f75d70381a06b2d7fcdfec0e05852fd5fa407f52d3eae885eff4f463e08 WatchSource:0}: Error finding container d6578f75d70381a06b2d7fcdfec0e05852fd5fa407f52d3eae885eff4f463e08: Status 404 returned error can't find the container with id d6578f75d70381a06b2d7fcdfec0e05852fd5fa407f52d3eae885eff4f463e08
Jul 13 21:22:53.538930 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.538905    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm"]
Jul 13 21:22:53.540429 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:53.540407    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13a6d918_eed6_4b27_aa8a_7eabe47daaf3.slice/crio-f5cf45d23e4896cedf5c01c5bdfbbe204ce787ba86aabdbe89e3a8efec1599f2 WatchSource:0}: Error finding container f5cf45d23e4896cedf5c01c5bdfbbe204ce787ba86aabdbe89e3a8efec1599f2: Status 404 returned error can't find the container with id f5cf45d23e4896cedf5c01c5bdfbbe204ce787ba86aabdbe89e3a8efec1599f2
Jul 13 21:22:53.540932 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:53.540904    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33a88660_7119_4ad8_8f7e_50478c1b9bd6.slice/crio-8bfebb3fa7312901a9f3fc0445d4da96662052c00212dbd0259a8ab5ad45e579 WatchSource:0}: Error finding container 8bfebb3fa7312901a9f3fc0445d4da96662052c00212dbd0259a8ab5ad45e579: Status 404 returned error can't find the container with id 8bfebb3fa7312901a9f3fc0445d4da96662052c00212dbd0259a8ab5ad45e579
Jul 13 21:22:53.715976 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.715888    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"]
Jul 13 21:22:53.744188 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.744157    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"]
Jul 13 21:22:53.744367 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.744270    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"
Jul 13 21:22:53.747206 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.747182    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 13 21:22:53.747333 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.747247    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dghr4\""
Jul 13 21:22:53.818999 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.818965    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34aedcdf-76ca-4216-9208-ee76f69057f8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-2br7n\" (UID: \"34aedcdf-76ca-4216-9208-ee76f69057f8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"
Jul 13 21:22:53.919607 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.919569    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34aedcdf-76ca-4216-9208-ee76f69057f8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-2br7n\" (UID: \"34aedcdf-76ca-4216-9208-ee76f69057f8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"
Jul 13 21:22:53.919781 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:53.919746    2575 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 13 21:22:53.919848 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:22:53.919834    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34aedcdf-76ca-4216-9208-ee76f69057f8-tls-certificates podName:34aedcdf-76ca-4216-9208-ee76f69057f8 nodeName:}" failed. No retries permitted until 2026-07-13 21:22:54.419809662 +0000 UTC m=+79.509089798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/34aedcdf-76ca-4216-9208-ee76f69057f8-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-2br7n" (UID: "34aedcdf-76ca-4216-9208-ee76f69057f8") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 13 21:22:53.946217 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.946155    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z4gw5" event={"ID":"8df1d10b-fd51-42f3-8df4-290226630026","Type":"ContainerStarted","Data":"01a96c840fb7c2b6caab768e48e65bbda912a590323748f2b6b350cc0b100c6f"}
Jul 13 21:22:53.948631 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.948599    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-ldhch" event={"ID":"ed09acd4-0a9b-4e4b-b72c-335b78fc60c1","Type":"ContainerStarted","Data":"5726835bc1564589597e9faee8c0c8e928ea996af2c5737afb2ecff4e2210547"}
Jul 13 21:22:53.950409 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.950377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht" event={"ID":"25abff9a-a168-4b5d-81fd-ff850378dbf6","Type":"ContainerStarted","Data":"9bd157160e1389e94d902664e55bbd366db75e3b0196327d52871e3c59214959"}
Jul 13 21:22:53.953007 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.952945    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx" event={"ID":"ed0a11bd-06f9-4058-bd40-a411090cfc56","Type":"ContainerStarted","Data":"06b18d9a816408677b92d8b70fc9dbfbd90f0e46c69954473b4e3e6481d4ea67"}
Jul 13 21:22:53.954184 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.954161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm" event={"ID":"33a88660-7119-4ad8-8f7e-50478c1b9bd6","Type":"ContainerStarted","Data":"8bfebb3fa7312901a9f3fc0445d4da96662052c00212dbd0259a8ab5ad45e579"}
Jul 13 21:22:53.955501 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.955474    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44" event={"ID":"13a6d918-eed6-4b27-aa8a-7eabe47daaf3","Type":"ContainerStarted","Data":"f5cf45d23e4896cedf5c01c5bdfbbe204ce787ba86aabdbe89e3a8efec1599f2"}
Jul 13 21:22:53.956820 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.956777    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9" event={"ID":"9b0e69c8-8a6c-48b7-8540-e6efde1dd028","Type":"ContainerStarted","Data":"d6578f75d70381a06b2d7fcdfec0e05852fd5fa407f52d3eae885eff4f463e08"}
Jul 13 21:22:53.970807 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.970567    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z4gw5" podStartSLOduration=17.575989777 podStartE2EDuration="27.970550828s" totalImagesPullingTime="10.394561051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:22:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:53.969076944 +0000 UTC m=+79.058357119" watchObservedRunningTime="2026-07-13 21:22:53.970550828 +0000 UTC m=+79.059830981"
Jul 13 21:22:53.992278 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:53.992221    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-gxhht" podStartSLOduration=33.87823508 podStartE2EDuration="36.99219782s" totalImagesPullingTime="3.11396274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:53.991771592 +0000 UTC m=+79.081051749" watchObservedRunningTime="2026-07-13 21:22:53.99219782 +0000 UTC m=+79.081477975"
Jul 13 21:22:54.011225 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.011169    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-rhbzx" podStartSLOduration=34.03358597 podStartE2EDuration="37.011150633s" totalImagesPullingTime="2.977564663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:22:54.009402988 +0000 UTC m=+79.098683169" watchObservedRunningTime="2026-07-13 21:22:54.011150633 +0000 UTC m=+79.100430787"
Jul 13 21:22:54.053491 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.053448    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7694846786-jr2vc"]
Jul 13 21:22:54.069891 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.069801    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.073359 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.073310    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 21:22:54.073510 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.073475    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 21:22:54.073585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.073326    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 21:22:54.073760 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.073731    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k8mjg\""
Jul 13 21:22:54.073868 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.073799    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 21:22:54.075983 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.075925    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 21:22:54.089242 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.089208    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7694846786-jr2vc"]
Jul 13 21:22:54.121496 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.121463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-service-ca\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.121694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.121551    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-oauth-serving-cert\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.121694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.121577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qc84\" (UniqueName: \"kubernetes.io/projected/be9cf85d-e710-430f-a142-9e4909fca420-kube-api-access-2qc84\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.121694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.121661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-oauth-config\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.121872 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.121766    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-serving-cert\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.121872 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.121861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-console-config\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.222995 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.222905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-serving-cert\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.222995 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.222961    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-console-config\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.222995 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.222991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-service-ca\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.223246 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.223043    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-oauth-serving-cert\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.223246 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.223073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qc84\" (UniqueName: \"kubernetes.io/projected/be9cf85d-e710-430f-a142-9e4909fca420-kube-api-access-2qc84\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.223246 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.223119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-oauth-config\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.224472 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.224136    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-service-ca\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.224472 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.224463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-console-config\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.224746 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.224724    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-oauth-serving-cert\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.226587 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.226543    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-oauth-config\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.229000 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.228954    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-serving-cert\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.234169 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.234124    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qc84\" (UniqueName: \"kubernetes.io/projected/be9cf85d-e710-430f-a142-9e4909fca420-kube-api-access-2qc84\") pod \"console-7694846786-jr2vc\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") " pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.383329 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.383286    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:22:54.425731 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.425684    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34aedcdf-76ca-4216-9208-ee76f69057f8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-2br7n\" (UID: \"34aedcdf-76ca-4216-9208-ee76f69057f8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"
Jul 13 21:22:54.429849 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.429791    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/34aedcdf-76ca-4216-9208-ee76f69057f8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-2br7n\" (UID: \"34aedcdf-76ca-4216-9208-ee76f69057f8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"
Jul 13 21:22:54.590115 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.590086    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7694846786-jr2vc"]
Jul 13 21:22:54.593663 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:22:54.593632    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe9cf85d_e710_430f_a142_9e4909fca420.slice/crio-4745f940eb00408ed9f1ba0fff80322e7db6a6a7a153f2f220b5b36bc263b042 WatchSource:0}: Error finding container 4745f940eb00408ed9f1ba0fff80322e7db6a6a7a153f2f220b5b36bc263b042: Status 404 returned error can't find the container with id 4745f940eb00408ed9f1ba0fff80322e7db6a6a7a153f2f220b5b36bc263b042
Jul 13 21:22:54.653783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.653457    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"
Jul 13 21:22:54.891164 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.891008    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"]
Jul 13 21:22:54.966056 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.965970    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n" event={"ID":"34aedcdf-76ca-4216-9208-ee76f69057f8","Type":"ContainerStarted","Data":"960522c97da436573c798c1b2c9c80680e8c3bc7397f58456172f4eb0c39754e"}
Jul 13 21:22:54.969943 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:54.969881    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7694846786-jr2vc" event={"ID":"be9cf85d-e710-430f-a142-9e4909fca420","Type":"ContainerStarted","Data":"4745f940eb00408ed9f1ba0fff80322e7db6a6a7a153f2f220b5b36bc263b042"}
Jul 13 21:22:59.933241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:22:59.932642    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qs8p2"
Jul 13 21:23:03.028654 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.028564    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm" event={"ID":"33a88660-7119-4ad8-8f7e-50478c1b9bd6","Type":"ContainerStarted","Data":"a30607000365fae62b6ab3de0d19c7ac1dc5f201f1b416f592251408eb20320e"}
Jul 13 21:23:03.028654 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.028613    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm" event={"ID":"33a88660-7119-4ad8-8f7e-50478c1b9bd6","Type":"ContainerStarted","Data":"310ac8fb85e01779c19934e96cb30aa73354e0c0d1af5fa9ffd7249895550709"}
Jul 13 21:23:03.028654 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.028631    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm" event={"ID":"33a88660-7119-4ad8-8f7e-50478c1b9bd6","Type":"ContainerStarted","Data":"725c504b03b69751c87d106902b066cf9fed3909e4947192bab3c0f26b0099c7"}
Jul 13 21:23:03.030757 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.030726    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44" event={"ID":"13a6d918-eed6-4b27-aa8a-7eabe47daaf3","Type":"ContainerStarted","Data":"0aa12bd8a55580a8e3d1e5132e5e9cfda66abfbb9761d392b4b9fc2cc770a3de"}
Jul 13 21:23:03.032396 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.032368    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9" event={"ID":"9b0e69c8-8a6c-48b7-8540-e6efde1dd028","Type":"ContainerStarted","Data":"fd3f62fdda93a5d826a454a18d476e534f799292b8b5582466bf9f1b33b301cd"}
Jul 13 21:23:03.032593 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.032554    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:23:03.034536 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.034516    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9"
Jul 13 21:23:03.034962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.034937    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n" event={"ID":"34aedcdf-76ca-4216-9208-ee76f69057f8","Type":"ContainerStarted","Data":"8963d4d9a779ca7b9402fc78c09ca3bf9734360735e10a04d79dfa382a4d61c7"}
Jul 13 21:23:03.035047 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.034985    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"
Jul 13 21:23:03.037173 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.037132    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7694846786-jr2vc" event={"ID":"be9cf85d-e710-430f-a142-9e4909fca420","Type":"ContainerStarted","Data":"02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c"}
Jul 13 21:23:03.040397 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.040374    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n"
Jul 13 21:23:03.050465 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.050410    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb75b4795-zztcm" podStartSLOduration=3.008817249 podStartE2EDuration="12.050388705s" totalImagesPullingTime="9.041571456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:03.048061968 +0000 UTC m=+88.137342124" watchObservedRunningTime="2026-07-13 21:23:03.050388705 +0000 UTC m=+88.139668859"
Jul 13 21:23:03.066861 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.066806    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7694846786-jr2vc" podStartSLOduration=1.09675687 podStartE2EDuration="9.066788445s" totalImagesPullingTime="7.970031575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:03.065141511 +0000 UTC m=+88.154421691" watchObservedRunningTime="2026-07-13 21:23:03.066788445 +0000 UTC m=+88.156068603"
Jul 13 21:23:03.083769 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.083697    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fc5f96d5b-xnn44" podStartSLOduration=3.064593342 podStartE2EDuration="12.083678898s" totalImagesPullingTime="9.019085556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:03.082510191 +0000 UTC m=+88.171790345" watchObservedRunningTime="2026-07-13 21:23:03.083678898 +0000 UTC m=+88.172959050"
Jul 13 21:23:03.099751 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.099696    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-2br7n" podStartSLOduration=2.440631174 podStartE2EDuration="10.099677848s" totalImagesPullingTime="7.659046674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:03.098923882 +0000 UTC m=+88.188204040" watchObservedRunningTime="2026-07-13 21:23:03.099677848 +0000 UTC m=+88.188958004"
Jul 13 21:23:03.116700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.115461    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76b7985d4f-xqqc9" podStartSLOduration=3.081789659 podStartE2EDuration="12.115439666s" totalImagesPullingTime="9.033650007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:03.114577408 +0000 UTC m=+88.203857561" watchObservedRunningTime="2026-07-13 21:23:03.115439666 +0000 UTC m=+88.204719821"
Jul 13 21:23:03.847618 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.847573    2575 patch_prober.go:28] interesting pod/image-registry-84cc7589c4-w6jqn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 21:23:03.847798 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:03.847652    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn" podUID="b61797e8-1217-4824-86d0-e7a4dfbf8714" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:23:04.383819 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:04.383779    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:23:04.384187 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:04.383848    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:23:04.388499 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:04.388479    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:23:05.053727 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:05.053698    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:23:05.899308 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:05.899277    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:23:11.152252 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.152077    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9tc7h"]
Jul 13 21:23:11.302497 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.301332    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.304565 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.304461    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 21:23:11.304732 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.304701    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8rcwv\""
Jul 13 21:23:11.306292 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.306261    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 21:23:11.306482 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.306460    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 21:23:11.306555 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.306535    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 21:23:11.387227 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.387025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca3c81d5-728f-4512-929b-d2b9a15c25b4-root\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.387227 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.387111    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-wtmp\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.387227 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.387147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca3c81d5-728f-4512-929b-d2b9a15c25b4-sys\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.387227 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.387206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.387227 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.387241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-tls\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.387637 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.387278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3c81d5-728f-4512-929b-d2b9a15c25b4-metrics-client-ca\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.387637 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.387317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8srv\" (UniqueName: \"kubernetes.io/projected/ca3c81d5-728f-4512-929b-d2b9a15c25b4-kube-api-access-z8srv\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.387637 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.387365    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.387637 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.387399    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-textfile\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488313    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca3c81d5-728f-4512-929b-d2b9a15c25b4-sys\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488378    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-tls\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488429    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca3c81d5-728f-4512-929b-d2b9a15c25b4-sys\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3c81d5-728f-4512-929b-d2b9a15c25b4-metrics-client-ca\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8srv\" (UniqueName: \"kubernetes.io/projected/ca3c81d5-728f-4512-929b-d2b9a15c25b4-kube-api-access-z8srv\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-textfile\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca3c81d5-728f-4512-929b-d2b9a15c25b4-root\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488671    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-wtmp\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.488827    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-wtmp\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.489412 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.489005    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca3c81d5-728f-4512-929b-d2b9a15c25b4-metrics-client-ca\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.490082 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.489594    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-textfile\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.490082 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.489764    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.490082 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.489846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca3c81d5-728f-4512-929b-d2b9a15c25b4-root\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.492537 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.492510    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-tls\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.493135 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.493092    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca3c81d5-728f-4512-929b-d2b9a15c25b4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.498044 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.498002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8srv\" (UniqueName: \"kubernetes.io/projected/ca3c81d5-728f-4512-929b-d2b9a15c25b4-kube-api-access-z8srv\") pod \"node-exporter-9tc7h\" (UID: \"ca3c81d5-728f-4512-929b-d2b9a15c25b4\") " pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:11.616580 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:11.616535    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9tc7h"
Jul 13 21:23:12.867437 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:12.867371    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7694846786-jr2vc"]
Jul 13 21:23:12.876949 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:12.876918    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p45dw"
Jul 13 21:23:14.872558 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:23:14.872525    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3c81d5_728f_4512_929b_d2b9a15c25b4.slice/crio-17bec80017b69f7ce82207e1ce9aff10d73052241847280f983ecf25e8787b96 WatchSource:0}: Error finding container 17bec80017b69f7ce82207e1ce9aff10d73052241847280f983ecf25e8787b96: Status 404 returned error can't find the container with id 17bec80017b69f7ce82207e1ce9aff10d73052241847280f983ecf25e8787b96
Jul 13 21:23:15.096172 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:15.096137    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tc7h" event={"ID":"ca3c81d5-728f-4512-929b-d2b9a15c25b4","Type":"ContainerStarted","Data":"17bec80017b69f7ce82207e1ce9aff10d73052241847280f983ecf25e8787b96"}
Jul 13 21:23:15.931261 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:15.931228    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d9d6bbd9f-fz6rd"]
Jul 13 21:23:15.957469 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:15.957434    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d9d6bbd9f-fz6rd"]
Jul 13 21:23:15.957835 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:15.957764    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:15.969133 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:15.969106    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 21:23:16.028356 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.028291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-service-ca\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.028534 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.028376    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-trusted-ca-bundle\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.028534 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.028426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4284k\" (UniqueName: \"kubernetes.io/projected/77b58e31-67e5-4ab1-989d-1be0119039a0-kube-api-access-4284k\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.028534 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.028506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-serving-cert\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.028698 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.028565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-console-config\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.028698 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.028639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-oauth-serving-cert\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.028698 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.028667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-oauth-config\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.104492 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.104455    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-ldhch" event={"ID":"ed09acd4-0a9b-4e4b-b72c-335b78fc60c1","Type":"ContainerStarted","Data":"bed4b64e871269fdc877726555401c6a54edb33cdd1f218e1e387d78fd385a42"}
Jul 13 21:23:16.104736 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.104716    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-ldhch"
Jul 13 21:23:16.117878 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.117852    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-ldhch"
Jul 13 21:23:16.129311 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.129282    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-oauth-serving-cert\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.129491 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.129326    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-oauth-config\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.129491 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.129456    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-service-ca\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.129620 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.129492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-trusted-ca-bundle\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.129620 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.129518    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4284k\" (UniqueName: \"kubernetes.io/projected/77b58e31-67e5-4ab1-989d-1be0119039a0-kube-api-access-4284k\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.129620 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.129553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-serving-cert\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.129776 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.129620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-console-config\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.130733 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.130002    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-oauth-serving-cert\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.130733 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.130284    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-console-config\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.130917 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.130710    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-ldhch" podStartSLOduration=3.169619359 podStartE2EDuration="25.130692755s" totalImagesPullingTime="21.961073396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:16.130095616 +0000 UTC m=+101.219375790" watchObservedRunningTime="2026-07-13 21:23:16.130692755 +0000 UTC m=+101.219972909"
Jul 13 21:23:16.130917 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.130826    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-trusted-ca-bundle\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.131508 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.131422    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-service-ca\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.134300 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.133832    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-serving-cert\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.135304 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.135281    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-oauth-config\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.141397 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.141376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4284k\" (UniqueName: \"kubernetes.io/projected/77b58e31-67e5-4ab1-989d-1be0119039a0-kube-api-access-4284k\") pod \"console-6d9d6bbd9f-fz6rd\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") " pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.271297 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.271213    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:16.525818 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:16.521891    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d9d6bbd9f-fz6rd"]
Jul 13 21:23:16.530994 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:23:16.530961    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b58e31_67e5_4ab1_989d_1be0119039a0.slice/crio-aa50580406fd76aee018bf12536d734ba217461466c49440798691c5adb8fc03 WatchSource:0}: Error finding container aa50580406fd76aee018bf12536d734ba217461466c49440798691c5adb8fc03: Status 404 returned error can't find the container with id aa50580406fd76aee018bf12536d734ba217461466c49440798691c5adb8fc03
Jul 13 21:23:17.112181 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:17.112128    2575 generic.go:356] "Generic (PLEG): container finished" podID="ca3c81d5-728f-4512-929b-d2b9a15c25b4" containerID="01eeb828e7900073225477997e1e3aabd5d1098a4ed2e667fbf90416282c5cb6" exitCode=0
Jul 13 21:23:17.112659 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:17.112282    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tc7h" event={"ID":"ca3c81d5-728f-4512-929b-d2b9a15c25b4","Type":"ContainerDied","Data":"01eeb828e7900073225477997e1e3aabd5d1098a4ed2e667fbf90416282c5cb6"}
Jul 13 21:23:17.114540 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:17.114503    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9d6bbd9f-fz6rd" event={"ID":"77b58e31-67e5-4ab1-989d-1be0119039a0","Type":"ContainerStarted","Data":"f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13"}
Jul 13 21:23:17.114668 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:17.114553    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9d6bbd9f-fz6rd" event={"ID":"77b58e31-67e5-4ab1-989d-1be0119039a0","Type":"ContainerStarted","Data":"aa50580406fd76aee018bf12536d734ba217461466c49440798691c5adb8fc03"}
Jul 13 21:23:17.154461 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:17.154409    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d9d6bbd9f-fz6rd" podStartSLOduration=2.154392675 podStartE2EDuration="2.154392675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:23:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:17.152231542 +0000 UTC m=+102.241511698" watchObservedRunningTime="2026-07-13 21:23:17.154392675 +0000 UTC m=+102.243672881"
Jul 13 21:23:18.123112 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:18.123071    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tc7h" event={"ID":"ca3c81d5-728f-4512-929b-d2b9a15c25b4","Type":"ContainerStarted","Data":"f9483853c5b2837af3b9cd1695cf4a645eb689ab66499f8ca8eae6b3375572a6"}
Jul 13 21:23:18.123575 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:18.123428    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tc7h" event={"ID":"ca3c81d5-728f-4512-929b-d2b9a15c25b4","Type":"ContainerStarted","Data":"4b4c1b86c647a87676226853c48f67433099007ecae1ebe881ccefc0a692878d"}
Jul 13 21:23:19.584073 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:19.584005    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9tc7h" podStartSLOduration=7.012355186 podStartE2EDuration="8.583979234s" totalImagesPullingTime="1.471007631s" totalInitContainerRuntime="100.616417ms" isStatefulPod=true podCreationTimestamp="2026-07-13 21:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:18.142838993 +0000 UTC m=+103.232119148" watchObservedRunningTime="2026-07-13 21:23:19.583979234 +0000 UTC m=+104.673259389"
Jul 13 21:23:19.585626 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:19.585588    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84cc7589c4-w6jqn"]
Jul 13 21:23:22.660653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.660611    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d9d6bbd9f-fz6rd"]
Jul 13 21:23:22.699284 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.699246    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f7f89d979-687cw"]
Jul 13 21:23:22.769687 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.769647    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7f89d979-687cw"]
Jul 13 21:23:22.769884 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.769801    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.891508 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.891471    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-trusted-ca-bundle\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.891688 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.891520    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-oauth-serving-cert\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.891688 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.891660    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-config\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.891812 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.891711    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-oauth-config\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.891812 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.891754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8mm2\" (UniqueName: \"kubernetes.io/projected/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-kube-api-access-c8mm2\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.891812 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.891809    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-serving-cert\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.891947 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.891832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-service-ca\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.992502 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.992417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-config\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.992736 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.992710    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-oauth-config\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.992858 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.992767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8mm2\" (UniqueName: \"kubernetes.io/projected/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-kube-api-access-c8mm2\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.992858 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.992823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-serving-cert\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.992858 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.992846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-service-ca\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.993012 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.992891    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-trusted-ca-bundle\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.993012 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.992926    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-oauth-serving-cert\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.993295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.993267    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-config\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.993597 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.993574    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-oauth-serving-cert\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.994402 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.994304    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-service-ca\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.994862 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.994839    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-trusted-ca-bundle\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.996361 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.996302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-serving-cert\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:22.997483 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:22.997438    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-oauth-config\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:23.003828 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:23.003802    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8mm2\" (UniqueName: \"kubernetes.io/projected/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-kube-api-access-c8mm2\") pod \"console-5f7f89d979-687cw\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") " pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:23.080678 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:23.080650    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:23.276450 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:23.276207    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f7f89d979-687cw"]
Jul 13 21:23:23.279712 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:23:23.279683    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589e22ee_f8fd_4afd_9eae_d52c2e2ec089.slice/crio-ea1b86fd44af1e59a7b336ecce5b82d37e48f9082c923d8963f3b83c2c51977a WatchSource:0}: Error finding container ea1b86fd44af1e59a7b336ecce5b82d37e48f9082c923d8963f3b83c2c51977a: Status 404 returned error can't find the container with id ea1b86fd44af1e59a7b336ecce5b82d37e48f9082c923d8963f3b83c2c51977a
Jul 13 21:23:24.158517 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:24.158475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7f89d979-687cw" event={"ID":"589e22ee-f8fd-4afd-9eae-d52c2e2ec089","Type":"ContainerStarted","Data":"f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9"}
Jul 13 21:23:24.158985 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:24.158547    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7f89d979-687cw" event={"ID":"589e22ee-f8fd-4afd-9eae-d52c2e2ec089","Type":"ContainerStarted","Data":"ea1b86fd44af1e59a7b336ecce5b82d37e48f9082c923d8963f3b83c2c51977a"}
Jul 13 21:23:24.182875 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:24.182821    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f7f89d979-687cw" podStartSLOduration=2.182804274 podStartE2EDuration="2.182804274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:23:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:23:24.181432935 +0000 UTC m=+109.270713112" watchObservedRunningTime="2026-07-13 21:23:24.182804274 +0000 UTC m=+109.272084426"
Jul 13 21:23:26.271897 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:26.271863    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:33.081246 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:33.081211    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:33.081750 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:33.081268    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:33.086247 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:33.086221    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:33.201606 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:33.201574    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:23:37.892166 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:37.892119    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7694846786-jr2vc" podUID="be9cf85d-e710-430f-a142-9e4909fca420" containerName="console" containerID="cri-o://02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c" gracePeriod=15
Jul 13 21:23:38.170646 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.170578    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:23:38.224162 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.224127    2575 generic.go:356] "Generic (PLEG): container finished" podID="be9cf85d-e710-430f-a142-9e4909fca420" containerID="02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c" exitCode=0
Jul 13 21:23:38.224314 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.224170    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7694846786-jr2vc"
Jul 13 21:23:38.224314 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.224206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7694846786-jr2vc" event={"ID":"be9cf85d-e710-430f-a142-9e4909fca420","Type":"ContainerDied","Data":"02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c"}
Jul 13 21:23:38.224314 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.224255    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7694846786-jr2vc" event={"ID":"be9cf85d-e710-430f-a142-9e4909fca420","Type":"ContainerDied","Data":"4745f940eb00408ed9f1ba0fff80322e7db6a6a7a153f2f220b5b36bc263b042"}
Jul 13 21:23:38.224314 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.224276    2575 scope.go:117] "RemoveContainer" containerID="02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c"
Jul 13 21:23:38.231327 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.231306    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-serving-cert\") pod \"be9cf85d-e710-430f-a142-9e4909fca420\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") "
Jul 13 21:23:38.231453 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.231364    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-console-config\") pod \"be9cf85d-e710-430f-a142-9e4909fca420\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") "
Jul 13 21:23:38.231453 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.231385    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qc84\" (UniqueName: \"kubernetes.io/projected/be9cf85d-e710-430f-a142-9e4909fca420-kube-api-access-2qc84\") pod \"be9cf85d-e710-430f-a142-9e4909fca420\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") "
Jul 13 21:23:38.231453 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.231435    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-oauth-config\") pod \"be9cf85d-e710-430f-a142-9e4909fca420\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") "
Jul 13 21:23:38.231587 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.231462    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-oauth-serving-cert\") pod \"be9cf85d-e710-430f-a142-9e4909fca420\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") "
Jul 13 21:23:38.231587 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.231493    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-service-ca\") pod \"be9cf85d-e710-430f-a142-9e4909fca420\" (UID: \"be9cf85d-e710-430f-a142-9e4909fca420\") "
Jul 13 21:23:38.231888 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.231862    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "be9cf85d-e710-430f-a142-9e4909fca420" (UID: "be9cf85d-e710-430f-a142-9e4909fca420"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:23:38.231998 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.231967    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-service-ca" (OuterVolumeSpecName: "service-ca") pod "be9cf85d-e710-430f-a142-9e4909fca420" (UID: "be9cf85d-e710-430f-a142-9e4909fca420"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:23:38.232138 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.232118    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-console-config" (OuterVolumeSpecName: "console-config") pod "be9cf85d-e710-430f-a142-9e4909fca420" (UID: "be9cf85d-e710-430f-a142-9e4909fca420"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:23:38.233440 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.233421    2575 scope.go:117] "RemoveContainer" containerID="02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c"
Jul 13 21:23:38.233576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.233551    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "be9cf85d-e710-430f-a142-9e4909fca420" (UID: "be9cf85d-e710-430f-a142-9e4909fca420"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:23:38.233646 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.233618    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be9cf85d-e710-430f-a142-9e4909fca420-kube-api-access-2qc84" (OuterVolumeSpecName: "kube-api-access-2qc84") pod "be9cf85d-e710-430f-a142-9e4909fca420" (UID: "be9cf85d-e710-430f-a142-9e4909fca420"). InnerVolumeSpecName "kube-api-access-2qc84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:23:38.233748 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:23:38.233730    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c\": container with ID starting with 02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c not found: ID does not exist" containerID="02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c"
Jul 13 21:23:38.233808 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.233758    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c"} err="failed to get container status \"02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c\": rpc error: code = NotFound desc = could not find container \"02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c\": container with ID starting with 02dde4645a01da46538f79def95aef58b44ed5e87e2d7e402d01b614b1d6690c not found: ID does not exist"
Jul 13 21:23:38.233878 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.233861    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "be9cf85d-e710-430f-a142-9e4909fca420" (UID: "be9cf85d-e710-430f-a142-9e4909fca420"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:23:38.332117 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.332078    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:38.332117 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.332111    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:38.332117 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.332124    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-console-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:38.332374 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.332137    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qc84\" (UniqueName: \"kubernetes.io/projected/be9cf85d-e710-430f-a142-9e4909fca420-kube-api-access-2qc84\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:38.332374 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.332149    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/be9cf85d-e710-430f-a142-9e4909fca420-console-oauth-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:38.332374 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.332160    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/be9cf85d-e710-430f-a142-9e4909fca420-oauth-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:38.546559 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.546516    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7694846786-jr2vc"]
Jul 13 21:23:38.548383 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:38.548356    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7694846786-jr2vc"]
Jul 13 21:23:39.468580 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:39.468546    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be9cf85d-e710-430f-a142-9e4909fca420" path="/var/lib/kubelet/pods/be9cf85d-e710-430f-a142-9e4909fca420/volumes"
Jul 13 21:23:41.238312 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:41.238279    2575 generic.go:356] "Generic (PLEG): container finished" podID="883ed7f6-38f8-4626-8467-00f1a732c497" containerID="149ad6b8ed15d930a7d705e7c92f06fc41ed54a387bc9398852d3e0281ee0262" exitCode=0
Jul 13 21:23:41.238781 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:41.238392    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9" event={"ID":"883ed7f6-38f8-4626-8467-00f1a732c497","Type":"ContainerDied","Data":"149ad6b8ed15d930a7d705e7c92f06fc41ed54a387bc9398852d3e0281ee0262"}
Jul 13 21:23:41.238849 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:41.238795    2575 scope.go:117] "RemoveContainer" containerID="149ad6b8ed15d930a7d705e7c92f06fc41ed54a387bc9398852d3e0281ee0262"
Jul 13 21:23:41.861968 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:41.861941    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c7d7cf9fb-cs5pw_1e9dcb4a-fc5c-4225-8408-451aa5bf4b22/router/0.log"
Jul 13 21:23:41.868537 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:41.868515    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bl66_0cdb947b-b2b7-42ab-b5e7-7933641becf7/serve-healthcheck-canary/0.log"
Jul 13 21:23:42.244760 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:42.244680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-c2qb9" event={"ID":"883ed7f6-38f8-4626-8467-00f1a732c497","Type":"ContainerStarted","Data":"f6340fbb8d6893511209b779daf06641851cdd86ecd1f4f5aac6e3915c1fd7a0"}
Jul 13 21:23:44.612101 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.612055    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn" podUID="b61797e8-1217-4824-86d0-e7a4dfbf8714" containerName="registry" containerID="cri-o://1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a" gracePeriod=30
Jul 13 21:23:44.854505 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.854473    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:23:44.888855 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.888779    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6j5w6\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-kube-api-access-6j5w6\") pod \"b61797e8-1217-4824-86d0-e7a4dfbf8714\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") "
Jul 13 21:23:44.888855 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.888812    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-installation-pull-secrets\") pod \"b61797e8-1217-4824-86d0-e7a4dfbf8714\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") "
Jul 13 21:23:44.888855 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.888832    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-certificates\") pod \"b61797e8-1217-4824-86d0-e7a4dfbf8714\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") "
Jul 13 21:23:44.889082 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.888885    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-trusted-ca\") pod \"b61797e8-1217-4824-86d0-e7a4dfbf8714\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") "
Jul 13 21:23:44.889082 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.888968    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b61797e8-1217-4824-86d0-e7a4dfbf8714-ca-trust-extracted\") pod \"b61797e8-1217-4824-86d0-e7a4dfbf8714\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") "
Jul 13 21:23:44.889082 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.889007    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-bound-sa-token\") pod \"b61797e8-1217-4824-86d0-e7a4dfbf8714\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") "
Jul 13 21:23:44.889082 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.889037    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") pod \"b61797e8-1217-4824-86d0-e7a4dfbf8714\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") "
Jul 13 21:23:44.889082 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.889068    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-image-registry-private-configuration\") pod \"b61797e8-1217-4824-86d0-e7a4dfbf8714\" (UID: \"b61797e8-1217-4824-86d0-e7a4dfbf8714\") "
Jul 13 21:23:44.889389 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.889333    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b61797e8-1217-4824-86d0-e7a4dfbf8714" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:23:44.890007 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.889964    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b61797e8-1217-4824-86d0-e7a4dfbf8714" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:23:44.891637 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.891598    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b61797e8-1217-4824-86d0-e7a4dfbf8714" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:23:44.891772 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.891743    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b61797e8-1217-4824-86d0-e7a4dfbf8714" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:23:44.891858 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.891831    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b61797e8-1217-4824-86d0-e7a4dfbf8714" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:23:44.891911 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.891861    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-kube-api-access-6j5w6" (OuterVolumeSpecName: "kube-api-access-6j5w6") pod "b61797e8-1217-4824-86d0-e7a4dfbf8714" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714"). InnerVolumeSpecName "kube-api-access-6j5w6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:23:44.891911 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.891892    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b61797e8-1217-4824-86d0-e7a4dfbf8714" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:23:44.898483 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.898459    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b61797e8-1217-4824-86d0-e7a4dfbf8714-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b61797e8-1217-4824-86d0-e7a4dfbf8714" (UID: "b61797e8-1217-4824-86d0-e7a4dfbf8714"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:23:44.989935 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.989896    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-bound-sa-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:44.989935 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.989924    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-tls\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:44.989935 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.989935    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-image-registry-private-configuration\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:44.989935 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.989945    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6j5w6\" (UniqueName: \"kubernetes.io/projected/b61797e8-1217-4824-86d0-e7a4dfbf8714-kube-api-access-6j5w6\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:44.990214 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.989953    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b61797e8-1217-4824-86d0-e7a4dfbf8714-installation-pull-secrets\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:44.990214 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.989962    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-registry-certificates\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:44.990214 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.989970    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b61797e8-1217-4824-86d0-e7a4dfbf8714-trusted-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:44.990214 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:44.989978    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b61797e8-1217-4824-86d0-e7a4dfbf8714-ca-trust-extracted\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:45.258831 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:45.258744    2575 generic.go:356] "Generic (PLEG): container finished" podID="b61797e8-1217-4824-86d0-e7a4dfbf8714" containerID="1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a" exitCode=0
Jul 13 21:23:45.258831 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:45.258782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn" event={"ID":"b61797e8-1217-4824-86d0-e7a4dfbf8714","Type":"ContainerDied","Data":"1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a"}
Jul 13 21:23:45.258831 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:45.258789    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn"
Jul 13 21:23:45.258831 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:45.258820    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-84cc7589c4-w6jqn" event={"ID":"b61797e8-1217-4824-86d0-e7a4dfbf8714","Type":"ContainerDied","Data":"9367c00ab8443d68270bc817114d6a51635413711b132732bae38df6eb5adf5c"}
Jul 13 21:23:45.259092 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:45.258841    2575 scope.go:117] "RemoveContainer" containerID="1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a"
Jul 13 21:23:45.267780 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:45.267762    2575 scope.go:117] "RemoveContainer" containerID="1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a"
Jul 13 21:23:45.268047 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:23:45.268026    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a\": container with ID starting with 1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a not found: ID does not exist" containerID="1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a"
Jul 13 21:23:45.268097 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:45.268055    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a"} err="failed to get container status \"1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a\": rpc error: code = NotFound desc = could not find container \"1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a\": container with ID starting with 1d05825622e8d6200b1da7f1f85d690b32919896eabf119e6ab8f341bd1b764a not found: ID does not exist"
Jul 13 21:23:45.280724 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:45.280701    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84cc7589c4-w6jqn"]
Jul 13 21:23:45.284315 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:45.284294    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-84cc7589c4-w6jqn"]
Jul 13 21:23:45.470130 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:45.470096    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b61797e8-1217-4824-86d0-e7a4dfbf8714" path="/var/lib/kubelet/pods/b61797e8-1217-4824-86d0-e7a4dfbf8714/volumes"
Jul 13 21:23:46.263977 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:46.263892    2575 generic.go:356] "Generic (PLEG): container finished" podID="c81457da-0ba0-4053-b2e5-d5221a8c943c" containerID="87429fa925231002f690f359f2f1f856e9a11d57cd7caa260aa14df29c1f335b" exitCode=0
Jul 13 21:23:46.263977 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:46.263957    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl" event={"ID":"c81457da-0ba0-4053-b2e5-d5221a8c943c","Type":"ContainerDied","Data":"87429fa925231002f690f359f2f1f856e9a11d57cd7caa260aa14df29c1f335b"}
Jul 13 21:23:46.264467 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:46.264276    2575 scope.go:117] "RemoveContainer" containerID="87429fa925231002f690f359f2f1f856e9a11d57cd7caa260aa14df29c1f335b"
Jul 13 21:23:47.270653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:47.270618    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hlqnl" event={"ID":"c81457da-0ba0-4053-b2e5-d5221a8c943c","Type":"ContainerStarted","Data":"b4d1c7d804ef983ee18438ce8dc5ee1581f164a84fbb4f1aa2b9d9eae3115f8b"}
Jul 13 21:23:47.688722 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:47.688685    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d9d6bbd9f-fz6rd" podUID="77b58e31-67e5-4ab1-989d-1be0119039a0" containerName="console" containerID="cri-o://f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13" gracePeriod=15
Jul 13 21:23:47.969147 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:47.969117    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:48.016683 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.016651    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-serving-cert\") pod \"77b58e31-67e5-4ab1-989d-1be0119039a0\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") "
Jul 13 21:23:48.016826 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.016697    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4284k\" (UniqueName: \"kubernetes.io/projected/77b58e31-67e5-4ab1-989d-1be0119039a0-kube-api-access-4284k\") pod \"77b58e31-67e5-4ab1-989d-1be0119039a0\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") "
Jul 13 21:23:48.016826 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.016713    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-console-config\") pod \"77b58e31-67e5-4ab1-989d-1be0119039a0\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") "
Jul 13 21:23:48.016826 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.016749    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-trusted-ca-bundle\") pod \"77b58e31-67e5-4ab1-989d-1be0119039a0\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") "
Jul 13 21:23:48.016826 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.016773    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-service-ca\") pod \"77b58e31-67e5-4ab1-989d-1be0119039a0\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") "
Jul 13 21:23:48.016826 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.016796    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-oauth-config\") pod \"77b58e31-67e5-4ab1-989d-1be0119039a0\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") "
Jul 13 21:23:48.017009 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.016842    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-oauth-serving-cert\") pod \"77b58e31-67e5-4ab1-989d-1be0119039a0\" (UID: \"77b58e31-67e5-4ab1-989d-1be0119039a0\") "
Jul 13 21:23:48.017110 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.017087    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-console-config" (OuterVolumeSpecName: "console-config") pod "77b58e31-67e5-4ab1-989d-1be0119039a0" (UID: "77b58e31-67e5-4ab1-989d-1be0119039a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:23:48.017292 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.017259    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "77b58e31-67e5-4ab1-989d-1be0119039a0" (UID: "77b58e31-67e5-4ab1-989d-1be0119039a0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:23:48.017448 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.017397    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "77b58e31-67e5-4ab1-989d-1be0119039a0" (UID: "77b58e31-67e5-4ab1-989d-1be0119039a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:23:48.017525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.017446    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-service-ca" (OuterVolumeSpecName: "service-ca") pod "77b58e31-67e5-4ab1-989d-1be0119039a0" (UID: "77b58e31-67e5-4ab1-989d-1be0119039a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:23:48.019090 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.019069    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "77b58e31-67e5-4ab1-989d-1be0119039a0" (UID: "77b58e31-67e5-4ab1-989d-1be0119039a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:23:48.019188 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.019128    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b58e31-67e5-4ab1-989d-1be0119039a0-kube-api-access-4284k" (OuterVolumeSpecName: "kube-api-access-4284k") pod "77b58e31-67e5-4ab1-989d-1be0119039a0" (UID: "77b58e31-67e5-4ab1-989d-1be0119039a0"). InnerVolumeSpecName "kube-api-access-4284k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:23:48.019188 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.019173    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "77b58e31-67e5-4ab1-989d-1be0119039a0" (UID: "77b58e31-67e5-4ab1-989d-1be0119039a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:23:48.117754 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.117725    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-oauth-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:48.117754 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.117751    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:48.117754 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.117760    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4284k\" (UniqueName: \"kubernetes.io/projected/77b58e31-67e5-4ab1-989d-1be0119039a0-kube-api-access-4284k\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:48.117982 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.117771    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-console-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:48.117982 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.117781    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-trusted-ca-bundle\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:48.117982 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.117789    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77b58e31-67e5-4ab1-989d-1be0119039a0-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:48.117982 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.117797    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77b58e31-67e5-4ab1-989d-1be0119039a0-console-oauth-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:23:48.280676 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.280593    2575 generic.go:356] "Generic (PLEG): container finished" podID="77b58e31-67e5-4ab1-989d-1be0119039a0" containerID="f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13" exitCode=0
Jul 13 21:23:48.280676 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.280635    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9d6bbd9f-fz6rd"
Jul 13 21:23:48.280676 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.280643    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9d6bbd9f-fz6rd" event={"ID":"77b58e31-67e5-4ab1-989d-1be0119039a0","Type":"ContainerDied","Data":"f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13"}
Jul 13 21:23:48.281139 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.280687    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9d6bbd9f-fz6rd" event={"ID":"77b58e31-67e5-4ab1-989d-1be0119039a0","Type":"ContainerDied","Data":"aa50580406fd76aee018bf12536d734ba217461466c49440798691c5adb8fc03"}
Jul 13 21:23:48.281139 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.280708    2575 scope.go:117] "RemoveContainer" containerID="f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13"
Jul 13 21:23:48.289901 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.289882    2575 scope.go:117] "RemoveContainer" containerID="f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13"
Jul 13 21:23:48.290133 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:23:48.290115    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13\": container with ID starting with f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13 not found: ID does not exist" containerID="f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13"
Jul 13 21:23:48.290178 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.290140    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13"} err="failed to get container status \"f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13\": rpc error: code = NotFound desc = could not find container \"f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13\": container with ID starting with f8cbe1e9a3041c6f4a7ead274f46eeaa4ce080878667c2df1733cb45593f6d13 not found: ID does not exist"
Jul 13 21:23:48.301276 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.301255    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d9d6bbd9f-fz6rd"]
Jul 13 21:23:48.307006 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:48.306984    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d9d6bbd9f-fz6rd"]
Jul 13 21:23:49.468532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:49.468501    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b58e31-67e5-4ab1-989d-1be0119039a0" path="/var/lib/kubelet/pods/77b58e31-67e5-4ab1-989d-1be0119039a0/volumes"
Jul 13 21:23:56.326311 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:56.326273    2575 generic.go:356] "Generic (PLEG): container finished" podID="8ab1b994-4573-4b8c-ab6b-0dca52fc98cb" containerID="08167b6e9c6a7c88771fbf1a8464129c24d1e40041b13fe19f207b309200d66a" exitCode=0
Jul 13 21:23:56.326842 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:56.326322    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr" event={"ID":"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb","Type":"ContainerDied","Data":"08167b6e9c6a7c88771fbf1a8464129c24d1e40041b13fe19f207b309200d66a"}
Jul 13 21:23:56.326842 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:56.326770    2575 scope.go:117] "RemoveContainer" containerID="08167b6e9c6a7c88771fbf1a8464129c24d1e40041b13fe19f207b309200d66a"
Jul 13 21:23:57.332271 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:23:57.332234    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-tqrlr" event={"ID":"8ab1b994-4573-4b8c-ab6b-0dca52fc98cb","Type":"ContainerStarted","Data":"74bdea97192127ba27c0551035929420e08c41fd534b04a7c70438b77e150fb1"}
Jul 13 21:24:44.231257 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:24:44.231222    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7f89d979-687cw"]
Jul 13 21:25:09.252792 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.252749    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f7f89d979-687cw" podUID="589e22ee-f8fd-4afd-9eae-d52c2e2ec089" containerName="console" containerID="cri-o://f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9" gracePeriod=15
Jul 13 21:25:09.495434 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.495411    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:25:09.533196 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.533115    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-serving-cert\") pod \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") "
Jul 13 21:25:09.533196 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.533155    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-service-ca\") pod \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") "
Jul 13 21:25:09.533196 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.533195    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-oauth-serving-cert\") pod \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") "
Jul 13 21:25:09.533488 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.533219    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-trusted-ca-bundle\") pod \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") "
Jul 13 21:25:09.533488 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.533241    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8mm2\" (UniqueName: \"kubernetes.io/projected/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-kube-api-access-c8mm2\") pod \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") "
Jul 13 21:25:09.533488 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.533274    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-config\") pod \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") "
Jul 13 21:25:09.533488 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.533297    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-oauth-config\") pod \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\" (UID: \"589e22ee-f8fd-4afd-9eae-d52c2e2ec089\") "
Jul 13 21:25:09.533752 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.533719    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "589e22ee-f8fd-4afd-9eae-d52c2e2ec089" (UID: "589e22ee-f8fd-4afd-9eae-d52c2e2ec089"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:25:09.533817 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.533759    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-service-ca" (OuterVolumeSpecName: "service-ca") pod "589e22ee-f8fd-4afd-9eae-d52c2e2ec089" (UID: "589e22ee-f8fd-4afd-9eae-d52c2e2ec089"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:25:09.533856 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.533810    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-config" (OuterVolumeSpecName: "console-config") pod "589e22ee-f8fd-4afd-9eae-d52c2e2ec089" (UID: "589e22ee-f8fd-4afd-9eae-d52c2e2ec089"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:25:09.534125 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.534099    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "589e22ee-f8fd-4afd-9eae-d52c2e2ec089" (UID: "589e22ee-f8fd-4afd-9eae-d52c2e2ec089"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:25:09.535589 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.535561    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "589e22ee-f8fd-4afd-9eae-d52c2e2ec089" (UID: "589e22ee-f8fd-4afd-9eae-d52c2e2ec089"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:25:09.535674 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.535641    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-kube-api-access-c8mm2" (OuterVolumeSpecName: "kube-api-access-c8mm2") pod "589e22ee-f8fd-4afd-9eae-d52c2e2ec089" (UID: "589e22ee-f8fd-4afd-9eae-d52c2e2ec089"). InnerVolumeSpecName "kube-api-access-c8mm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:25:09.535765 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.535747    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "589e22ee-f8fd-4afd-9eae-d52c2e2ec089" (UID: "589e22ee-f8fd-4afd-9eae-d52c2e2ec089"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:25:09.634077 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.634028    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:25:09.634077 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.634070    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-oauth-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:25:09.634077 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.634081    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-trusted-ca-bundle\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:25:09.634077 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.634090    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8mm2\" (UniqueName: \"kubernetes.io/projected/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-kube-api-access-c8mm2\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:25:09.634077 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.634100    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:25:09.634429 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.634109    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-oauth-config\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:25:09.634429 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.634117    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/589e22ee-f8fd-4afd-9eae-d52c2e2ec089-console-serving-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:25:09.642282 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.642250    2575 generic.go:356] "Generic (PLEG): container finished" podID="589e22ee-f8fd-4afd-9eae-d52c2e2ec089" containerID="f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9" exitCode=0
Jul 13 21:25:09.642461 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.642297    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f7f89d979-687cw"
Jul 13 21:25:09.642461 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.642354    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7f89d979-687cw" event={"ID":"589e22ee-f8fd-4afd-9eae-d52c2e2ec089","Type":"ContainerDied","Data":"f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9"}
Jul 13 21:25:09.642461 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.642411    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f7f89d979-687cw" event={"ID":"589e22ee-f8fd-4afd-9eae-d52c2e2ec089","Type":"ContainerDied","Data":"ea1b86fd44af1e59a7b336ecce5b82d37e48f9082c923d8963f3b83c2c51977a"}
Jul 13 21:25:09.642461 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.642438    2575 scope.go:117] "RemoveContainer" containerID="f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9"
Jul 13 21:25:09.650931 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.650913    2575 scope.go:117] "RemoveContainer" containerID="f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9"
Jul 13 21:25:09.651200 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:25:09.651182    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9\": container with ID starting with f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9 not found: ID does not exist" containerID="f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9"
Jul 13 21:25:09.651263 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.651212    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9"} err="failed to get container status \"f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9\": rpc error: code = NotFound desc = could not find container \"f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9\": container with ID starting with f8b6ca5d8dc0748a07251317f7ab9845bf3fd9936faed6426ba0043051f500e9 not found: ID does not exist"
Jul 13 21:25:09.662787 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.662760    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f7f89d979-687cw"]
Jul 13 21:25:09.668646 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:09.668623    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f7f89d979-687cw"]
Jul 13 21:25:11.468695 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:25:11.468662    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="589e22ee-f8fd-4afd-9eae-d52c2e2ec089" path="/var/lib/kubelet/pods/589e22ee-f8fd-4afd-9eae-d52c2e2ec089/volumes"
Jul 13 21:26:16.706111 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706077    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"]
Jul 13 21:26:16.706532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706401    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be9cf85d-e710-430f-a142-9e4909fca420" containerName="console"
Jul 13 21:26:16.706532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706412    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="be9cf85d-e710-430f-a142-9e4909fca420" containerName="console"
Jul 13 21:26:16.706532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706427    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b61797e8-1217-4824-86d0-e7a4dfbf8714" containerName="registry"
Jul 13 21:26:16.706532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706433    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b61797e8-1217-4824-86d0-e7a4dfbf8714" containerName="registry"
Jul 13 21:26:16.706532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706442    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589e22ee-f8fd-4afd-9eae-d52c2e2ec089" containerName="console"
Jul 13 21:26:16.706532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706448    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="589e22ee-f8fd-4afd-9eae-d52c2e2ec089" containerName="console"
Jul 13 21:26:16.706532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706459    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b58e31-67e5-4ab1-989d-1be0119039a0" containerName="console"
Jul 13 21:26:16.706532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706464    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b58e31-67e5-4ab1-989d-1be0119039a0" containerName="console"
Jul 13 21:26:16.706532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706533    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b58e31-67e5-4ab1-989d-1be0119039a0" containerName="console"
Jul 13 21:26:16.706799 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706541    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="be9cf85d-e710-430f-a142-9e4909fca420" containerName="console"
Jul 13 21:26:16.706799 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706548    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b61797e8-1217-4824-86d0-e7a4dfbf8714" containerName="registry"
Jul 13 21:26:16.706799 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.706557    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="589e22ee-f8fd-4afd-9eae-d52c2e2ec089" containerName="console"
Jul 13 21:26:16.708596 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.708581    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.711259 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.711232    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 21:26:16.711259 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.711242    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 21:26:16.711488 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.711402    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lnw2r\""
Jul 13 21:26:16.711488 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.711415    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 21:26:16.711720 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.711707    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 21:26:16.721315 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.721293    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"]
Jul 13 21:26:16.794757 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.794717    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvwkb\" (UniqueName: \"kubernetes.io/projected/c59e849e-4bb0-45de-a177-7ee4a10aae6b-kube-api-access-mvwkb\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.794946 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.794821    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c59e849e-4bb0-45de-a177-7ee4a10aae6b-tmp\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.794946 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.794871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c59e849e-4bb0-45de-a177-7ee4a10aae6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.794946 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.794928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c59e849e-4bb0-45de-a177-7ee4a10aae6b-manifests\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.795076 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.794964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c59e849e-4bb0-45de-a177-7ee4a10aae6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.896178 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.896141    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c59e849e-4bb0-45de-a177-7ee4a10aae6b-tmp\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.896392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.896189    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c59e849e-4bb0-45de-a177-7ee4a10aae6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.896392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.896221    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c59e849e-4bb0-45de-a177-7ee4a10aae6b-manifests\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.896392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.896243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c59e849e-4bb0-45de-a177-7ee4a10aae6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.896392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.896281    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwkb\" (UniqueName: \"kubernetes.io/projected/c59e849e-4bb0-45de-a177-7ee4a10aae6b-kube-api-access-mvwkb\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.896655 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.896636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c59e849e-4bb0-45de-a177-7ee4a10aae6b-manifests\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.898656 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.898625    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c59e849e-4bb0-45de-a177-7ee4a10aae6b-tmp\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.898762 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.898740    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c59e849e-4bb0-45de-a177-7ee4a10aae6b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.898858 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.898842    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c59e849e-4bb0-45de-a177-7ee4a10aae6b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:16.908100 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:16.908042    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvwkb\" (UniqueName: \"kubernetes.io/projected/c59e849e-4bb0-45de-a177-7ee4a10aae6b-kube-api-access-mvwkb\") pod \"opendatahub-operator-controller-manager-6f98b9f4-sxpqg\" (UID: \"c59e849e-4bb0-45de-a177-7ee4a10aae6b\") " pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:17.018207 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:17.018102    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:17.152852 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:17.152824    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"]
Jul 13 21:26:17.157167 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:26:17.157137    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59e849e_4bb0_45de_a177_7ee4a10aae6b.slice/crio-54bb0da36075a690ead9ce8aea8fd2651b981bfffba20f1f6f75b75fe9f9ab65 WatchSource:0}: Error finding container 54bb0da36075a690ead9ce8aea8fd2651b981bfffba20f1f6f75b75fe9f9ab65: Status 404 returned error can't find the container with id 54bb0da36075a690ead9ce8aea8fd2651b981bfffba20f1f6f75b75fe9f9ab65
Jul 13 21:26:17.918692 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:17.918654    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg" event={"ID":"c59e849e-4bb0-45de-a177-7ee4a10aae6b","Type":"ContainerStarted","Data":"54bb0da36075a690ead9ce8aea8fd2651b981bfffba20f1f6f75b75fe9f9ab65"}
Jul 13 21:26:20.936105 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:20.936066    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg" event={"ID":"c59e849e-4bb0-45de-a177-7ee4a10aae6b","Type":"ContainerStarted","Data":"950b3cf70ed4ab51b8789407f42a57a9652223ee29c05a7ce2ef0690140ecda9"}
Jul 13 21:26:21.942424 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:21.942392    2575 generic.go:356] "Generic (PLEG): container finished" podID="c59e849e-4bb0-45de-a177-7ee4a10aae6b" containerID="950b3cf70ed4ab51b8789407f42a57a9652223ee29c05a7ce2ef0690140ecda9" exitCode=0
Jul 13 21:26:21.942831 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:21.942460    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg" event={"ID":"c59e849e-4bb0-45de-a177-7ee4a10aae6b","Type":"ContainerDied","Data":"950b3cf70ed4ab51b8789407f42a57a9652223ee29c05a7ce2ef0690140ecda9"}
Jul 13 21:26:22.948408 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:22.948367    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg" event={"ID":"c59e849e-4bb0-45de-a177-7ee4a10aae6b","Type":"ContainerStarted","Data":"aa8bd820d9c147bc2a4bdc4a119e89755b60097399862107e53b496ffc62596a"}
Jul 13 21:26:22.948786 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:22.948457    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:22.969646 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:22.969598    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg" podStartSLOduration=2.58874563 podStartE2EDuration="6.969581676s" totalImagesPullingTime="3.331568896s" totalInitContainerRuntime="1.04926715s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:26:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:26:22.967367826 +0000 UTC m=+288.056647996" watchObservedRunningTime="2026-07-13 21:26:22.969581676 +0000 UTC m=+288.058861829"
Jul 13 21:26:33.955399 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:33.955366    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f98b9f4-sxpqg"
Jul 13 21:26:35.330842 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:35.330810    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:26:35.335076 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:35.335048    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:26:35.335076 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:35.335073    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:26:35.339531 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:35.339511    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:26:35.343731 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:35.343714    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 21:26:43.744616 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.744575    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"]
Jul 13 21:26:43.747466 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.747444    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.755166 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.755143    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 13 21:26:43.755458 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.755442    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 13 21:26:43.756549 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.756528    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 21:26:43.756645 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.756550    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-22rlv\""
Jul 13 21:26:43.756645 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.756580    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 13 21:26:43.756645 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.756526    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 21:26:43.765333 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.765311    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"]
Jul 13 21:26:43.827989 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.827943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/616c82c8-97e4-45dd-a174-6ae96da5a59e-manager-config\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.827989 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.827996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/616c82c8-97e4-45dd-a174-6ae96da5a59e-metrics-cert\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.828204 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.828072    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/616c82c8-97e4-45dd-a174-6ae96da5a59e-cert\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.828204 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.828146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25lxz\" (UniqueName: \"kubernetes.io/projected/616c82c8-97e4-45dd-a174-6ae96da5a59e-kube-api-access-25lxz\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.928929 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.928893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25lxz\" (UniqueName: \"kubernetes.io/projected/616c82c8-97e4-45dd-a174-6ae96da5a59e-kube-api-access-25lxz\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.929094 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.928958    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/616c82c8-97e4-45dd-a174-6ae96da5a59e-manager-config\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.929094 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.928993    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/616c82c8-97e4-45dd-a174-6ae96da5a59e-metrics-cert\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.929094 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.929027    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/616c82c8-97e4-45dd-a174-6ae96da5a59e-cert\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.929769 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.929746    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/616c82c8-97e4-45dd-a174-6ae96da5a59e-manager-config\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.931528 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.931508    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/616c82c8-97e4-45dd-a174-6ae96da5a59e-cert\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.931624 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.931603    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/616c82c8-97e4-45dd-a174-6ae96da5a59e-metrics-cert\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:43.937548 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:43.937524    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25lxz\" (UniqueName: \"kubernetes.io/projected/616c82c8-97e4-45dd-a174-6ae96da5a59e-kube-api-access-25lxz\") pod \"lws-controller-manager-74864c9df6-tgd8x\" (UID: \"616c82c8-97e4-45dd-a174-6ae96da5a59e\") " pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:44.057079 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:44.057043    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:44.205461 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:44.205399    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"]
Jul 13 21:26:44.208282 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:26:44.208250    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616c82c8_97e4_45dd_a174_6ae96da5a59e.slice/crio-844bbe7666520bbd1630ce3f50d9991ca766fef779463c5df45dee0b6040d4b7 WatchSource:0}: Error finding container 844bbe7666520bbd1630ce3f50d9991ca766fef779463c5df45dee0b6040d4b7: Status 404 returned error can't find the container with id 844bbe7666520bbd1630ce3f50d9991ca766fef779463c5df45dee0b6040d4b7
Jul 13 21:26:44.211168 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:44.211150    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:26:45.047791 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:45.047751    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x" event={"ID":"616c82c8-97e4-45dd-a174-6ae96da5a59e","Type":"ContainerStarted","Data":"844bbe7666520bbd1630ce3f50d9991ca766fef779463c5df45dee0b6040d4b7"}
Jul 13 21:26:47.058885 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.058850    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x" event={"ID":"616c82c8-97e4-45dd-a174-6ae96da5a59e","Type":"ContainerStarted","Data":"7a13723a31602a3c410f7ddc123f45327bf608262dceb7c54b110e3474ad265f"}
Jul 13 21:26:47.059268 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.058966    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:26:47.084253 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.084207    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x" podStartSLOduration=1.782520171 podStartE2EDuration="4.084190621s" totalImagesPullingTime="2.30167045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:26:47.082830656 +0000 UTC m=+312.172110829" watchObservedRunningTime="2026-07-13 21:26:47.084190621 +0000 UTC m=+312.173470773"
Jul 13 21:26:47.567624 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.567591    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"]
Jul 13 21:26:47.570165 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.570144    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:26:47.577102 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.577083    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 13 21:26:47.580195 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.580175    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-q7ddg\""
Jul 13 21:26:47.599670 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.599649    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"]
Jul 13 21:26:47.601614 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.601600    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:47.604589 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.604564    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 13 21:26:47.604764 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.604747    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-tjbdc\""
Jul 13 21:26:47.625458 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.625436    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"]
Jul 13 21:26:47.650956 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.650932    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"]
Jul 13 21:26:47.662834 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.662795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw7pj\" (UniqueName: \"kubernetes.io/projected/7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6-kube-api-access-sw7pj\") pod \"kserve-controller-manager-d6f4b65b8-cqpbr\" (UID: \"7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:26:47.662972 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.662858    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6-cert\") pod \"kserve-controller-manager-d6f4b65b8-cqpbr\" (UID: \"7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:26:47.763371 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.763315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzrmf\" (UniqueName: \"kubernetes.io/projected/be9d3335-b014-4c27-a89b-cf58ab584088-kube-api-access-lzrmf\") pod \"llmisvc-controller-manager-777c6bd7d5-sjnlw\" (UID: \"be9d3335-b014-4c27-a89b-cf58ab584088\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:47.763563 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.763449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be9d3335-b014-4c27-a89b-cf58ab584088-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sjnlw\" (UID: \"be9d3335-b014-4c27-a89b-cf58ab584088\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:47.763563 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.763492    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw7pj\" (UniqueName: \"kubernetes.io/projected/7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6-kube-api-access-sw7pj\") pod \"kserve-controller-manager-d6f4b65b8-cqpbr\" (UID: \"7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:26:47.763563 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.763524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6-cert\") pod \"kserve-controller-manager-d6f4b65b8-cqpbr\" (UID: \"7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:26:47.763722 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:26:47.763648    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 13 21:26:47.763722 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:26:47.763712    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6-cert podName:7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6 nodeName:}" failed. No retries permitted until 2026-07-13 21:26:48.263692881 +0000 UTC m=+313.352973032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6-cert") pod "kserve-controller-manager-d6f4b65b8-cqpbr" (UID: "7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6") : secret "kserve-webhook-server-cert" not found
Jul 13 21:26:47.777565 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.777533    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw7pj\" (UniqueName: \"kubernetes.io/projected/7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6-kube-api-access-sw7pj\") pod \"kserve-controller-manager-d6f4b65b8-cqpbr\" (UID: \"7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:26:47.864856 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.864766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be9d3335-b014-4c27-a89b-cf58ab584088-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sjnlw\" (UID: \"be9d3335-b014-4c27-a89b-cf58ab584088\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:47.864994 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.864867    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzrmf\" (UniqueName: \"kubernetes.io/projected/be9d3335-b014-4c27-a89b-cf58ab584088-kube-api-access-lzrmf\") pod \"llmisvc-controller-manager-777c6bd7d5-sjnlw\" (UID: \"be9d3335-b014-4c27-a89b-cf58ab584088\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:47.864994 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:26:47.864952    2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 13 21:26:47.865059 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:26:47.865036    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be9d3335-b014-4c27-a89b-cf58ab584088-cert podName:be9d3335-b014-4c27-a89b-cf58ab584088 nodeName:}" failed. No retries permitted until 2026-07-13 21:26:48.365015105 +0000 UTC m=+313.454295239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be9d3335-b014-4c27-a89b-cf58ab584088-cert") pod "llmisvc-controller-manager-777c6bd7d5-sjnlw" (UID: "be9d3335-b014-4c27-a89b-cf58ab584088") : secret "llmisvc-webhook-server-cert" not found
Jul 13 21:26:47.876022 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:47.875995    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzrmf\" (UniqueName: \"kubernetes.io/projected/be9d3335-b014-4c27-a89b-cf58ab584088-kube-api-access-lzrmf\") pod \"llmisvc-controller-manager-777c6bd7d5-sjnlw\" (UID: \"be9d3335-b014-4c27-a89b-cf58ab584088\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:48.268250 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.268159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6-cert\") pod \"kserve-controller-manager-d6f4b65b8-cqpbr\" (UID: \"7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:26:48.270557 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.270536    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6-cert\") pod \"kserve-controller-manager-d6f4b65b8-cqpbr\" (UID: \"7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:26:48.369142 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.369105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be9d3335-b014-4c27-a89b-cf58ab584088-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sjnlw\" (UID: \"be9d3335-b014-4c27-a89b-cf58ab584088\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:48.369277 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:26:48.369224    2575 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 13 21:26:48.369319 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:26:48.369281    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be9d3335-b014-4c27-a89b-cf58ab584088-cert podName:be9d3335-b014-4c27-a89b-cf58ab584088 nodeName:}" failed. No retries permitted until 2026-07-13 21:26:49.369267236 +0000 UTC m=+314.458547366 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/be9d3335-b014-4c27-a89b-cf58ab584088-cert") pod "llmisvc-controller-manager-777c6bd7d5-sjnlw" (UID: "be9d3335-b014-4c27-a89b-cf58ab584088") : secret "llmisvc-webhook-server-cert" not found
Jul 13 21:26:48.480991 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.480959    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:26:48.615394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.615369    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"]
Jul 13 21:26:48.616588 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:26:48.616567    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca9463a_069a_4ebf_88b6_f7bfb6d7c7b6.slice/crio-0d6acceaa053fdddfe290868666475b8232342e8eec5dc8a694876c53814186d WatchSource:0}: Error finding container 0d6acceaa053fdddfe290868666475b8232342e8eec5dc8a694876c53814186d: Status 404 returned error can't find the container with id 0d6acceaa053fdddfe290868666475b8232342e8eec5dc8a694876c53814186d
Jul 13 21:26:48.648260 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.648230    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"]
Jul 13 21:26:48.651387 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.651368    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.654067 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.654041    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 21:26:48.654187 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.654083    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-5xwxb\""
Jul 13 21:26:48.669131 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.669107    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"]
Jul 13 21:26:48.773288 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.773248    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.773521 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.773296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.773521 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.773327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.773521 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.773417    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57128c30-3cb2-4a5a-ae16-3edb2e563820-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.773521 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.773452    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc8w6\" (UniqueName: \"kubernetes.io/projected/57128c30-3cb2-4a5a-ae16-3edb2e563820-kube-api-access-xc8w6\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.773521 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.773497    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.773712 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.773581    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.773712 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.773622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.773712 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.773647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.874790 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.874753    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.874987 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.874794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.874987 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.874820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.874987 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.874882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.874987 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.874911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.875165 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.875053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.875165 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.875132    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57128c30-3cb2-4a5a-ae16-3edb2e563820-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.875274 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.875165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc8w6\" (UniqueName: \"kubernetes.io/projected/57128c30-3cb2-4a5a-ae16-3edb2e563820-kube-api-access-xc8w6\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.875274 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.875182    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.875274 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.875235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.875512 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.875482    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.875512 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.875505    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.875764 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.875742    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.876023 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.876004    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57128c30-3cb2-4a5a-ae16-3edb2e563820-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.877375 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.877352    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.877472 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.877374    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.884921 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.884899    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc8w6\" (UniqueName: \"kubernetes.io/projected/57128c30-3cb2-4a5a-ae16-3edb2e563820-kube-api-access-xc8w6\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.885595 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.885573    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57128c30-3cb2-4a5a-ae16-3edb2e563820-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4mkf4b\" (UID: \"57128c30-3cb2-4a5a-ae16-3edb2e563820\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:48.961897 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:48.961869    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:49.070115 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:49.070077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr" event={"ID":"7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6","Type":"ContainerStarted","Data":"0d6acceaa053fdddfe290868666475b8232342e8eec5dc8a694876c53814186d"}
Jul 13 21:26:49.102407 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:49.102384    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"]
Jul 13 21:26:49.104485 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:26:49.104463    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57128c30_3cb2_4a5a_ae16_3edb2e563820.slice/crio-4b7bcc5e3b1b4b6e4473f769ed16f57571542a822e4ab0bf249192f4f54ef3af WatchSource:0}: Error finding container 4b7bcc5e3b1b4b6e4473f769ed16f57571542a822e4ab0bf249192f4f54ef3af: Status 404 returned error can't find the container with id 4b7bcc5e3b1b4b6e4473f769ed16f57571542a822e4ab0bf249192f4f54ef3af
Jul 13 21:26:49.380146 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:49.380117    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be9d3335-b014-4c27-a89b-cf58ab584088-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sjnlw\" (UID: \"be9d3335-b014-4c27-a89b-cf58ab584088\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:49.382692 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:49.382665    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/be9d3335-b014-4c27-a89b-cf58ab584088-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-sjnlw\" (UID: \"be9d3335-b014-4c27-a89b-cf58ab584088\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:49.413637 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:49.413605    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:49.558119 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:49.558083    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"]
Jul 13 21:26:49.560737 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:26:49.560705    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbe9d3335_b014_4c27_a89b_cf58ab584088.slice/crio-5f1eadcf7db5e9cf06528b64310d1a7870c79fb8763075b9918debf11a43235b WatchSource:0}: Error finding container 5f1eadcf7db5e9cf06528b64310d1a7870c79fb8763075b9918debf11a43235b: Status 404 returned error can't find the container with id 5f1eadcf7db5e9cf06528b64310d1a7870c79fb8763075b9918debf11a43235b
Jul 13 21:26:50.076838 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:50.076772    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw" event={"ID":"be9d3335-b014-4c27-a89b-cf58ab584088","Type":"ContainerStarted","Data":"5f1eadcf7db5e9cf06528b64310d1a7870c79fb8763075b9918debf11a43235b"}
Jul 13 21:26:50.078924 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:50.078877    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b" event={"ID":"57128c30-3cb2-4a5a-ae16-3edb2e563820","Type":"ContainerStarted","Data":"4b7bcc5e3b1b4b6e4473f769ed16f57571542a822e4ab0bf249192f4f54ef3af"}
Jul 13 21:26:52.336316 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:52.336258    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:26:52.336704 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:52.336382    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:26:52.336704 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:52.336414    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:26:53.102869 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:53.102826    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr" event={"ID":"7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6","Type":"ContainerStarted","Data":"170fc0ae7025437d10d9d35f7dcf9a39274e8877a02fbc7c0223e3a16ed931e7"}
Jul 13 21:26:53.103073 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:53.102937    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:26:53.104848 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:53.104822    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b" event={"ID":"57128c30-3cb2-4a5a-ae16-3edb2e563820","Type":"ContainerStarted","Data":"8189e0c251d536e2bbbee1c278d72339643c16807920a9d8aad9e633b263312b"}
Jul 13 21:26:53.124544 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:53.124493    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr" podStartSLOduration=2.406475116 podStartE2EDuration="6.124479577s" totalImagesPullingTime="3.718004461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:26:53.123111887 +0000 UTC m=+318.212392069" watchObservedRunningTime="2026-07-13 21:26:53.124479577 +0000 UTC m=+318.213759729"
Jul 13 21:26:53.146711 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:53.146661    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b" podStartSLOduration=1.9170192400000001 podStartE2EDuration="5.146646443s" totalImagesPullingTime="3.229627203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:26:53.145514576 +0000 UTC m=+318.234794747" watchObservedRunningTime="2026-07-13 21:26:53.146646443 +0000 UTC m=+318.235926596"
Jul 13 21:26:53.963020 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:53.962990    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:53.967740 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:53.967711    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:54.109704 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:54.109662    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:54.110680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:54.110660    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4mkf4b"
Jul 13 21:26:55.115274 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:55.115236    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw" event={"ID":"be9d3335-b014-4c27-a89b-cf58ab584088","Type":"ContainerStarted","Data":"afe002a930d529a9684d94b3e19c95a13b0c3cfcb53841bce76a1e15cb4052c0"}
Jul 13 21:26:55.115709 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:55.115555    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:26:55.134010 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:55.133959    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw" podStartSLOduration=3.178221311 podStartE2EDuration="8.133942383s" totalImagesPullingTime="4.955721072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:26:55.131910378 +0000 UTC m=+320.221190533" watchObservedRunningTime="2026-07-13 21:26:55.133942383 +0000 UTC m=+320.223222535"
Jul 13 21:26:58.065470 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:26:58.065440    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74864c9df6-tgd8x"
Jul 13 21:27:24.114800 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:27:24.114767    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cqpbr"
Jul 13 21:27:26.122379 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:27:26.122324    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-sjnlw"
Jul 13 21:29:16.858501 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.858462    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"]
Jul 13 21:29:16.861099 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.861077    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:16.863575 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.863558    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4wqqp\""
Jul 13 21:29:16.870704 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.870681    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"]
Jul 13 21:29:16.924036 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.924011    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:16.924156 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.924042    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdqgb\" (UniqueName: \"kubernetes.io/projected/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-kube-api-access-xdqgb\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:16.924156 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.924065    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:16.924156 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.924084    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:16.924156 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.924149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:16.924321 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.924208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:16.924321 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.924228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:16.924321 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.924255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:16.924321 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:16.924288    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.025458 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.025412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.025653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.025493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.025653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.025520    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.025653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.025543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.025653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.025583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.025653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.025619    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.025653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.025642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdqgb\" (UniqueName: \"kubernetes.io/projected/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-kube-api-access-xdqgb\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.025966 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.025668    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.025966 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.025692    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.026076 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.026017    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.026130 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.026065    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.026130 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.026106    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.026257 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.026135    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.026472 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.026453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.027724 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.027701    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.028166 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.028145    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.034287 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.034266    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdqgb\" (UniqueName: \"kubernetes.io/projected/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-kube-api-access-xdqgb\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.034480 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.034463    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-dv98p\" (UID: \"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.172000 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.171917    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:17.305796 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.305758    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"]
Jul 13 21:29:17.308329 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:29:17.308301    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6db1aa7_cfa5_4fb6_a054_4e47c532c0bc.slice/crio-ea1eafae57cb3a5eae3eaf7dd584abbdf536b4c66d7343a1f3b74d89396e43ef WatchSource:0}: Error finding container ea1eafae57cb3a5eae3eaf7dd584abbdf536b4c66d7343a1f3b74d89396e43ef: Status 404 returned error can't find the container with id ea1eafae57cb3a5eae3eaf7dd584abbdf536b4c66d7343a1f3b74d89396e43ef
Jul 13 21:29:17.310903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.310862    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:29:17.311003 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.310927    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:29:17.311003 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.310955    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:29:17.750472 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.750436    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p" event={"ID":"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc","Type":"ContainerStarted","Data":"04dc3e594a0fab569a08c86b10a314d0737dfb1aad5974966c52f43ae274fbd5"}
Jul 13 21:29:17.750643 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.750501    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p" event={"ID":"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc","Type":"ContainerStarted","Data":"ea1eafae57cb3a5eae3eaf7dd584abbdf536b4c66d7343a1f3b74d89396e43ef"}
Jul 13 21:29:17.769876 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:17.769826    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p" podStartSLOduration=1.7698100719999998 podStartE2EDuration="1.769810072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:29:17.768958975 +0000 UTC m=+462.858239141" watchObservedRunningTime="2026-07-13 21:29:17.769810072 +0000 UTC m=+462.859090226"
Jul 13 21:29:18.172046 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:18.172012    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:18.176388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:18.176362    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:18.755143 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:18.755112    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:18.756185 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:18.756160    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:29:19.782158 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:19.782127    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dgq96"]
Jul 13 21:29:19.784678 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:19.784659    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dgq96"
Jul 13 21:29:19.787314 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:19.787291    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 21:29:19.787451 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:19.787372    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 21:29:19.788375 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:19.788300    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8prnx\""
Jul 13 21:29:19.791537 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:19.791517    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dgq96"]
Jul 13 21:29:19.850607 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:19.850578    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z6qq\" (UniqueName: \"kubernetes.io/projected/770a5593-fbc5-498e-bfbd-9c624c3b8c52-kube-api-access-4z6qq\") pod \"authorino-75d556bd77-dgq96\" (UID: \"770a5593-fbc5-498e-bfbd-9c624c3b8c52\") " pod="kuadrant-system/authorino-75d556bd77-dgq96"
Jul 13 21:29:19.951941 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:19.951910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z6qq\" (UniqueName: \"kubernetes.io/projected/770a5593-fbc5-498e-bfbd-9c624c3b8c52-kube-api-access-4z6qq\") pod \"authorino-75d556bd77-dgq96\" (UID: \"770a5593-fbc5-498e-bfbd-9c624c3b8c52\") " pod="kuadrant-system/authorino-75d556bd77-dgq96"
Jul 13 21:29:19.963642 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:19.963619    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z6qq\" (UniqueName: \"kubernetes.io/projected/770a5593-fbc5-498e-bfbd-9c624c3b8c52-kube-api-access-4z6qq\") pod \"authorino-75d556bd77-dgq96\" (UID: \"770a5593-fbc5-498e-bfbd-9c624c3b8c52\") " pod="kuadrant-system/authorino-75d556bd77-dgq96"
Jul 13 21:29:20.095087 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:20.095046    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dgq96"
Jul 13 21:29:20.223090 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:20.223066    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dgq96"]
Jul 13 21:29:20.225233 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:29:20.225204    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod770a5593_fbc5_498e_bfbd_9c624c3b8c52.slice/crio-122f26660b6b68fdfc70e415c4d9a2759d2cc29de04d5bcb7d731393a930f0c3 WatchSource:0}: Error finding container 122f26660b6b68fdfc70e415c4d9a2759d2cc29de04d5bcb7d731393a930f0c3: Status 404 returned error can't find the container with id 122f26660b6b68fdfc70e415c4d9a2759d2cc29de04d5bcb7d731393a930f0c3
Jul 13 21:29:20.765266 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:20.765227    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dgq96" event={"ID":"770a5593-fbc5-498e-bfbd-9c624c3b8c52","Type":"ContainerStarted","Data":"122f26660b6b68fdfc70e415c4d9a2759d2cc29de04d5bcb7d731393a930f0c3"}
Jul 13 21:29:23.789077 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:23.789037    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dgq96" event={"ID":"770a5593-fbc5-498e-bfbd-9c624c3b8c52","Type":"ContainerStarted","Data":"dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617"}
Jul 13 21:29:23.804096 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:23.804053    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dgq96" podStartSLOduration=1.840770969 podStartE2EDuration="4.804039411s" totalImagesPullingTime="2.963268442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:29:23.802625007 +0000 UTC m=+468.891905160" watchObservedRunningTime="2026-07-13 21:29:23.804039411 +0000 UTC m=+468.893319563"
Jul 13 21:29:54.264917 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.264882    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dgq96"]
Jul 13 21:29:54.265445 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.265082    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dgq96" podUID="770a5593-fbc5-498e-bfbd-9c624c3b8c52" containerName="authorino" containerID="cri-o://dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617" gracePeriod=30
Jul 13 21:29:54.518877 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.518821    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dgq96"
Jul 13 21:29:54.646701 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.646668    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z6qq\" (UniqueName: \"kubernetes.io/projected/770a5593-fbc5-498e-bfbd-9c624c3b8c52-kube-api-access-4z6qq\") pod \"770a5593-fbc5-498e-bfbd-9c624c3b8c52\" (UID: \"770a5593-fbc5-498e-bfbd-9c624c3b8c52\") "
Jul 13 21:29:54.648795 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.648766    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/770a5593-fbc5-498e-bfbd-9c624c3b8c52-kube-api-access-4z6qq" (OuterVolumeSpecName: "kube-api-access-4z6qq") pod "770a5593-fbc5-498e-bfbd-9c624c3b8c52" (UID: "770a5593-fbc5-498e-bfbd-9c624c3b8c52"). InnerVolumeSpecName "kube-api-access-4z6qq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:29:54.747928 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.747897    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z6qq\" (UniqueName: \"kubernetes.io/projected/770a5593-fbc5-498e-bfbd-9c624c3b8c52-kube-api-access-4z6qq\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:29:54.928138 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.928103    2575 generic.go:356] "Generic (PLEG): container finished" podID="770a5593-fbc5-498e-bfbd-9c624c3b8c52" containerID="dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617" exitCode=0
Jul 13 21:29:54.928307 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.928146    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dgq96"
Jul 13 21:29:54.928307 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.928186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dgq96" event={"ID":"770a5593-fbc5-498e-bfbd-9c624c3b8c52","Type":"ContainerDied","Data":"dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617"}
Jul 13 21:29:54.928307 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.928227    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dgq96" event={"ID":"770a5593-fbc5-498e-bfbd-9c624c3b8c52","Type":"ContainerDied","Data":"122f26660b6b68fdfc70e415c4d9a2759d2cc29de04d5bcb7d731393a930f0c3"}
Jul 13 21:29:54.928307 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.928247    2575 scope.go:117] "RemoveContainer" containerID="dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617"
Jul 13 21:29:54.937487 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.937471    2575 scope.go:117] "RemoveContainer" containerID="dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617"
Jul 13 21:29:54.937759 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:29:54.937740    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617\": container with ID starting with dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617 not found: ID does not exist" containerID="dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617"
Jul 13 21:29:54.937811 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.937769    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617"} err="failed to get container status \"dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617\": rpc error: code = NotFound desc = could not find container \"dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617\": container with ID starting with dfae8d097d57f083661495f671e7aaaab7ef228672cdca7cfc081bb2eccbb617 not found: ID does not exist"
Jul 13 21:29:54.992817 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:54.992785    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dgq96"]
Jul 13 21:29:55.014492 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:55.014461    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dgq96"]
Jul 13 21:29:55.468485 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:29:55.468453    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="770a5593-fbc5-498e-bfbd-9c624c3b8c52" path="/var/lib/kubelet/pods/770a5593-fbc5-498e-bfbd-9c624c3b8c52/volumes"
Jul 13 21:30:34.610874 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.610795    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"]
Jul 13 21:30:34.611465 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.611284    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="770a5593-fbc5-498e-bfbd-9c624c3b8c52" containerName="authorino"
Jul 13 21:30:34.611465 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.611303    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="770a5593-fbc5-498e-bfbd-9c624c3b8c52" containerName="authorino"
Jul 13 21:30:34.611465 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.611448    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="770a5593-fbc5-498e-bfbd-9c624c3b8c52" containerName="authorino"
Jul 13 21:30:34.614297 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.614279    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"
Jul 13 21:30:34.617040 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.617023    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 13 21:30:34.617232 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.617215    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g7zmg\""
Jul 13 21:30:34.628638 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.628614    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"]
Jul 13 21:30:34.688388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.688349    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7mgc\" (UniqueName: \"kubernetes.io/projected/c3ac8a89-1b8a-421b-aed0-73630fdc50c9-kube-api-access-p7mgc\") pod \"payload-processing-f9b8d9b9b-8vwpd\" (UID: \"c3ac8a89-1b8a-421b-aed0-73630fdc50c9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"
Jul 13 21:30:34.688564 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.688498    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3ac8a89-1b8a-421b-aed0-73630fdc50c9-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-8vwpd\" (UID: \"c3ac8a89-1b8a-421b-aed0-73630fdc50c9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"
Jul 13 21:30:34.789272 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.789236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7mgc\" (UniqueName: \"kubernetes.io/projected/c3ac8a89-1b8a-421b-aed0-73630fdc50c9-kube-api-access-p7mgc\") pod \"payload-processing-f9b8d9b9b-8vwpd\" (UID: \"c3ac8a89-1b8a-421b-aed0-73630fdc50c9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"
Jul 13 21:30:34.789464 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.789387    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3ac8a89-1b8a-421b-aed0-73630fdc50c9-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-8vwpd\" (UID: \"c3ac8a89-1b8a-421b-aed0-73630fdc50c9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"
Jul 13 21:30:34.790052 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.790033    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3ac8a89-1b8a-421b-aed0-73630fdc50c9-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-8vwpd\" (UID: \"c3ac8a89-1b8a-421b-aed0-73630fdc50c9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"
Jul 13 21:30:34.799389 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.799359    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7mgc\" (UniqueName: \"kubernetes.io/projected/c3ac8a89-1b8a-421b-aed0-73630fdc50c9-kube-api-access-p7mgc\") pod \"payload-processing-f9b8d9b9b-8vwpd\" (UID: \"c3ac8a89-1b8a-421b-aed0-73630fdc50c9\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"
Jul 13 21:30:34.923889 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:34.923801    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"
Jul 13 21:30:35.086944 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:35.086921    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"]
Jul 13 21:30:35.089487 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:30:35.089460    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ac8a89_1b8a_421b_aed0_73630fdc50c9.slice/crio-70b3a26fc3c9afa4e27eae61036ec249a8013ca1bc47a625f733c339db0af438 WatchSource:0}: Error finding container 70b3a26fc3c9afa4e27eae61036ec249a8013ca1bc47a625f733c339db0af438: Status 404 returned error can't find the container with id 70b3a26fc3c9afa4e27eae61036ec249a8013ca1bc47a625f733c339db0af438
Jul 13 21:30:35.112925 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:35.112895    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd" event={"ID":"c3ac8a89-1b8a-421b-aed0-73630fdc50c9","Type":"ContainerStarted","Data":"70b3a26fc3c9afa4e27eae61036ec249a8013ca1bc47a625f733c339db0af438"}
Jul 13 21:30:37.124492 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:37.124458    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd" event={"ID":"c3ac8a89-1b8a-421b-aed0-73630fdc50c9","Type":"ContainerStarted","Data":"dbd4524ef86c902f2f90928b3dfcd831733bd53ae2a439bbec4a8c3a93c161d8"}
Jul 13 21:30:37.124908 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:37.124564    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"
Jul 13 21:30:37.141370 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:37.141293    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd" podStartSLOduration=1.6159272279999999 podStartE2EDuration="3.141269587s" totalImagesPullingTime="1.525342359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:30:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:30:37.140146218 +0000 UTC m=+542.229426372" watchObservedRunningTime="2026-07-13 21:30:37.141269587 +0000 UTC m=+542.230549737"
Jul 13 21:30:42.149458 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:42.149379    2575 generic.go:356] "Generic (PLEG): container finished" podID="f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc" containerID="04dc3e594a0fab569a08c86b10a314d0737dfb1aad5974966c52f43ae274fbd5" exitCode=0
Jul 13 21:30:42.149848 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:42.149451    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p" event={"ID":"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc","Type":"ContainerDied","Data":"04dc3e594a0fab569a08c86b10a314d0737dfb1aad5974966c52f43ae274fbd5"}
Jul 13 21:30:42.149894 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:42.149850    2575 scope.go:117] "RemoveContainer" containerID="04dc3e594a0fab569a08c86b10a314d0737dfb1aad5974966c52f43ae274fbd5"
Jul 13 21:30:42.150961 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:42.150933    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:30:42.151033 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:42.151016    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:30:42.151084 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:42.151067    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:30:43.158863 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:43.158832    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p" event={"ID":"f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc","Type":"ContainerStarted","Data":"3cfce630dec92674225ae8f284baaf108c2f8fabcf06b9ec7421e67536e837d7"}
Jul 13 21:30:43.172242 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:43.172212    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:30:43.172415 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:43.172383    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dv98p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 13 21:30:43.172467 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:43.172425    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p" podUID="f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 13 21:30:44.173133 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:44.173103    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dv98p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 13 21:30:44.173512 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:44.173154    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p" podUID="f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 13 21:30:45.172845 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:45.172811    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dv98p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 13 21:30:45.173055 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:45.172870    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p" podUID="f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 13 21:30:46.172240 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:46.172210    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dv98p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 13 21:30:46.172641 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:46.172260    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p" podUID="f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 13 21:30:47.172447 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:47.172403    2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-dv98p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Jul 13 21:30:47.172948 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:47.172466    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p" podUID="f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Jul 13 21:30:48.131664 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:48.131632    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-8vwpd"
Jul 13 21:30:48.176227 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:48.176190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:30:48.176641 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:48.176552    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:30:48.177301 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:30:48.177277    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-dv98p"
Jul 13 21:31:10.884918 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.884869    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"]
Jul 13 21:31:10.887267 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.887250    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:10.890084 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.890064    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 21:31:10.891193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.891175    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 21:31:10.891317 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.891300    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 13 21:31:10.891407 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.891388    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rkxvv\""
Jul 13 21:31:10.897613 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.897591    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"]
Jul 13 21:31:10.915117 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.915085    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:10.915401 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.915374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:10.915526 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.915423    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:10.915526 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.915500    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a476321c-c6ec-4a54-bcdf-272cc0d310d0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:10.915623 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.915543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:10.915667 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:10.915624    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npb8q\" (UniqueName: \"kubernetes.io/projected/a476321c-c6ec-4a54-bcdf-272cc0d310d0-kube-api-access-npb8q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.016778 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.016741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npb8q\" (UniqueName: \"kubernetes.io/projected/a476321c-c6ec-4a54-bcdf-272cc0d310d0-kube-api-access-npb8q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.016778 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.016784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.017020 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.016827    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.017020 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.016850    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.017020 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.016872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a476321c-c6ec-4a54-bcdf-272cc0d310d0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.017020 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.016890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.017324 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.017302    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.017415 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.017328    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.017415 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.017388    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.019179 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.019158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a476321c-c6ec-4a54-bcdf-272cc0d310d0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.019394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.019376    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a476321c-c6ec-4a54-bcdf-272cc0d310d0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.025355 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.025321    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npb8q\" (UniqueName: \"kubernetes.io/projected/a476321c-c6ec-4a54-bcdf-272cc0d310d0-kube-api-access-npb8q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qj68t\" (UID: \"a476321c-c6ec-4a54-bcdf-272cc0d310d0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.198015 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.197915    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:11.333956 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:11.333932    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"]
Jul 13 21:31:11.336002 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:31:11.335974    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda476321c_c6ec_4a54_bcdf_272cc0d310d0.slice/crio-db6f1b09a436ca88925f11d2e4bb2cf34a8c6a816e052be38859f69399073475 WatchSource:0}: Error finding container db6f1b09a436ca88925f11d2e4bb2cf34a8c6a816e052be38859f69399073475: Status 404 returned error can't find the container with id db6f1b09a436ca88925f11d2e4bb2cf34a8c6a816e052be38859f69399073475
Jul 13 21:31:12.296865 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:12.296829    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t" event={"ID":"a476321c-c6ec-4a54-bcdf-272cc0d310d0","Type":"ContainerStarted","Data":"db6f1b09a436ca88925f11d2e4bb2cf34a8c6a816e052be38859f69399073475"}
Jul 13 21:31:13.303563 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:13.303528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t" event={"ID":"a476321c-c6ec-4a54-bcdf-272cc0d310d0","Type":"ContainerStarted","Data":"d685f3cc58276f5e64e0ecf5b8448f62c36a90906b2f855b71ace4309e9ed4a5"}
Jul 13 21:31:13.321705 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:13.321652    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t" podStartSLOduration=2.279203933 podStartE2EDuration="3.321636415s" totalImagesPullingTime="1.042432482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:31:13.319642837 +0000 UTC m=+578.408923008" watchObservedRunningTime="2026-07-13 21:31:13.321636415 +0000 UTC m=+578.410916567"
Jul 13 21:31:21.198759 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:21.198711    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:21.199260 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:21.198801    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:21.211453 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:21.211422    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:21.357537 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:21.357507    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qj68t"
Jul 13 21:31:33.302878 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.302839    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"]
Jul 13 21:31:33.306803 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.306780    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.309972 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.309952    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 13 21:31:33.321053 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.321020    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"]
Jul 13 21:31:33.406229 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.406200    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.406450 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.406263    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d9fffdb-ee14-4926-b51d-8686018913d2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.406450 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.406321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.406450 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.406386    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.406450 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.406437    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.406617 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.406464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpjqv\" (UniqueName: \"kubernetes.io/projected/5d9fffdb-ee14-4926-b51d-8686018913d2-kube-api-access-qpjqv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.507248 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.507210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.507470 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.507259    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.507470 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.507278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpjqv\" (UniqueName: \"kubernetes.io/projected/5d9fffdb-ee14-4926-b51d-8686018913d2-kube-api-access-qpjqv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.507470 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.507323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.507650 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.507547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d9fffdb-ee14-4926-b51d-8686018913d2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.507706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.507667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.507764 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.507721    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.507957 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.507938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.508030 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.508013    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.509607 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.509587    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d9fffdb-ee14-4926-b51d-8686018913d2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.509877 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.509859    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d9fffdb-ee14-4926-b51d-8686018913d2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.516842 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.516819    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpjqv\" (UniqueName: \"kubernetes.io/projected/5d9fffdb-ee14-4926-b51d-8686018913d2-kube-api-access-qpjqv\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4csxn\" (UID: \"5d9fffdb-ee14-4926-b51d-8686018913d2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.617088 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.616988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:33.750393 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:33.750368    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"]
Jul 13 21:31:33.752556 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:31:33.752529    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9fffdb_ee14_4926_b51d_8686018913d2.slice/crio-17152cde4aec2efc9ad73fdae70ddb0a69a4ae9623f2f791d9a13f1fc6b9a46c WatchSource:0}: Error finding container 17152cde4aec2efc9ad73fdae70ddb0a69a4ae9623f2f791d9a13f1fc6b9a46c: Status 404 returned error can't find the container with id 17152cde4aec2efc9ad73fdae70ddb0a69a4ae9623f2f791d9a13f1fc6b9a46c
Jul 13 21:31:34.413690 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:34.413652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn" event={"ID":"5d9fffdb-ee14-4926-b51d-8686018913d2","Type":"ContainerStarted","Data":"644e6b9f4eefa62402b862325945f857f7fce474bbfeaf2fea3cc80202d6b808"}
Jul 13 21:31:34.414082 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:34.413727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn" event={"ID":"5d9fffdb-ee14-4926-b51d-8686018913d2","Type":"ContainerStarted","Data":"17152cde4aec2efc9ad73fdae70ddb0a69a4ae9623f2f791d9a13f1fc6b9a46c"}
Jul 13 21:31:34.434694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:34.434640    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn" podStartSLOduration=1.240686904 podStartE2EDuration="1.43462415s" totalImagesPullingTime="193.937246ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:31:34.432496288 +0000 UTC m=+599.521776454" watchObservedRunningTime="2026-07-13 21:31:34.43462415 +0000 UTC m=+599.523904299"
Jul 13 21:31:35.363005 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:35.362979    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:31:35.364456 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:35.364434    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:31:35.366325 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:35.366305    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:31:35.367897 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:35.367880    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:31:43.617806 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:43.617753    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:43.618414 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:43.617842    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:43.631895 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:43.631867    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:31:44.471822 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:31:44.471788    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4csxn"
Jul 13 21:36:35.392795 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:36:35.392768    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:36:35.393652 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:36:35.393631    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:36:35.396310 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:36:35.396292    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:36:35.397188 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:36:35.397171    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:41:35.421788 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:41:35.421759    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:41:35.424319 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:41:35.423325    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:41:35.428172 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:41:35.428151    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:41:35.429452 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:41:35.429431    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:45:41.520746 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.520669    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"]
Jul 13 21:45:41.523722 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.523702    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.526493 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.526474    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9b188814-openshift-default-dockercfg-99p7w\""
Jul 13 21:45:41.537355 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.537320    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"]
Jul 13 21:45:41.694990 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.694952    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-data\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.694990 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.694995    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ff70f54-6048-4025-8584-93196aa05cec-istio-podinfo\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.695185 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.695018    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-socket\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.695185 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.695061    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ff70f54-6048-4025-8584-93196aa05cec-istiod-ca-cert\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.695185 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.695152    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-envoy\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.695283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.695187    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-istio-token\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.695283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.695224    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dzhv\" (UniqueName: \"kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-kube-api-access-9dzhv\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.695283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.695252    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-certs\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.695283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.695280    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-credential-socket\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.796707 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.796617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-envoy\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.796707 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.796656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-istio-token\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.796707 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.796677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dzhv\" (UniqueName: \"kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-kube-api-access-9dzhv\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.796914 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.796790    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-certs\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.796914 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.796837    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-credential-socket\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.797000 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.796914    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-data\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.797000 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.796965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ff70f54-6048-4025-8584-93196aa05cec-istio-podinfo\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.797073 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.797018    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-socket\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.797073 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.797050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ff70f54-6048-4025-8584-93196aa05cec-istiod-ca-cert\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.797204 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.797184    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-certs\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.797276 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.797254    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-credential-socket\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.797332 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.797314    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-data\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.797428 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.797406    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-socket\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.797705 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.797689    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ff70f54-6048-4025-8584-93196aa05cec-istiod-ca-cert\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.798884 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.798866    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-envoy\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.799291 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.799275    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ff70f54-6048-4025-8584-93196aa05cec-istio-podinfo\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.806966 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.806938    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dzhv\" (UniqueName: \"kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-kube-api-access-9dzhv\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.807279 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.807263    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-istio-token\") pod \"e2e-ait-9b188814-openshift-default-c8f974977-5gmjc\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") " pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.834601 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.834572    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:41.974890 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.974855    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"]
Jul 13 21:45:41.977990 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:45:41.977960    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff70f54_6048_4025_8584_93196aa05cec.slice/crio-cfb320b8d42db87215ef36bdb228e6b0e28e5db69cf7508596afadaa1f630b31 WatchSource:0}: Error finding container cfb320b8d42db87215ef36bdb228e6b0e28e5db69cf7508596afadaa1f630b31: Status 404 returned error can't find the container with id cfb320b8d42db87215ef36bdb228e6b0e28e5db69cf7508596afadaa1f630b31
Jul 13 21:45:41.980031 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.979996    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:45:41.980135 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.980076    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:45:41.980135 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:41.980119    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:45:42.389480 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:42.389446    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" event={"ID":"2ff70f54-6048-4025-8584-93196aa05cec","Type":"ContainerStarted","Data":"9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90"}
Jul 13 21:45:42.389673 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:42.389500    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" event={"ID":"2ff70f54-6048-4025-8584-93196aa05cec","Type":"ContainerStarted","Data":"cfb320b8d42db87215ef36bdb228e6b0e28e5db69cf7508596afadaa1f630b31"}
Jul 13 21:45:42.412725 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:42.412672    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" podStartSLOduration=1.412657338 podStartE2EDuration="1.412657338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:45:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:45:42.410547968 +0000 UTC m=+1447.499828146" watchObservedRunningTime="2026-07-13 21:45:42.412657338 +0000 UTC m=+1447.501937490"
Jul 13 21:45:42.835466 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:42.835434    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:43.840086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:43.840053    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:44.398965 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:44.398939    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:44.400004 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:44.399984    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:54.448065 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:54.447970    2575 generic.go:356] "Generic (PLEG): container finished" podID="2ff70f54-6048-4025-8584-93196aa05cec" containerID="9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90" exitCode=0
Jul 13 21:45:54.448065 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:54.448041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" event={"ID":"2ff70f54-6048-4025-8584-93196aa05cec","Type":"ContainerDied","Data":"9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90"}
Jul 13 21:45:54.448515 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:54.448450    2575 scope.go:117] "RemoveContainer" containerID="9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90"
Jul 13 21:45:54.449442 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:54.449418    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:45:54.449507 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:54.449484    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:45:54.449550 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:54.449519    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:45:55.457685 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:55.457646    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" event={"ID":"2ff70f54-6048-4025-8584-93196aa05cec","Type":"ContainerStarted","Data":"6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99"}
Jul 13 21:45:55.835528 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:55.835487    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:55.837179 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:55.837141    2575 patch_prober.go:28] interesting pod/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 13 21:45:55.837329 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:55.837215    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 13 21:45:56.835303 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:56.835256    2575 patch_prober.go:28] interesting pod/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 13 21:45:56.835836 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:56.835360    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 13 21:45:57.836226 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:57.836177    2575 patch_prober.go:28] interesting pod/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 13 21:45:57.836726 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:57.836253    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 13 21:45:58.836485 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:58.835975    2575 patch_prober.go:28] interesting pod/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 13 21:45:58.836485 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:58.836051    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 13 21:45:59.399438 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:59.399388    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:59.839131 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:59.839097    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:45:59.839999 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:45:59.839981    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:46:35.452927 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:35.452898    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:46:35.456038 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:35.456018    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:46:35.456267 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:35.456238    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:46:35.462519 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:35.462498    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:46:47.808799 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:47.808758    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w"]
Jul 13 21:46:47.812044 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:47.812026    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w"
Jul 13 21:46:47.817559 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:47.817538    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vjqr5\""
Jul 13 21:46:47.817828 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:47.817804    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:46:47.826708 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:47.826671    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w"]
Jul 13 21:46:47.884835 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:47.884750    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27bd48e8-faff-4dd8-a748-fce857bce011-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9b188814-89c9w\" (UID: \"27bd48e8-faff-4dd8-a748-fce857bce011\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w"
Jul 13 21:46:47.985977 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:47.985940    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27bd48e8-faff-4dd8-a748-fce857bce011-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9b188814-89c9w\" (UID: \"27bd48e8-faff-4dd8-a748-fce857bce011\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w"
Jul 13 21:46:47.986588 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:47.986569    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27bd48e8-faff-4dd8-a748-fce857bce011-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9b188814-89c9w\" (UID: \"27bd48e8-faff-4dd8-a748-fce857bce011\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w"
Jul 13 21:46:48.122319 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:48.122230    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w"
Jul 13 21:46:48.462736 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:48.462706    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w"]
Jul 13 21:46:48.464828 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:46:48.464801    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27bd48e8_faff_4dd8_a748_fce857bce011.slice/crio-740b643406b8ea61b7ef6ad221693efa37b03e8a5e7339f86cd823875c4d8b86 WatchSource:0}: Error finding container 740b643406b8ea61b7ef6ad221693efa37b03e8a5e7339f86cd823875c4d8b86: Status 404 returned error can't find the container with id 740b643406b8ea61b7ef6ad221693efa37b03e8a5e7339f86cd823875c4d8b86
Jul 13 21:46:48.466525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:48.466510    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:46:48.717218 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:48.717136    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w" event={"ID":"27bd48e8-faff-4dd8-a748-fce857bce011","Type":"ContainerStarted","Data":"740b643406b8ea61b7ef6ad221693efa37b03e8a5e7339f86cd823875c4d8b86"}
Jul 13 21:46:51.734507 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:51.734418    2575 generic.go:356] "Generic (PLEG): container finished" podID="27bd48e8-faff-4dd8-a748-fce857bce011" containerID="186f6adeb76c5e671cda63af9b137d092e0cc282ad188701af9f550f42fc308d" exitCode=0
Jul 13 21:46:51.734858 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:51.734509    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w" event={"ID":"27bd48e8-faff-4dd8-a748-fce857bce011","Type":"ContainerDied","Data":"186f6adeb76c5e671cda63af9b137d092e0cc282ad188701af9f550f42fc308d"}
Jul 13 21:46:52.879184 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:52.879155    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w"
Jul 13 21:46:52.932678 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:52.932649    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27bd48e8-faff-4dd8-a748-fce857bce011-maas-api-service-ca\") pod \"27bd48e8-faff-4dd8-a748-fce857bce011\" (UID: \"27bd48e8-faff-4dd8-a748-fce857bce011\") "
Jul 13 21:46:52.933022 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:52.933001    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27bd48e8-faff-4dd8-a748-fce857bce011-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27bd48e8-faff-4dd8-a748-fce857bce011" (UID: "27bd48e8-faff-4dd8-a748-fce857bce011"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:46:53.033402 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:53.033293    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27bd48e8-faff-4dd8-a748-fce857bce011-maas-api-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:46:53.745688 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:53.745591    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w" event={"ID":"27bd48e8-faff-4dd8-a748-fce857bce011","Type":"ContainerDied","Data":"740b643406b8ea61b7ef6ad221693efa37b03e8a5e7339f86cd823875c4d8b86"}
Jul 13 21:46:53.745688 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:53.745618    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9b188814-89c9w"
Jul 13 21:46:53.745688 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:46:53.745644    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="740b643406b8ea61b7ef6ad221693efa37b03e8a5e7339f86cd823875c4d8b86"
Jul 13 21:47:13.073118 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.072893    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"]
Jul 13 21:47:13.073967 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.073246    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy" containerID="cri-o://6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99" gracePeriod=30
Jul 13 21:47:13.704497 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.704466    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"]
Jul 13 21:47:13.704844 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.704832    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27bd48e8-faff-4dd8-a748-fce857bce011" containerName="revoke-keys"
Jul 13 21:47:13.704937 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.704845    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="27bd48e8-faff-4dd8-a748-fce857bce011" containerName="revoke-keys"
Jul 13 21:47:13.704937 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.704922    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="27bd48e8-faff-4dd8-a748-fce857bce011" containerName="revoke-keys"
Jul 13 21:47:13.707742 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.707725    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.711918 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.711894    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c9a3e9a3-gw-openshift-default-dockercfg-7vsnx\""
Jul 13 21:47:13.826955 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.826920    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-certs\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.827129 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.827002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-credential-socket\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.827129 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.827046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9mx4\" (UniqueName: \"kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-kube-api-access-q9mx4\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.827129 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.827098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istiod-ca-cert\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.827244 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.827138    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-token\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.827244 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.827168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-data\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.827244 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.827217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-envoy\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.827381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.827257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-podinfo\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.827381 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.827293    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-socket\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.836717 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.836683    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"]
Jul 13 21:47:13.927940 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.927900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istiod-ca-cert\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928133 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.927959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-token\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928133 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-data\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928133 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-envoy\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928305 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928164    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-podinfo\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928305 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-socket\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928305 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928285    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-certs\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-credential-socket\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9mx4\" (UniqueName: \"kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-kube-api-access-q9mx4\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928453    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-data\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928788 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928764    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istiod-ca-cert\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928865 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928790    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-certs\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928930 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928895    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-socket\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.928988 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.928942    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-credential-socket\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.930578 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.930541    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-envoy\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.930817 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.930800    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-podinfo\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.943242 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.943218    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-token\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:13.943376 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:13.943267    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9mx4\" (UniqueName: \"kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-kube-api-access-q9mx4\") pod \"e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") " pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:14.018069 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:14.017980    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:14.160247 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:14.160218    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"]
Jul 13 21:47:14.162179 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:47:14.162146    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d11541d_a4c6_466b_8fc1_dd7b8785cd1f.slice/crio-a0f788af46fda97ce3e23de5f248220b964db3dbea633f29ccbfa020a2c80e2b WatchSource:0}: Error finding container a0f788af46fda97ce3e23de5f248220b964db3dbea633f29ccbfa020a2c80e2b: Status 404 returned error can't find the container with id a0f788af46fda97ce3e23de5f248220b964db3dbea633f29ccbfa020a2c80e2b
Jul 13 21:47:14.164301 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:14.164267    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:47:14.164391 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:14.164357    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:47:14.164433 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:14.164391    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:47:14.842188 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:14.842153    2575 patch_prober.go:28] interesting pod/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 13 21:47:14.842382 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:14.842214    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:47:14.845394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:14.845366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" event={"ID":"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f","Type":"ContainerStarted","Data":"b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d"}
Jul 13 21:47:14.845494 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:14.845443    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" event={"ID":"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f","Type":"ContainerStarted","Data":"a0f788af46fda97ce3e23de5f248220b964db3dbea633f29ccbfa020a2c80e2b"}
Jul 13 21:47:14.870603 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:14.870557    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" podStartSLOduration=1.8705447240000002 podStartE2EDuration="1.870544724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:47:14.869083784 +0000 UTC m=+1539.958363958" watchObservedRunningTime="2026-07-13 21:47:14.870544724 +0000 UTC m=+1539.959824877"
Jul 13 21:47:15.018295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:15.018260    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:15.023330 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:15.023299    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:15.850944 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:15.850908    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:15.851787 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:15.851767    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:18.375525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.375501    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:47:18.565192 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565152    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-socket\") pod \"2ff70f54-6048-4025-8584-93196aa05cec\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") "
Jul 13 21:47:18.565417 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565217    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-envoy\") pod \"2ff70f54-6048-4025-8584-93196aa05cec\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") "
Jul 13 21:47:18.565417 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565244    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ff70f54-6048-4025-8584-93196aa05cec-istio-podinfo\") pod \"2ff70f54-6048-4025-8584-93196aa05cec\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") "
Jul 13 21:47:18.565417 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565260    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-istio-token\") pod \"2ff70f54-6048-4025-8584-93196aa05cec\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") "
Jul 13 21:47:18.565417 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565283    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dzhv\" (UniqueName: \"kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-kube-api-access-9dzhv\") pod \"2ff70f54-6048-4025-8584-93196aa05cec\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") "
Jul 13 21:47:18.565417 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565309    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-data\") pod \"2ff70f54-6048-4025-8584-93196aa05cec\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") "
Jul 13 21:47:18.565417 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565332    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-certs\") pod \"2ff70f54-6048-4025-8584-93196aa05cec\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") "
Jul 13 21:47:18.565735 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565425    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ff70f54-6048-4025-8584-93196aa05cec-istiod-ca-cert\") pod \"2ff70f54-6048-4025-8584-93196aa05cec\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") "
Jul 13 21:47:18.565735 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565447    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-credential-socket\") pod \"2ff70f54-6048-4025-8584-93196aa05cec\" (UID: \"2ff70f54-6048-4025-8584-93196aa05cec\") "
Jul 13 21:47:18.565735 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565482    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2ff70f54-6048-4025-8584-93196aa05cec" (UID: "2ff70f54-6048-4025-8584-93196aa05cec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:18.565735 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565646    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2ff70f54-6048-4025-8584-93196aa05cec" (UID: "2ff70f54-6048-4025-8584-93196aa05cec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:18.565888 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565754    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:47:18.565888 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565771    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:47:18.565888 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.565802    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2ff70f54-6048-4025-8584-93196aa05cec" (UID: "2ff70f54-6048-4025-8584-93196aa05cec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:18.566060 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.566034    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff70f54-6048-4025-8584-93196aa05cec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2ff70f54-6048-4025-8584-93196aa05cec" (UID: "2ff70f54-6048-4025-8584-93196aa05cec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:47:18.566355 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.566314    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-data" (OuterVolumeSpecName: "istio-data") pod "2ff70f54-6048-4025-8584-93196aa05cec" (UID: "2ff70f54-6048-4025-8584-93196aa05cec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:18.567746 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.567722    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2ff70f54-6048-4025-8584-93196aa05cec" (UID: "2ff70f54-6048-4025-8584-93196aa05cec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:47:18.567821 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.567752    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2ff70f54-6048-4025-8584-93196aa05cec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2ff70f54-6048-4025-8584-93196aa05cec" (UID: "2ff70f54-6048-4025-8584-93196aa05cec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:47:18.567982 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.567959    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-istio-token" (OuterVolumeSpecName: "istio-token") pod "2ff70f54-6048-4025-8584-93196aa05cec" (UID: "2ff70f54-6048-4025-8584-93196aa05cec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:47:18.568062 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.567996    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-kube-api-access-9dzhv" (OuterVolumeSpecName: "kube-api-access-9dzhv") pod "2ff70f54-6048-4025-8584-93196aa05cec" (UID: "2ff70f54-6048-4025-8584-93196aa05cec"). InnerVolumeSpecName "kube-api-access-9dzhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:47:18.667054 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.666972    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:47:18.667054 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.666998    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2ff70f54-6048-4025-8584-93196aa05cec-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:47:18.667054 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.667007    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:47:18.667054 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.667017    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dzhv\" (UniqueName: \"kubernetes.io/projected/2ff70f54-6048-4025-8584-93196aa05cec-kube-api-access-9dzhv\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:47:18.667054 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.667025    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:47:18.667054 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.667033    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2ff70f54-6048-4025-8584-93196aa05cec-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:47:18.667054 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.667040    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2ff70f54-6048-4025-8584-93196aa05cec-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:47:18.867898 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.867857    2575 generic.go:356] "Generic (PLEG): container finished" podID="2ff70f54-6048-4025-8584-93196aa05cec" containerID="6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99" exitCode=0
Jul 13 21:47:18.867898 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.867893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" event={"ID":"2ff70f54-6048-4025-8584-93196aa05cec","Type":"ContainerDied","Data":"6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99"}
Jul 13 21:47:18.868147 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.867914    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"
Jul 13 21:47:18.868147 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.867950    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc" event={"ID":"2ff70f54-6048-4025-8584-93196aa05cec","Type":"ContainerDied","Data":"cfb320b8d42db87215ef36bdb228e6b0e28e5db69cf7508596afadaa1f630b31"}
Jul 13 21:47:18.868147 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.867973    2575 scope.go:117] "RemoveContainer" containerID="6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99"
Jul 13 21:47:18.877561 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.877544    2575 scope.go:117] "RemoveContainer" containerID="9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90"
Jul 13 21:47:18.885645 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.885623    2575 scope.go:117] "RemoveContainer" containerID="6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99"
Jul 13 21:47:18.885895 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:47:18.885877    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99\": container with ID starting with 6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99 not found: ID does not exist" containerID="6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99"
Jul 13 21:47:18.885939 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.885902    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99"} err="failed to get container status \"6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99\": rpc error: code = NotFound desc = could not find container \"6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99\": container with ID starting with 6d08f1269dd33b4529e3ea07848062d5f88d8817d40f3eebcd740de6b5525a99 not found: ID does not exist"
Jul 13 21:47:18.885939 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.885919    2575 scope.go:117] "RemoveContainer" containerID="9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90"
Jul 13 21:47:18.886180 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:47:18.886159    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90\": container with ID starting with 9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90 not found: ID does not exist" containerID="9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90"
Jul 13 21:47:18.886222 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.886189    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90"} err="failed to get container status \"9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90\": rpc error: code = NotFound desc = could not find container \"9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90\": container with ID starting with 9d65fb218bb26e928efb29dafe1a9a8cff89c9b0158a7ab1a672f1f3113d4a90 not found: ID does not exist"
Jul 13 21:47:18.891065 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.891043    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"]
Jul 13 21:47:18.899731 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:18.899711    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9b188814-openshift-default-c8f974977-5gmjc"]
Jul 13 21:47:19.460222 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.460183    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"]
Jul 13 21:47:19.460628 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.460583    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy"
Jul 13 21:47:19.460628 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.460595    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy"
Jul 13 21:47:19.460628 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.460604    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy"
Jul 13 21:47:19.460628 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.460610    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy"
Jul 13 21:47:19.460763 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.460675    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy"
Jul 13 21:47:19.460763 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.460684    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ff70f54-6048-4025-8584-93196aa05cec" containerName="istio-proxy"
Jul 13 21:47:19.465457 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.465435    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"
Jul 13 21:47:19.468093 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.468070    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:47:19.468212 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.468152    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vjqr5\""
Jul 13 21:47:19.472155 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.472123    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0ddde9-3c9e-460f-a0d8-58d21e3e0665-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh\" (UID: \"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"
Jul 13 21:47:19.472351 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.472313    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ff70f54-6048-4025-8584-93196aa05cec" path="/var/lib/kubelet/pods/2ff70f54-6048-4025-8584-93196aa05cec/volumes"
Jul 13 21:47:19.474128 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.474105    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"]
Jul 13 21:47:19.573566 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.573531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0ddde9-3c9e-460f-a0d8-58d21e3e0665-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh\" (UID: \"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"
Jul 13 21:47:19.574203 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.574179    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0ddde9-3c9e-460f-a0d8-58d21e3e0665-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh\" (UID: \"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"
Jul 13 21:47:19.777564 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.777465    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"
Jul 13 21:47:19.954533 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:19.954502    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"]
Jul 13 21:47:19.958687 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:47:19.958661    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0ddde9_3c9e_460f_a0d8_58d21e3e0665.slice/crio-78484b382090a9021fe3fa0af1b8135a20e2c784b0b824aa388ed7e499b6ed08 WatchSource:0}: Error finding container 78484b382090a9021fe3fa0af1b8135a20e2c784b0b824aa388ed7e499b6ed08: Status 404 returned error can't find the container with id 78484b382090a9021fe3fa0af1b8135a20e2c784b0b824aa388ed7e499b6ed08
Jul 13 21:47:20.887129 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:20.887087    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh" event={"ID":"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665","Type":"ContainerStarted","Data":"3a0f11e8887f6953cd96bba7b2702cbb2977af885d6a1bd0adefddc91a0c279f"}
Jul 13 21:47:20.887576 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:20.887163    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh" event={"ID":"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665","Type":"ContainerStarted","Data":"78484b382090a9021fe3fa0af1b8135a20e2c784b0b824aa388ed7e499b6ed08"}
Jul 13 21:47:21.892994 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:21.892961    2575 generic.go:356] "Generic (PLEG): container finished" podID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerID="3a0f11e8887f6953cd96bba7b2702cbb2977af885d6a1bd0adefddc91a0c279f" exitCode=7
Jul 13 21:47:21.892994 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:21.892999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh" event={"ID":"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665","Type":"ContainerDied","Data":"3a0f11e8887f6953cd96bba7b2702cbb2977af885d6a1bd0adefddc91a0c279f"}
Jul 13 21:47:21.893433 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:21.893194    2575 scope.go:117] "RemoveContainer" containerID="3a0f11e8887f6953cd96bba7b2702cbb2977af885d6a1bd0adefddc91a0c279f"
Jul 13 21:47:22.902145 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:22.902110    2575 generic.go:356] "Generic (PLEG): container finished" podID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerID="4facb4c624c496123e16a151ec3ac647c13e67eba317a0700aed5d7f5e56bb13" exitCode=7
Jul 13 21:47:22.902145 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:22.902151    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh" event={"ID":"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665","Type":"ContainerDied","Data":"4facb4c624c496123e16a151ec3ac647c13e67eba317a0700aed5d7f5e56bb13"}
Jul 13 21:47:22.902645 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:22.902204    2575 scope.go:117] "RemoveContainer" containerID="3a0f11e8887f6953cd96bba7b2702cbb2977af885d6a1bd0adefddc91a0c279f"
Jul 13 21:47:22.902645 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:22.902479    2575 scope.go:117] "RemoveContainer" containerID="4facb4c624c496123e16a151ec3ac647c13e67eba317a0700aed5d7f5e56bb13"
Jul 13 21:47:22.902818 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:47:22.902750    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh_odh-ai-gateway-infra(0c0ddde9-3c9e-460f-a0d8-58d21e3e0665)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665"
Jul 13 21:47:23.908588 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:23.908559    2575 scope.go:117] "RemoveContainer" containerID="4facb4c624c496123e16a151ec3ac647c13e67eba317a0700aed5d7f5e56bb13"
Jul 13 21:47:23.909057 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:47:23.908757    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh_odh-ai-gateway-infra(0c0ddde9-3c9e-460f-a0d8-58d21e3e0665)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665"
Jul 13 21:47:25.919159 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:25.919125    2575 generic.go:356] "Generic (PLEG): container finished" podID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerID="b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d" exitCode=0
Jul 13 21:47:25.919614 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:25.919198    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" event={"ID":"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f","Type":"ContainerDied","Data":"b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d"}
Jul 13 21:47:25.919614 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:25.919603    2575 scope.go:117] "RemoveContainer" containerID="b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d"
Jul 13 21:47:25.920585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:25.920556    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:47:25.920676 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:25.920624    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:47:25.920676 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:25.920656    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:47:26.925999 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:26.925964    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" event={"ID":"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f","Type":"ContainerStarted","Data":"9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8"}
Jul 13 21:47:27.019019 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:27.018982    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:27.019900 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:27.019879    2575 patch_prober.go:28] interesting pod/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 13 21:47:27.019953 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:27.019933    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 13 21:47:28.018597 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:28.018561    2575 patch_prober.go:28] interesting pod/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 13 21:47:28.018974 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:28.018631    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 13 21:47:29.018590 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:29.018557    2575 patch_prober.go:28] interesting pod/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 13 21:47:29.018768 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:29.018626    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 13 21:47:30.018919 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:30.018882    2575 patch_prober.go:28] interesting pod/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 13 21:47:30.019410 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:30.018944    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 13 21:47:30.851532 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:30.851493    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:31.022939 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:31.022909    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:31.023800 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:31.023784    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:47:34.463474 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:34.463435    2575 scope.go:117] "RemoveContainer" containerID="4facb4c624c496123e16a151ec3ac647c13e67eba317a0700aed5d7f5e56bb13"
Jul 13 21:47:34.974529 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:34.974496    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh" event={"ID":"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665","Type":"ContainerStarted","Data":"b9e2e162eb86d340d7ef7caa023a48ea9d8c125a73782ecfdb8bcfa0a5fdc27d"}
Jul 13 21:47:34.992907 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:34.992815    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh" podStartSLOduration=15.992800132 podStartE2EDuration="15.992800132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:47:20.915837538 +0000 UTC m=+1546.005117691" watchObservedRunningTime="2026-07-13 21:47:34.992800132 +0000 UTC m=+1560.082080285"
Jul 13 21:47:35.981432 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:35.981399    2575 generic.go:356] "Generic (PLEG): container finished" podID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerID="b9e2e162eb86d340d7ef7caa023a48ea9d8c125a73782ecfdb8bcfa0a5fdc27d" exitCode=0
Jul 13 21:47:35.981861 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:35.981470    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh" event={"ID":"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665","Type":"ContainerDied","Data":"b9e2e162eb86d340d7ef7caa023a48ea9d8c125a73782ecfdb8bcfa0a5fdc27d"}
Jul 13 21:47:35.981861 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:35.981524    2575 scope.go:117] "RemoveContainer" containerID="4facb4c624c496123e16a151ec3ac647c13e67eba317a0700aed5d7f5e56bb13"
Jul 13 21:47:36.007199 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:36.007163    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"]
Jul 13 21:47:37.129292 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:37.129270    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"
Jul 13 21:47:37.236975 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:37.236945    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0ddde9-3c9e-460f-a0d8-58d21e3e0665-maas-api-service-ca\") pod \"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665\" (UID: \"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665\") "
Jul 13 21:47:37.237331 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:37.237306    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c0ddde9-3c9e-460f-a0d8-58d21e3e0665-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" (UID: "0c0ddde9-3c9e-460f-a0d8-58d21e3e0665"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:47:37.338066 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:37.338032    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0ddde9-3c9e-460f-a0d8-58d21e3e0665-maas-api-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:47:37.992921 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:37.992894    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"
Jul 13 21:47:37.993092 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:37.992928    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh" event={"ID":"0c0ddde9-3c9e-460f-a0d8-58d21e3e0665","Type":"ContainerDied","Data":"78484b382090a9021fe3fa0af1b8135a20e2c784b0b824aa388ed7e499b6ed08"}
Jul 13 21:47:37.993092 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:37.992969    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78484b382090a9021fe3fa0af1b8135a20e2c784b0b824aa388ed7e499b6ed08"
Jul 13 21:47:38.025434 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:38.025405    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"]
Jul 13 21:47:38.030039 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:38.030016    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-ns2xh"]
Jul 13 21:47:39.468886 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:47:39.468852    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" path="/var/lib/kubelet/pods/0c0ddde9-3c9e-460f-a0d8-58d21e3e0665/volumes"
Jul 13 21:48:09.507853 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.507817    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g"]
Jul 13 21:48:09.508277 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.508187    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerName="revoke-keys"
Jul 13 21:48:09.508277 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.508197    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerName="revoke-keys"
Jul 13 21:48:09.508277 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.508207    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerName="revoke-keys"
Jul 13 21:48:09.508277 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.508213    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerName="revoke-keys"
Jul 13 21:48:09.508277 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.508221    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerName="revoke-keys"
Jul 13 21:48:09.508277 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.508227    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerName="revoke-keys"
Jul 13 21:48:09.508490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.508288    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerName="revoke-keys"
Jul 13 21:48:09.508490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.508298    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerName="revoke-keys"
Jul 13 21:48:09.510245 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.510227    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g"
Jul 13 21:48:09.512992 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.512970    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:48:09.512992 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.512987    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vjqr5\""
Jul 13 21:48:09.518957 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.518925    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g"]
Jul 13 21:48:09.632285 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.632243    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a982937-4ed7-45dd-8104-9d02288a690f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g\" (UID: \"8a982937-4ed7-45dd-8104-9d02288a690f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g"
Jul 13 21:48:09.733487 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.733439    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a982937-4ed7-45dd-8104-9d02288a690f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g\" (UID: \"8a982937-4ed7-45dd-8104-9d02288a690f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g"
Jul 13 21:48:09.734106 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.734083    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a982937-4ed7-45dd-8104-9d02288a690f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g\" (UID: \"8a982937-4ed7-45dd-8104-9d02288a690f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g"
Jul 13 21:48:09.821801 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.821767    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g"
Jul 13 21:48:09.959229 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:09.959205    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g"]
Jul 13 21:48:09.961509 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:48:09.961482    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a982937_4ed7_45dd_8104_9d02288a690f.slice/crio-fd5c3dddeaecdda2692e9fd0643b2a8f3d790f2ddb67eabdff8af0640b4f0bbb WatchSource:0}: Error finding container fd5c3dddeaecdda2692e9fd0643b2a8f3d790f2ddb67eabdff8af0640b4f0bbb: Status 404 returned error can't find the container with id fd5c3dddeaecdda2692e9fd0643b2a8f3d790f2ddb67eabdff8af0640b4f0bbb
Jul 13 21:48:10.144701 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:10.144620    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g" event={"ID":"8a982937-4ed7-45dd-8104-9d02288a690f","Type":"ContainerStarted","Data":"fd5c3dddeaecdda2692e9fd0643b2a8f3d790f2ddb67eabdff8af0640b4f0bbb"}
Jul 13 21:48:11.150460 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:11.150422    2575 generic.go:356] "Generic (PLEG): container finished" podID="8a982937-4ed7-45dd-8104-9d02288a690f" containerID="841e70840504dbdbcd4a77a3756e248f918a43662edda4fa2d9f7c859d4d989a" exitCode=0
Jul 13 21:48:11.150851 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:11.150507    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g" event={"ID":"8a982937-4ed7-45dd-8104-9d02288a690f","Type":"ContainerDied","Data":"841e70840504dbdbcd4a77a3756e248f918a43662edda4fa2d9f7c859d4d989a"}
Jul 13 21:48:12.298919 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:12.298883    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g"
Jul 13 21:48:12.458606 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:12.458522    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a982937-4ed7-45dd-8104-9d02288a690f-maas-api-service-ca\") pod \"8a982937-4ed7-45dd-8104-9d02288a690f\" (UID: \"8a982937-4ed7-45dd-8104-9d02288a690f\") "
Jul 13 21:48:12.458891 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:12.458868    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a982937-4ed7-45dd-8104-9d02288a690f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a982937-4ed7-45dd-8104-9d02288a690f" (UID: "8a982937-4ed7-45dd-8104-9d02288a690f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:48:12.559934 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:12.559905    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a982937-4ed7-45dd-8104-9d02288a690f-maas-api-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:13.162962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:13.162925    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g" event={"ID":"8a982937-4ed7-45dd-8104-9d02288a690f","Type":"ContainerDied","Data":"fd5c3dddeaecdda2692e9fd0643b2a8f3d790f2ddb67eabdff8af0640b4f0bbb"}
Jul 13 21:48:13.162962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:13.162953    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g"
Jul 13 21:48:13.163167 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:13.162977    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd5c3dddeaecdda2692e9fd0643b2a8f3d790f2ddb67eabdff8af0640b4f0bbb"
Jul 13 21:48:19.567781 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:19.567748    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"]
Jul 13 21:48:19.568181 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:19.567948    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy" containerID="cri-o://9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8" gracePeriod=30
Jul 13 21:48:24.809875 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.809849    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:48:24.876527 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876488    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-credential-socket\") pod \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") "
Jul 13 21:48:24.876687 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876562    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-socket\") pod \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") "
Jul 13 21:48:24.876687 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876609    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-envoy\") pod \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") "
Jul 13 21:48:24.876814 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876689    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istiod-ca-cert\") pod \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") "
Jul 13 21:48:24.876814 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876736    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-certs\") pod \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") "
Jul 13 21:48:24.876814 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876761    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9mx4\" (UniqueName: \"kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-kube-api-access-q9mx4\") pod \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") "
Jul 13 21:48:24.876814 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876765    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" (UID: "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:48:24.876814 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876790    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-podinfo\") pod \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") "
Jul 13 21:48:24.877083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876828    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-data\") pod \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") "
Jul 13 21:48:24.877083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876876    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-token\") pod \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\" (UID: \"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f\") "
Jul 13 21:48:24.877083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876875    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" (UID: "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:48:24.877083 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.876982    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" (UID: "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:48:24.877295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.877153    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" (UID: "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:48:24.877295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.877163    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:24.877295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.877201    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:24.877295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.877247    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:24.877866 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.877836    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" (UID: "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:48:24.879163 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.879138    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" (UID: "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:48:24.879324 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.879164    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" (UID: "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:48:24.879618 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.879594    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" (UID: "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:48:24.879715 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.879593    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-kube-api-access-q9mx4" (OuterVolumeSpecName: "kube-api-access-q9mx4") pod "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" (UID: "0d11541d-a4c6-466b-8fc1-dd7b8785cd1f"). InnerVolumeSpecName "kube-api-access-q9mx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:48:24.978250 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.978219    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:24.978250 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.978246    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:24.978449 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.978256    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9mx4\" (UniqueName: \"kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-kube-api-access-q9mx4\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:24.978449 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.978265    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:24.978449 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.978274    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:24.978449 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:24.978282    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:25.220978 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.220890    2575 generic.go:356] "Generic (PLEG): container finished" podID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerID="9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8" exitCode=0
Jul 13 21:48:25.220978 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.220946    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"
Jul 13 21:48:25.221245 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.220976    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" event={"ID":"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f","Type":"ContainerDied","Data":"9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8"}
Jul 13 21:48:25.221245 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.221058    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w" event={"ID":"0d11541d-a4c6-466b-8fc1-dd7b8785cd1f","Type":"ContainerDied","Data":"a0f788af46fda97ce3e23de5f248220b964db3dbea633f29ccbfa020a2c80e2b"}
Jul 13 21:48:25.221245 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.221083    2575 scope.go:117] "RemoveContainer" containerID="9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8"
Jul 13 21:48:25.230385 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.230369    2575 scope.go:117] "RemoveContainer" containerID="b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d"
Jul 13 21:48:25.240362 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.240327    2575 scope.go:117] "RemoveContainer" containerID="9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8"
Jul 13 21:48:25.240904 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:48:25.240875    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8\": container with ID starting with 9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8 not found: ID does not exist" containerID="9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8"
Jul 13 21:48:25.241025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.240911    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8"} err="failed to get container status \"9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8\": rpc error: code = NotFound desc = could not find container \"9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8\": container with ID starting with 9065b47990d2d6d55681a70050da0e21bfdff4960eee9feedfc35872ad20b6c8 not found: ID does not exist"
Jul 13 21:48:25.241025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.240942    2575 scope.go:117] "RemoveContainer" containerID="b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d"
Jul 13 21:48:25.241287 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:48:25.241243    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d\": container with ID starting with b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d not found: ID does not exist" containerID="b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d"
Jul 13 21:48:25.241287 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.241276    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d"} err="failed to get container status \"b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d\": rpc error: code = NotFound desc = could not find container \"b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d\": container with ID starting with b154618e72f8b9ba77077e12c289092c424dfed4b6e2403ca8ddfce4a8a9cc4d not found: ID does not exist"
Jul 13 21:48:25.243169 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.243150    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"]
Jul 13 21:48:25.247565 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.247546    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c9a3e9a3-gw-openshift-default-588556c579-nr64w"]
Jul 13 21:48:25.469262 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.469229    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" path="/var/lib/kubelet/pods/0d11541d-a4c6-466b-8fc1-dd7b8785cd1f/volumes"
Jul 13 21:48:25.621702 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.621672    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"]
Jul 13 21:48:25.622218 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.622203    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy"
Jul 13 21:48:25.622268 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.622222    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy"
Jul 13 21:48:25.622268 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.622236    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy"
Jul 13 21:48:25.622268 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.622245    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy"
Jul 13 21:48:25.622268 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.622260    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a982937-4ed7-45dd-8104-9d02288a690f" containerName="revoke-keys"
Jul 13 21:48:25.622404 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.622269    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a982937-4ed7-45dd-8104-9d02288a690f" containerName="revoke-keys"
Jul 13 21:48:25.622404 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.622396    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy"
Jul 13 21:48:25.622468 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.622409    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a982937-4ed7-45dd-8104-9d02288a690f" containerName="revoke-keys"
Jul 13 21:48:25.622468 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.622422    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c0ddde9-3c9e-460f-a0d8-58d21e3e0665" containerName="revoke-keys"
Jul 13 21:48:25.622468 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.622434    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d11541d-a4c6-466b-8fc1-dd7b8785cd1f" containerName="istio-proxy"
Jul 13 21:48:25.627191 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.627170    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.629903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.629881    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8a043b23-openshift-default-dockercfg-lm6tc\""
Jul 13 21:48:25.639304 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.639281    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"]
Jul 13 21:48:25.684238 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.684217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-token\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.684388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.684259    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-envoy\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.684388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.684291    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-socket\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.684492 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.684405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-credential-socket\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.684492 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.684434    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-data\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.684492 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.684455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnvnc\" (UniqueName: \"kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-kube-api-access-rnvnc\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.684647 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.684540    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-podinfo\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.684647 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.684580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-certs\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.684647 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.684606    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5487334d-fc8a-49e6-ae05-95e70ba95db5-istiod-ca-cert\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.785557 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.785525    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-token\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.785726 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.785582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-envoy\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.785726 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.785628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-socket\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.785726 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.785672    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-credential-socket\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.785726 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.785695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-data\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.785726 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.785722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnvnc\" (UniqueName: \"kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-kube-api-access-rnvnc\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.786003 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.785756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-podinfo\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.786003 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.785788    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-certs\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.786003 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.785812    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5487334d-fc8a-49e6-ae05-95e70ba95db5-istiod-ca-cert\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.786162 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.786119    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-data\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.786162 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.786152    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-credential-socket\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.786279 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.786181    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-socket\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.786366 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.786309    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-certs\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.786569 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.786550    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5487334d-fc8a-49e6-ae05-95e70ba95db5-istiod-ca-cert\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.787779 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.787760    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-envoy\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.788160 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.788143    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-podinfo\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.794165 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.794142    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnvnc\" (UniqueName: \"kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-kube-api-access-rnvnc\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.794366 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.794332    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-token\") pod \"e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") " pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:25.937845 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:25.937750    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:26.089500 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:26.089468    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"]
Jul 13 21:48:26.092010 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:48:26.091980    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5487334d_fc8a_49e6_ae05_95e70ba95db5.slice/crio-f8d29fc9dd4b2947637ee2134726d7b9520e9dfbc956032efea2c865f1cd9986 WatchSource:0}: Error finding container f8d29fc9dd4b2947637ee2134726d7b9520e9dfbc956032efea2c865f1cd9986: Status 404 returned error can't find the container with id f8d29fc9dd4b2947637ee2134726d7b9520e9dfbc956032efea2c865f1cd9986
Jul 13 21:48:26.094237 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:26.094205    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:48:26.094313 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:26.094274    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:48:26.094313 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:26.094304    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:48:26.229203 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:26.229099    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" event={"ID":"5487334d-fc8a-49e6-ae05-95e70ba95db5","Type":"ContainerStarted","Data":"42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39"}
Jul 13 21:48:26.229203 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:26.229167    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" event={"ID":"5487334d-fc8a-49e6-ae05-95e70ba95db5","Type":"ContainerStarted","Data":"f8d29fc9dd4b2947637ee2134726d7b9520e9dfbc956032efea2c865f1cd9986"}
Jul 13 21:48:26.249767 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:26.249707    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" podStartSLOduration=1.24968596 podStartE2EDuration="1.24968596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:48:26.248491189 +0000 UTC m=+1611.337771371" watchObservedRunningTime="2026-07-13 21:48:26.24968596 +0000 UTC m=+1611.338966114"
Jul 13 21:48:26.938091 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:26.938061    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:27.943901 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:27.943875    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:28.239867 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:28.239782    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:28.240845 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:28.240824    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:31.802517 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:31.802477    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"]
Jul 13 21:48:31.806132 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:31.806114    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"
Jul 13 21:48:31.810456 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:31.810434    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:48:31.810574 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:31.810510    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vjqr5\""
Jul 13 21:48:31.815692 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:31.815670    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"]
Jul 13 21:48:31.842827 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:31.841758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/619e4328-78a1-4ee0-94d4-c02ef262cd0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a043b23-z72j2\" (UID: \"619e4328-78a1-4ee0-94d4-c02ef262cd0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"
Jul 13 21:48:31.943238 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:31.943201    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/619e4328-78a1-4ee0-94d4-c02ef262cd0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a043b23-z72j2\" (UID: \"619e4328-78a1-4ee0-94d4-c02ef262cd0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"
Jul 13 21:48:31.944318 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:31.944272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/619e4328-78a1-4ee0-94d4-c02ef262cd0a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a043b23-z72j2\" (UID: \"619e4328-78a1-4ee0-94d4-c02ef262cd0a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"
Jul 13 21:48:32.117935 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:32.117845    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"
Jul 13 21:48:32.292078 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:32.292055    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"]
Jul 13 21:48:32.294233 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:48:32.294203    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619e4328_78a1_4ee0_94d4_c02ef262cd0a.slice/crio-635ba2f13d615a795ee312248c2a74e1dac53e2b2e7c0d868257d720c0940e09 WatchSource:0}: Error finding container 635ba2f13d615a795ee312248c2a74e1dac53e2b2e7c0d868257d720c0940e09: Status 404 returned error can't find the container with id 635ba2f13d615a795ee312248c2a74e1dac53e2b2e7c0d868257d720c0940e09
Jul 13 21:48:33.271172 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:33.271133    2575 generic.go:356] "Generic (PLEG): container finished" podID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerID="1feb1c8de9268a5939e1a4ec42465bc8a3f4bbb7e7f96fc61407215160ca7b11" exitCode=7
Jul 13 21:48:33.271578 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:33.271193    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2" event={"ID":"619e4328-78a1-4ee0-94d4-c02ef262cd0a","Type":"ContainerDied","Data":"1feb1c8de9268a5939e1a4ec42465bc8a3f4bbb7e7f96fc61407215160ca7b11"}
Jul 13 21:48:33.271578 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:33.271243    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2" event={"ID":"619e4328-78a1-4ee0-94d4-c02ef262cd0a","Type":"ContainerStarted","Data":"635ba2f13d615a795ee312248c2a74e1dac53e2b2e7c0d868257d720c0940e09"}
Jul 13 21:48:33.271578 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:33.271470    2575 scope.go:117] "RemoveContainer" containerID="1feb1c8de9268a5939e1a4ec42465bc8a3f4bbb7e7f96fc61407215160ca7b11"
Jul 13 21:48:34.278321 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:34.278282    2575 generic.go:356] "Generic (PLEG): container finished" podID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerID="4e4c2e4b1a8686d05761189e693d0248eacb66c3bb33f183a6ae5b7748337542" exitCode=7
Jul 13 21:48:34.278723 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:34.278381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2" event={"ID":"619e4328-78a1-4ee0-94d4-c02ef262cd0a","Type":"ContainerDied","Data":"4e4c2e4b1a8686d05761189e693d0248eacb66c3bb33f183a6ae5b7748337542"}
Jul 13 21:48:34.278723 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:34.278435    2575 scope.go:117] "RemoveContainer" containerID="1feb1c8de9268a5939e1a4ec42465bc8a3f4bbb7e7f96fc61407215160ca7b11"
Jul 13 21:48:34.278723 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:34.278609    2575 scope.go:117] "RemoveContainer" containerID="4e4c2e4b1a8686d05761189e693d0248eacb66c3bb33f183a6ae5b7748337542"
Jul 13 21:48:34.278863 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:48:34.278843    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8a043b23-z72j2_odh-ai-gateway-infra(619e4328-78a1-4ee0-94d4-c02ef262cd0a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a"
Jul 13 21:48:35.284998 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:35.284916    2575 scope.go:117] "RemoveContainer" containerID="4e4c2e4b1a8686d05761189e693d0248eacb66c3bb33f183a6ae5b7748337542"
Jul 13 21:48:35.285355 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:48:35.285111    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8a043b23-z72j2_odh-ai-gateway-infra(619e4328-78a1-4ee0-94d4-c02ef262cd0a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a"
Jul 13 21:48:38.303273 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:38.303242    2575 generic.go:356] "Generic (PLEG): container finished" podID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerID="42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39" exitCode=0
Jul 13 21:48:38.303719 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:38.303310    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" event={"ID":"5487334d-fc8a-49e6-ae05-95e70ba95db5","Type":"ContainerDied","Data":"42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39"}
Jul 13 21:48:38.303768 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:38.303736    2575 scope.go:117] "RemoveContainer" containerID="42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39"
Jul 13 21:48:38.304679 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:38.304652    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:48:38.304744 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:38.304719    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:48:38.304781 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:38.304749    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:48:39.309659 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:39.309622    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" event={"ID":"5487334d-fc8a-49e6-ae05-95e70ba95db5","Type":"ContainerStarted","Data":"e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005"}
Jul 13 21:48:39.937977 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:39.937942    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:39.939104 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:39.939070    2575 patch_prober.go:28] interesting pod/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 13 21:48:39.939248 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:39.939139    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 13 21:48:40.940821 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:40.940778    2575 patch_prober.go:28] interesting pod/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 13 21:48:40.941328 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:40.940851    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 13 21:48:41.938742 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:41.938698    2575 patch_prober.go:28] interesting pod/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 13 21:48:41.938956 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:41.938779    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 13 21:48:42.938991 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:42.938952    2575 patch_prober.go:28] interesting pod/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 13 21:48:42.939602 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:42.939569    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 13 21:48:43.240400 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:43.240313    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:43.942018 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:43.941989    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:43.942798 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:43.942780    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:48:48.463884 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:48.463852    2575 scope.go:117] "RemoveContainer" containerID="4e4c2e4b1a8686d05761189e693d0248eacb66c3bb33f183a6ae5b7748337542"
Jul 13 21:48:49.359825 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:49.359792    2575 generic.go:356] "Generic (PLEG): container finished" podID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerID="cc38ebfd2c3286584280bf26a7206a658d4069f60469aece45df50b273186e49" exitCode=0
Jul 13 21:48:49.359988 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:49.359864    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2" event={"ID":"619e4328-78a1-4ee0-94d4-c02ef262cd0a","Type":"ContainerDied","Data":"cc38ebfd2c3286584280bf26a7206a658d4069f60469aece45df50b273186e49"}
Jul 13 21:48:49.359988 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:49.359920    2575 scope.go:117] "RemoveContainer" containerID="4e4c2e4b1a8686d05761189e693d0248eacb66c3bb33f183a6ae5b7748337542"
Jul 13 21:48:50.411429 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:50.411397    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"]
Jul 13 21:48:50.504642 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:50.504617    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"
Jul 13 21:48:50.623402 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:50.623295    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/619e4328-78a1-4ee0-94d4-c02ef262cd0a-maas-api-service-ca\") pod \"619e4328-78a1-4ee0-94d4-c02ef262cd0a\" (UID: \"619e4328-78a1-4ee0-94d4-c02ef262cd0a\") "
Jul 13 21:48:50.623633 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:50.623605    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/619e4328-78a1-4ee0-94d4-c02ef262cd0a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "619e4328-78a1-4ee0-94d4-c02ef262cd0a" (UID: "619e4328-78a1-4ee0-94d4-c02ef262cd0a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:48:50.724939 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:50.724912    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/619e4328-78a1-4ee0-94d4-c02ef262cd0a-maas-api-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:48:51.371893 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:51.371863    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"
Jul 13 21:48:51.372093 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:51.371903    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2" event={"ID":"619e4328-78a1-4ee0-94d4-c02ef262cd0a","Type":"ContainerDied","Data":"635ba2f13d615a795ee312248c2a74e1dac53e2b2e7c0d868257d720c0940e09"}
Jul 13 21:48:51.372093 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:51.371954    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="635ba2f13d615a795ee312248c2a74e1dac53e2b2e7c0d868257d720c0940e09"
Jul 13 21:48:51.400378 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:51.400348    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"]
Jul 13 21:48:51.403031 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:51.403006    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-z72j2"]
Jul 13 21:48:51.469737 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:48:51.469708    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" path="/var/lib/kubelet/pods/619e4328-78a1-4ee0-94d4-c02ef262cd0a/volumes"
Jul 13 21:49:21.866883 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.866852    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6"]
Jul 13 21:49:21.867394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.867223    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerName="revoke-keys"
Jul 13 21:49:21.867394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.867234    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerName="revoke-keys"
Jul 13 21:49:21.867394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.867245    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerName="revoke-keys"
Jul 13 21:49:21.867394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.867250    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerName="revoke-keys"
Jul 13 21:49:21.867394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.867265    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerName="revoke-keys"
Jul 13 21:49:21.867394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.867270    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerName="revoke-keys"
Jul 13 21:49:21.867394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.867356    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerName="revoke-keys"
Jul 13 21:49:21.867394 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.867362    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerName="revoke-keys"
Jul 13 21:49:21.870193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.870173    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6"
Jul 13 21:49:21.874001 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.873984    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vjqr5\""
Jul 13 21:49:21.874154 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.874072    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:49:21.891958 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.891929    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6"]
Jul 13 21:49:21.997499 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:21.997463    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb8a4c13-10af-49f5-905f-220fe540d0a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6\" (UID: \"bb8a4c13-10af-49f5-905f-220fe540d0a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6"
Jul 13 21:49:22.098235 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:22.098204    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb8a4c13-10af-49f5-905f-220fe540d0a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6\" (UID: \"bb8a4c13-10af-49f5-905f-220fe540d0a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6"
Jul 13 21:49:22.098820 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:22.098799    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb8a4c13-10af-49f5-905f-220fe540d0a2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6\" (UID: \"bb8a4c13-10af-49f5-905f-220fe540d0a2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6"
Jul 13 21:49:22.180758 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:22.180668    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6"
Jul 13 21:49:22.321528 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:22.321500    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6"]
Jul 13 21:49:22.520734 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:22.520649    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6" event={"ID":"bb8a4c13-10af-49f5-905f-220fe540d0a2","Type":"ContainerStarted","Data":"795518a85c1d412b8e5b222b9697945a3085e2b75d893f83cf8d3fc746cb135d"}
Jul 13 21:49:23.526484 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:23.526388    2575 generic.go:356] "Generic (PLEG): container finished" podID="bb8a4c13-10af-49f5-905f-220fe540d0a2" containerID="3b351741b8949539a0584133589fc7e4989d3321605515ddeb437c15da1f92ff" exitCode=0
Jul 13 21:49:23.526838 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:23.526472    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6" event={"ID":"bb8a4c13-10af-49f5-905f-220fe540d0a2","Type":"ContainerDied","Data":"3b351741b8949539a0584133589fc7e4989d3321605515ddeb437c15da1f92ff"}
Jul 13 21:49:24.667494 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:24.667468    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6"
Jul 13 21:49:24.723220 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:24.723190    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb8a4c13-10af-49f5-905f-220fe540d0a2-maas-api-service-ca\") pod \"bb8a4c13-10af-49f5-905f-220fe540d0a2\" (UID: \"bb8a4c13-10af-49f5-905f-220fe540d0a2\") "
Jul 13 21:49:24.723649 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:24.723617    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb8a4c13-10af-49f5-905f-220fe540d0a2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb8a4c13-10af-49f5-905f-220fe540d0a2" (UID: "bb8a4c13-10af-49f5-905f-220fe540d0a2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:49:24.824636 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:24.824608    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb8a4c13-10af-49f5-905f-220fe540d0a2-maas-api-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:49:25.538122 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:25.538084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6" event={"ID":"bb8a4c13-10af-49f5-905f-220fe540d0a2","Type":"ContainerDied","Data":"795518a85c1d412b8e5b222b9697945a3085e2b75d893f83cf8d3fc746cb135d"}
Jul 13 21:49:25.538122 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:25.538124    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6"
Jul 13 21:49:25.538320 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:25.538144    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="795518a85c1d412b8e5b222b9697945a3085e2b75d893f83cf8d3fc746cb135d"
Jul 13 21:49:47.921273 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:47.921235    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"]
Jul 13 21:49:47.921743 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:47.921455    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy" containerID="cri-o://e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005" gracePeriod=30
Jul 13 21:49:48.187862 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.187781    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"]
Jul 13 21:49:48.188604 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.188576    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb8a4c13-10af-49f5-905f-220fe540d0a2" containerName="revoke-keys"
Jul 13 21:49:48.188604 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.188605    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb8a4c13-10af-49f5-905f-220fe540d0a2" containerName="revoke-keys"
Jul 13 21:49:48.188740 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.188725    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="619e4328-78a1-4ee0-94d4-c02ef262cd0a" containerName="revoke-keys"
Jul 13 21:49:48.188775 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.188739    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb8a4c13-10af-49f5-905f-220fe540d0a2" containerName="revoke-keys"
Jul 13 21:49:48.192280 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.192257    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.195170 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.195152    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7fdae48e-openshift-default-dockercfg-5gkkb\""
Jul 13 21:49:48.205416 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.205391    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"]
Jul 13 21:49:48.331585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.331553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-credential-socket\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.331742 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.331593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-token\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.331742 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.331636    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-data\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.331742 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.331658    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzzsw\" (UniqueName: \"kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-kube-api-access-xzzsw\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.331742 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.331688    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-podinfo\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.331742 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.331707    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-envoy\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.331742 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.331726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istiod-ca-cert\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.331948 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.331744    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-socket\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.331948 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.331774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-certs\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433049 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istiod-ca-cert\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433049 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-socket\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433299 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-certs\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433299 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433279    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-credential-socket\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433429 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-token\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433429 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-data\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433429 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzzsw\" (UniqueName: \"kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-kube-api-access-xzzsw\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433588 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433453    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-podinfo\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433588 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-envoy\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433588 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-socket\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433588 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433563    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-certs\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.433910 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.433883    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istiod-ca-cert\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.434111 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.434088    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-data\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.434190 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.434090    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-credential-socket\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.435766 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.435737    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-envoy\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.436019 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.436001    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-podinfo\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.442565 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.442490    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-token\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.442651 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.442627    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzzsw\" (UniqueName: \"kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-kube-api-access-xzzsw\") pod \"e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") " pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.503497 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.503467    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:48.638677 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.638652    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"]
Jul 13 21:49:48.639568 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:49:48.639534    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3de909_a0b2_4c4f_a364_e0ef43b7be04.slice/crio-06a4f1eb0ed929f560d7239ef7ce80323cbece140ad41fa90beac9918e161f28 WatchSource:0}: Error finding container 06a4f1eb0ed929f560d7239ef7ce80323cbece140ad41fa90beac9918e161f28: Status 404 returned error can't find the container with id 06a4f1eb0ed929f560d7239ef7ce80323cbece140ad41fa90beac9918e161f28
Jul 13 21:49:48.641706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.641663    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:49:48.641772 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.641753    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:49:48.641831 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.641805    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:49:48.649227 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:48.649206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" event={"ID":"0a3de909-a0b2-4c4f-a364-e0ef43b7be04","Type":"ContainerStarted","Data":"06a4f1eb0ed929f560d7239ef7ce80323cbece140ad41fa90beac9918e161f28"}
Jul 13 21:49:49.656270 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:49.656230    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" event={"ID":"0a3de909-a0b2-4c4f-a364-e0ef43b7be04","Type":"ContainerStarted","Data":"4a0bfb44606239c7e0f515df14a0aa209204e6ad0af45afb79772ae7f77c9f18"}
Jul 13 21:49:49.692447 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:49.692392    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" podStartSLOduration=1.692374496 podStartE2EDuration="1.692374496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:49:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:49:49.690148463 +0000 UTC m=+1694.779428636" watchObservedRunningTime="2026-07-13 21:49:49.692374496 +0000 UTC m=+1694.781654720"
Jul 13 21:49:50.504523 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:50.504491    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:50.509490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:50.509461    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:50.661389 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:50.661360    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:50.662286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:50.662269    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:49:53.182487 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.182463    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:49:53.277194 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277167    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnvnc\" (UniqueName: \"kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-kube-api-access-rnvnc\") pod \"5487334d-fc8a-49e6-ae05-95e70ba95db5\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") "
Jul 13 21:49:53.277313 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277200    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-podinfo\") pod \"5487334d-fc8a-49e6-ae05-95e70ba95db5\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") "
Jul 13 21:49:53.277313 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277230    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-token\") pod \"5487334d-fc8a-49e6-ae05-95e70ba95db5\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") "
Jul 13 21:49:53.277313 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277245    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-socket\") pod \"5487334d-fc8a-49e6-ae05-95e70ba95db5\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") "
Jul 13 21:49:53.277313 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277275    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-credential-socket\") pod \"5487334d-fc8a-49e6-ae05-95e70ba95db5\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") "
Jul 13 21:49:53.277313 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277300    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-envoy\") pod \"5487334d-fc8a-49e6-ae05-95e70ba95db5\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") "
Jul 13 21:49:53.277604 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277353    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-data\") pod \"5487334d-fc8a-49e6-ae05-95e70ba95db5\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") "
Jul 13 21:49:53.277604 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277403    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5487334d-fc8a-49e6-ae05-95e70ba95db5-istiod-ca-cert\") pod \"5487334d-fc8a-49e6-ae05-95e70ba95db5\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") "
Jul 13 21:49:53.277604 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277429    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-certs\") pod \"5487334d-fc8a-49e6-ae05-95e70ba95db5\" (UID: \"5487334d-fc8a-49e6-ae05-95e70ba95db5\") "
Jul 13 21:49:53.277604 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277580    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5487334d-fc8a-49e6-ae05-95e70ba95db5" (UID: "5487334d-fc8a-49e6-ae05-95e70ba95db5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:49:53.277604 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277595    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5487334d-fc8a-49e6-ae05-95e70ba95db5" (UID: "5487334d-fc8a-49e6-ae05-95e70ba95db5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:49:53.277886 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277824    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5487334d-fc8a-49e6-ae05-95e70ba95db5" (UID: "5487334d-fc8a-49e6-ae05-95e70ba95db5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:49:53.277886 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277847    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:49:53.278000 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.277885    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:49:53.278088 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.278061    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5487334d-fc8a-49e6-ae05-95e70ba95db5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5487334d-fc8a-49e6-ae05-95e70ba95db5" (UID: "5487334d-fc8a-49e6-ae05-95e70ba95db5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:49:53.278523 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.278495    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-data" (OuterVolumeSpecName: "istio-data") pod "5487334d-fc8a-49e6-ae05-95e70ba95db5" (UID: "5487334d-fc8a-49e6-ae05-95e70ba95db5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:49:53.279530 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.279507    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-kube-api-access-rnvnc" (OuterVolumeSpecName: "kube-api-access-rnvnc") pod "5487334d-fc8a-49e6-ae05-95e70ba95db5" (UID: "5487334d-fc8a-49e6-ae05-95e70ba95db5"). InnerVolumeSpecName "kube-api-access-rnvnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:49:53.279639 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.279570    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5487334d-fc8a-49e6-ae05-95e70ba95db5" (UID: "5487334d-fc8a-49e6-ae05-95e70ba95db5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:49:53.279639 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.279574    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-token" (OuterVolumeSpecName: "istio-token") pod "5487334d-fc8a-49e6-ae05-95e70ba95db5" (UID: "5487334d-fc8a-49e6-ae05-95e70ba95db5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:49:53.279855 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.279834    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5487334d-fc8a-49e6-ae05-95e70ba95db5" (UID: "5487334d-fc8a-49e6-ae05-95e70ba95db5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:49:53.378446 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.378422    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:49:53.378446 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.378444    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5487334d-fc8a-49e6-ae05-95e70ba95db5-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:49:53.378446 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.378453    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:49:53.378642 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.378461    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnvnc\" (UniqueName: \"kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-kube-api-access-rnvnc\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:49:53.378642 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.378470    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:49:53.378642 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.378478    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:49:53.378642 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.378486    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5487334d-fc8a-49e6-ae05-95e70ba95db5-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:49:53.678700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.678663    2575 generic.go:356] "Generic (PLEG): container finished" podID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerID="e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005" exitCode=0
Jul 13 21:49:53.678898 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.678734    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"
Jul 13 21:49:53.678898 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.678751    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" event={"ID":"5487334d-fc8a-49e6-ae05-95e70ba95db5","Type":"ContainerDied","Data":"e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005"}
Jul 13 21:49:53.678898 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.678801    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs" event={"ID":"5487334d-fc8a-49e6-ae05-95e70ba95db5","Type":"ContainerDied","Data":"f8d29fc9dd4b2947637ee2134726d7b9520e9dfbc956032efea2c865f1cd9986"}
Jul 13 21:49:53.678898 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.678828    2575 scope.go:117] "RemoveContainer" containerID="e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005"
Jul 13 21:49:53.687920 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.687905    2575 scope.go:117] "RemoveContainer" containerID="42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39"
Jul 13 21:49:53.696194 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.696175    2575 scope.go:117] "RemoveContainer" containerID="e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005"
Jul 13 21:49:53.696482 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:49:53.696461    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005\": container with ID starting with e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005 not found: ID does not exist" containerID="e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005"
Jul 13 21:49:53.696580 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.696491    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005"} err="failed to get container status \"e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005\": rpc error: code = NotFound desc = could not find container \"e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005\": container with ID starting with e80766dff329e4a7390b620a62683ba31544c9740e597b4f0e63906159b98005 not found: ID does not exist"
Jul 13 21:49:53.696580 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.696507    2575 scope.go:117] "RemoveContainer" containerID="42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39"
Jul 13 21:49:53.696735 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:49:53.696720    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39\": container with ID starting with 42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39 not found: ID does not exist" containerID="42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39"
Jul 13 21:49:53.696786 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.696739    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39"} err="failed to get container status \"42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39\": rpc error: code = NotFound desc = could not find container \"42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39\": container with ID starting with 42453654e9cec87052ae7c4a4ae03de8cb86d3b28504a7c086e0cf4cd31aac39 not found: ID does not exist"
Jul 13 21:49:53.697101 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.697079    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"]
Jul 13 21:49:53.702270 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.702248    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8a043b23-openshift-default-f665b6c97-8w5xs"]
Jul 13 21:49:53.708838 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.708818    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"]
Jul 13 21:49:53.709169 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.709157    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy"
Jul 13 21:49:53.709213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.709171    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy"
Jul 13 21:49:53.709213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.709185    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy"
Jul 13 21:49:53.709213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.709192    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy"
Jul 13 21:49:53.709310 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.709261    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy"
Jul 13 21:49:53.709310 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.709271    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" containerName="istio-proxy"
Jul 13 21:49:53.713781 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.713767    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"
Jul 13 21:49:53.716401 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.716379    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:49:53.716483 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.716460    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vjqr5\""
Jul 13 21:49:53.720308 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.720291    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"]
Jul 13 21:49:53.781976 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.781945    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f19ab9-2ea6-407a-81de-c6022105222f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm\" (UID: \"a4f19ab9-2ea6-407a-81de-c6022105222f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"
Jul 13 21:49:53.882502 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.882473    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f19ab9-2ea6-407a-81de-c6022105222f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm\" (UID: \"a4f19ab9-2ea6-407a-81de-c6022105222f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"
Jul 13 21:49:53.883090 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:53.883058    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f19ab9-2ea6-407a-81de-c6022105222f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm\" (UID: \"a4f19ab9-2ea6-407a-81de-c6022105222f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"
Jul 13 21:49:54.024907 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:54.024830    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"
Jul 13 21:49:54.156320 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:54.156298    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"]
Jul 13 21:49:54.158976 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:49:54.158941    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f19ab9_2ea6_407a_81de_c6022105222f.slice/crio-38c307792ff49a9042987d1372fd4a388cbc4e3e3a3679e0eded8012c1bd40a9 WatchSource:0}: Error finding container 38c307792ff49a9042987d1372fd4a388cbc4e3e3a3679e0eded8012c1bd40a9: Status 404 returned error can't find the container with id 38c307792ff49a9042987d1372fd4a388cbc4e3e3a3679e0eded8012c1bd40a9
Jul 13 21:49:54.692193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:54.692106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm" event={"ID":"a4f19ab9-2ea6-407a-81de-c6022105222f","Type":"ContainerStarted","Data":"46a4098c4dfdd3d0646e83fe2767dd49bcabccba253c38d93a128ff60b1f8ca8"}
Jul 13 21:49:54.692193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:54.692186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm" event={"ID":"a4f19ab9-2ea6-407a-81de-c6022105222f","Type":"ContainerStarted","Data":"38c307792ff49a9042987d1372fd4a388cbc4e3e3a3679e0eded8012c1bd40a9"}
Jul 13 21:49:54.711193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:54.711148    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm" podStartSLOduration=1.7111330869999999 podStartE2EDuration="1.711133087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:49:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:49:54.709583484 +0000 UTC m=+1699.798863663" watchObservedRunningTime="2026-07-13 21:49:54.711133087 +0000 UTC m=+1699.800413239"
Jul 13 21:49:55.471039 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:55.471007    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5487334d-fc8a-49e6-ae05-95e70ba95db5" path="/var/lib/kubelet/pods/5487334d-fc8a-49e6-ae05-95e70ba95db5/volumes"
Jul 13 21:49:55.698495 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:55.698460    2575 generic.go:356] "Generic (PLEG): container finished" podID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerID="46a4098c4dfdd3d0646e83fe2767dd49bcabccba253c38d93a128ff60b1f8ca8" exitCode=7
Jul 13 21:49:55.698947 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:55.698534    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm" event={"ID":"a4f19ab9-2ea6-407a-81de-c6022105222f","Type":"ContainerDied","Data":"46a4098c4dfdd3d0646e83fe2767dd49bcabccba253c38d93a128ff60b1f8ca8"}
Jul 13 21:49:55.698947 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:55.698785    2575 scope.go:117] "RemoveContainer" containerID="46a4098c4dfdd3d0646e83fe2767dd49bcabccba253c38d93a128ff60b1f8ca8"
Jul 13 21:49:56.705939 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:56.705903    2575 generic.go:356] "Generic (PLEG): container finished" podID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerID="1f0d040417c73d3c93b62c3375640d8f01c818ba65dd0ac2f353d0544a1f958c" exitCode=7
Jul 13 21:49:56.706362 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:56.705989    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm" event={"ID":"a4f19ab9-2ea6-407a-81de-c6022105222f","Type":"ContainerDied","Data":"1f0d040417c73d3c93b62c3375640d8f01c818ba65dd0ac2f353d0544a1f958c"}
Jul 13 21:49:56.706362 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:56.706059    2575 scope.go:117] "RemoveContainer" containerID="46a4098c4dfdd3d0646e83fe2767dd49bcabccba253c38d93a128ff60b1f8ca8"
Jul 13 21:49:56.706362 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:56.706244    2575 scope.go:117] "RemoveContainer" containerID="1f0d040417c73d3c93b62c3375640d8f01c818ba65dd0ac2f353d0544a1f958c"
Jul 13 21:49:56.706555 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:49:56.706495    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm_odh-ai-gateway-infra(a4f19ab9-2ea6-407a-81de-c6022105222f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f"
Jul 13 21:49:57.712068 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:49:57.712038    2575 scope.go:117] "RemoveContainer" containerID="1f0d040417c73d3c93b62c3375640d8f01c818ba65dd0ac2f353d0544a1f958c"
Jul 13 21:49:57.712426 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:49:57.712244    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm_odh-ai-gateway-infra(a4f19ab9-2ea6-407a-81de-c6022105222f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f"
Jul 13 21:50:03.743995 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:03.743963    2575 generic.go:356] "Generic (PLEG): container finished" podID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerID="4a0bfb44606239c7e0f515df14a0aa209204e6ad0af45afb79772ae7f77c9f18" exitCode=0
Jul 13 21:50:03.743995 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:03.744004    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" event={"ID":"0a3de909-a0b2-4c4f-a364-e0ef43b7be04","Type":"ContainerDied","Data":"4a0bfb44606239c7e0f515df14a0aa209204e6ad0af45afb79772ae7f77c9f18"}
Jul 13 21:50:03.744581 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:03.744406    2575 scope.go:117] "RemoveContainer" containerID="4a0bfb44606239c7e0f515df14a0aa209204e6ad0af45afb79772ae7f77c9f18"
Jul 13 21:50:03.745406 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:03.745374    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:50:03.745522 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:03.745441    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:50:03.745522 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:03.745491    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:50:04.750960 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:04.750917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" event={"ID":"0a3de909-a0b2-4c4f-a364-e0ef43b7be04","Type":"ContainerStarted","Data":"2fca2c948edf19624c35739a6c6e8dd9b85c124e71e6793992bf3d7ba6192fd7"}
Jul 13 21:50:05.504448 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:05.504416    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:50:05.505679 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:05.505646    2575 patch_prober.go:28] interesting pod/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 13 21:50:05.505826 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:05.505707    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 13 21:50:05.662223 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:05.662184    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:50:06.504328 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:06.504293    2575 patch_prober.go:28] interesting pod/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 13 21:50:06.504745 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:06.504401    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 13 21:50:07.504803 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:07.504763    2575 patch_prober.go:28] interesting pod/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 13 21:50:07.505213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:07.504829    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 13 21:50:08.504302 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:08.504264    2575 patch_prober.go:28] interesting pod/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 13 21:50:08.504498 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:08.504329    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 13 21:50:09.507770 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:09.507739    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:50:09.508745 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:09.508724    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:50:10.464164 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:10.464137    2575 scope.go:117] "RemoveContainer" containerID="1f0d040417c73d3c93b62c3375640d8f01c818ba65dd0ac2f353d0544a1f958c"
Jul 13 21:50:10.781026 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:10.780989    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm" event={"ID":"a4f19ab9-2ea6-407a-81de-c6022105222f","Type":"ContainerStarted","Data":"2cb47e82e932f537560d22c35010a70ff74e1736e39b97400d50e32d9989e3f1"}
Jul 13 21:50:11.788911 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:11.788877    2575 generic.go:356] "Generic (PLEG): container finished" podID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerID="2cb47e82e932f537560d22c35010a70ff74e1736e39b97400d50e32d9989e3f1" exitCode=0
Jul 13 21:50:11.789356 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:11.788927    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm" event={"ID":"a4f19ab9-2ea6-407a-81de-c6022105222f","Type":"ContainerDied","Data":"2cb47e82e932f537560d22c35010a70ff74e1736e39b97400d50e32d9989e3f1"}
Jul 13 21:50:11.789356 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:11.788974    2575 scope.go:117] "RemoveContainer" containerID="1f0d040417c73d3c93b62c3375640d8f01c818ba65dd0ac2f353d0544a1f958c"
Jul 13 21:50:11.815918 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:11.815884    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"]
Jul 13 21:50:12.940259 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:12.940233    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"
Jul 13 21:50:13.058332 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:13.058298    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f19ab9-2ea6-407a-81de-c6022105222f-maas-api-service-ca\") pod \"a4f19ab9-2ea6-407a-81de-c6022105222f\" (UID: \"a4f19ab9-2ea6-407a-81de-c6022105222f\") "
Jul 13 21:50:13.058654 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:13.058629    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4f19ab9-2ea6-407a-81de-c6022105222f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4f19ab9-2ea6-407a-81de-c6022105222f" (UID: "a4f19ab9-2ea6-407a-81de-c6022105222f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:50:13.159873 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:13.159842    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f19ab9-2ea6-407a-81de-c6022105222f-maas-api-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:50:13.802398 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:13.802367    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"
Jul 13 21:50:13.802559 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:13.802392    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm" event={"ID":"a4f19ab9-2ea6-407a-81de-c6022105222f","Type":"ContainerDied","Data":"38c307792ff49a9042987d1372fd4a388cbc4e3e3a3679e0eded8012c1bd40a9"}
Jul 13 21:50:13.802559 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:13.802451    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38c307792ff49a9042987d1372fd4a388cbc4e3e3a3679e0eded8012c1bd40a9"
Jul 13 21:50:13.835771 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:13.835739    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"]
Jul 13 21:50:13.840312 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:13.840287    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5zhmm"]
Jul 13 21:50:15.469682 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:15.469650    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f" path="/var/lib/kubelet/pods/a4f19ab9-2ea6-407a-81de-c6022105222f/volumes"
Jul 13 21:50:53.804284 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.804247    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p"]
Jul 13 21:50:53.804700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.804641    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerName="revoke-keys"
Jul 13 21:50:53.804700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.804655    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerName="revoke-keys"
Jul 13 21:50:53.804700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.804664    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerName="revoke-keys"
Jul 13 21:50:53.804700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.804670    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerName="revoke-keys"
Jul 13 21:50:53.804837 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.804740    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerName="revoke-keys"
Jul 13 21:50:53.804837 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.804748    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerName="revoke-keys"
Jul 13 21:50:53.804837 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.804755    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerName="revoke-keys"
Jul 13 21:50:53.807060 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.807043    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p"
Jul 13 21:50:53.814156 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.814136    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:50:53.814278 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.814253    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vjqr5\""
Jul 13 21:50:53.837095 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.837068    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p"]
Jul 13 21:50:53.837220 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.837118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac786246-3893-408e-b53d-b02c9ec5c4d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p\" (UID: \"ac786246-3893-408e-b53d-b02c9ec5c4d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p"
Jul 13 21:50:53.937955 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.937917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac786246-3893-408e-b53d-b02c9ec5c4d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p\" (UID: \"ac786246-3893-408e-b53d-b02c9ec5c4d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p"
Jul 13 21:50:53.938514 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:53.938495    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac786246-3893-408e-b53d-b02c9ec5c4d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p\" (UID: \"ac786246-3893-408e-b53d-b02c9ec5c4d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p"
Jul 13 21:50:54.117178 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:54.117094    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p"
Jul 13 21:50:54.250347 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:54.250311    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p"]
Jul 13 21:50:54.253688 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:50:54.253657    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac786246_3893_408e_b53d_b02c9ec5c4d1.slice/crio-1d1b2ab0e7b3e2bcc6e1b7cd7fb29624cce60feb74b09f96e1cc3e372ebdb70e WatchSource:0}: Error finding container 1d1b2ab0e7b3e2bcc6e1b7cd7fb29624cce60feb74b09f96e1cc3e372ebdb70e: Status 404 returned error can't find the container with id 1d1b2ab0e7b3e2bcc6e1b7cd7fb29624cce60feb74b09f96e1cc3e372ebdb70e
Jul 13 21:50:55.013432 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:55.013396    2575 generic.go:356] "Generic (PLEG): container finished" podID="ac786246-3893-408e-b53d-b02c9ec5c4d1" containerID="45c6b28a1364d02d666cd9a889b5836851b6c0c9dbbdb153f7142b343906e287" exitCode=0
Jul 13 21:50:55.013943 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:55.013488    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p" event={"ID":"ac786246-3893-408e-b53d-b02c9ec5c4d1","Type":"ContainerDied","Data":"45c6b28a1364d02d666cd9a889b5836851b6c0c9dbbdb153f7142b343906e287"}
Jul 13 21:50:55.013943 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:55.013555    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p" event={"ID":"ac786246-3893-408e-b53d-b02c9ec5c4d1","Type":"ContainerStarted","Data":"1d1b2ab0e7b3e2bcc6e1b7cd7fb29624cce60feb74b09f96e1cc3e372ebdb70e"}
Jul 13 21:50:56.150430 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:56.150406    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p"
Jul 13 21:50:56.262142 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:56.262107    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac786246-3893-408e-b53d-b02c9ec5c4d1-maas-api-service-ca\") pod \"ac786246-3893-408e-b53d-b02c9ec5c4d1\" (UID: \"ac786246-3893-408e-b53d-b02c9ec5c4d1\") "
Jul 13 21:50:56.262537 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:56.262513    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac786246-3893-408e-b53d-b02c9ec5c4d1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ac786246-3893-408e-b53d-b02c9ec5c4d1" (UID: "ac786246-3893-408e-b53d-b02c9ec5c4d1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:50:56.363106 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:56.363063    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac786246-3893-408e-b53d-b02c9ec5c4d1-maas-api-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:50:57.024313 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:57.024286    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p"
Jul 13 21:50:57.024516 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:57.024327    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p" event={"ID":"ac786246-3893-408e-b53d-b02c9ec5c4d1","Type":"ContainerDied","Data":"1d1b2ab0e7b3e2bcc6e1b7cd7fb29624cce60feb74b09f96e1cc3e372ebdb70e"}
Jul 13 21:50:57.024516 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:50:57.024398    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d1b2ab0e7b3e2bcc6e1b7cd7fb29624cce60feb74b09f96e1cc3e372ebdb70e"
Jul 13 21:51:19.037371 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:19.037320    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"]
Jul 13 21:51:19.037900 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:19.037558    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy" containerID="cri-o://2fca2c948edf19624c35739a6c6e8dd9b85c124e71e6793992bf3d7ba6192fd7" gracePeriod=30
Jul 13 21:51:24.157753 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.157720    2575 generic.go:356] "Generic (PLEG): container finished" podID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerID="2fca2c948edf19624c35739a6c6e8dd9b85c124e71e6793992bf3d7ba6192fd7" exitCode=0
Jul 13 21:51:24.158139 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.157797    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" event={"ID":"0a3de909-a0b2-4c4f-a364-e0ef43b7be04","Type":"ContainerDied","Data":"2fca2c948edf19624c35739a6c6e8dd9b85c124e71e6793992bf3d7ba6192fd7"}
Jul 13 21:51:24.158139 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.157873    2575 scope.go:117] "RemoveContainer" containerID="4a0bfb44606239c7e0f515df14a0aa209204e6ad0af45afb79772ae7f77c9f18"
Jul 13 21:51:24.302295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.302268    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:51:24.330986 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.330900    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istiod-ca-cert\") pod \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") "
Jul 13 21:51:24.330986 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.330949    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-data\") pod \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") "
Jul 13 21:51:24.331213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.330994    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzzsw\" (UniqueName: \"kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-kube-api-access-xzzsw\") pod \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") "
Jul 13 21:51:24.331213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.331020    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-podinfo\") pod \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") "
Jul 13 21:51:24.331213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.331052    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-socket\") pod \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") "
Jul 13 21:51:24.331213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.331081    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-token\") pod \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") "
Jul 13 21:51:24.331213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.331107    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-credential-socket\") pod \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") "
Jul 13 21:51:24.331213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.331131    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-certs\") pod \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") "
Jul 13 21:51:24.331213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.331157    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-envoy\") pod \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\" (UID: \"0a3de909-a0b2-4c4f-a364-e0ef43b7be04\") "
Jul 13 21:51:24.331594 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.331446    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a3de909-a0b2-4c4f-a364-e0ef43b7be04" (UID: "0a3de909-a0b2-4c4f-a364-e0ef43b7be04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:51:24.331594 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.331540    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a3de909-a0b2-4c4f-a364-e0ef43b7be04" (UID: "0a3de909-a0b2-4c4f-a364-e0ef43b7be04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:51:24.331702 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.331619    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a3de909-a0b2-4c4f-a364-e0ef43b7be04" (UID: "0a3de909-a0b2-4c4f-a364-e0ef43b7be04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:51:24.332261 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.332108    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a3de909-a0b2-4c4f-a364-e0ef43b7be04" (UID: "0a3de909-a0b2-4c4f-a364-e0ef43b7be04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:51:24.332261 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.332212    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a3de909-a0b2-4c4f-a364-e0ef43b7be04" (UID: "0a3de909-a0b2-4c4f-a364-e0ef43b7be04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:51:24.334923 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.334881    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a3de909-a0b2-4c4f-a364-e0ef43b7be04" (UID: "0a3de909-a0b2-4c4f-a364-e0ef43b7be04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:51:24.335249 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.335215    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a3de909-a0b2-4c4f-a364-e0ef43b7be04" (UID: "0a3de909-a0b2-4c4f-a364-e0ef43b7be04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:51:24.335380 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.335251    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a3de909-a0b2-4c4f-a364-e0ef43b7be04" (UID: "0a3de909-a0b2-4c4f-a364-e0ef43b7be04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:51:24.335468 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.335410    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-kube-api-access-xzzsw" (OuterVolumeSpecName: "kube-api-access-xzzsw") pod "0a3de909-a0b2-4c4f-a364-e0ef43b7be04" (UID: "0a3de909-a0b2-4c4f-a364-e0ef43b7be04"). InnerVolumeSpecName "kube-api-access-xzzsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:51:24.432299 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.432257    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:51:24.432299 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.432295    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzzsw\" (UniqueName: \"kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-kube-api-access-xzzsw\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:51:24.432299 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.432306    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:51:24.432582 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.432315    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:51:24.432582 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.432325    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:51:24.432582 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.432367    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:51:24.432582 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.432376    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:51:24.432582 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.432384    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:51:24.432582 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:24.432392    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a3de909-a0b2-4c4f-a364-e0ef43b7be04-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:51:25.164288 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:25.164257    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"
Jul 13 21:51:25.164775 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:25.164259    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5" event={"ID":"0a3de909-a0b2-4c4f-a364-e0ef43b7be04","Type":"ContainerDied","Data":"06a4f1eb0ed929f560d7239ef7ce80323cbece140ad41fa90beac9918e161f28"}
Jul 13 21:51:25.164775 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:25.164393    2575 scope.go:117] "RemoveContainer" containerID="2fca2c948edf19624c35739a6c6e8dd9b85c124e71e6793992bf3d7ba6192fd7"
Jul 13 21:51:25.192502 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:25.192474    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"]
Jul 13 21:51:25.197233 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:25.197211    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7fdae48e-openshift-default-6b7fb9cbf9-rbvf5"]
Jul 13 21:51:25.469089 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:25.469010    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" path="/var/lib/kubelet/pods/0a3de909-a0b2-4c4f-a364-e0ef43b7be04/volumes"
Jul 13 21:51:35.484714 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:35.484683    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:51:35.488064 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:35.488035    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:51:35.490805 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:35.490782    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:51:35.493954 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:51:35.493938    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:52:56.076558 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.076526    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"]
Jul 13 21:52:56.077025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.076890    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy"
Jul 13 21:52:56.077025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.076902    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy"
Jul 13 21:52:56.077025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.076917    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac786246-3893-408e-b53d-b02c9ec5c4d1" containerName="revoke-keys"
Jul 13 21:52:56.077025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.076922    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac786246-3893-408e-b53d-b02c9ec5c4d1" containerName="revoke-keys"
Jul 13 21:52:56.077025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.076930    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerName="revoke-keys"
Jul 13 21:52:56.077025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.076935    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f19ab9-2ea6-407a-81de-c6022105222f" containerName="revoke-keys"
Jul 13 21:52:56.077025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.076945    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy"
Jul 13 21:52:56.077025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.076950    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy"
Jul 13 21:52:56.077025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.077021    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac786246-3893-408e-b53d-b02c9ec5c4d1" containerName="revoke-keys"
Jul 13 21:52:56.077025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.077031    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy"
Jul 13 21:52:56.077331 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.077040    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a3de909-a0b2-4c4f-a364-e0ef43b7be04" containerName="istio-proxy"
Jul 13 21:52:56.080052 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.080031    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.082837 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.082815    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5f8bcbd1-openshift-default-dockercfg-rqvs2\""
Jul 13 21:52:56.104716 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.104684    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"]
Jul 13 21:52:56.250351 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.250298    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-token\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.250563 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.250389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-data\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.250563 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.250430    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-credential-socket\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.250563 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.250477    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-podinfo\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.250563 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.250539    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istiod-ca-cert\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.250788 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.250568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-envoy\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.250788 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.250609    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfvbh\" (UniqueName: \"kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-kube-api-access-tfvbh\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.250788 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.250629    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-socket\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.250788 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.250653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-certs\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352176 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-credential-socket\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352176 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352122    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-podinfo\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352176 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istiod-ca-cert\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352480 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352200    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-envoy\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352480 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfvbh\" (UniqueName: \"kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-kube-api-access-tfvbh\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352480 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-socket\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352480 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352305    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-certs\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352480 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352366    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-token\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352480 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352413    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-data\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352828 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352644    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-credential-socket\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.352940 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352911    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-data\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.353065 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352939    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-certs\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.353065 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.352985    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-socket\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.353065 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.353011    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istiod-ca-cert\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.354635 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.354613    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-envoy\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.354901 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.354885    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-podinfo\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.361895 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.361874    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-token\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.362411 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.362396    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfvbh\" (UniqueName: \"kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-kube-api-access-tfvbh\") pod \"e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") " pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.392818 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.392787    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:56.557427 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.557392    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"]
Jul 13 21:52:56.558297 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:52:56.558266    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fcbd9d0_9f04_40e2_a5a9_16a5c9acd10b.slice/crio-8d6247254c5d0a6428481c9424335283f01a377af9cb5db8afbee2086c78a1e5 WatchSource:0}: Error finding container 8d6247254c5d0a6428481c9424335283f01a377af9cb5db8afbee2086c78a1e5: Status 404 returned error can't find the container with id 8d6247254c5d0a6428481c9424335283f01a377af9cb5db8afbee2086c78a1e5
Jul 13 21:52:56.560624 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.560592    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:52:56.560735 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.560681    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:52:56.560799 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.560727    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:52:56.645350 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.638100    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" event={"ID":"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b","Type":"ContainerStarted","Data":"c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869"}
Jul 13 21:52:56.645350 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.638222    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" event={"ID":"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b","Type":"ContainerStarted","Data":"8d6247254c5d0a6428481c9424335283f01a377af9cb5db8afbee2086c78a1e5"}
Jul 13 21:52:56.660084 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:56.660034    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" podStartSLOduration=0.66001946 podStartE2EDuration="660.01946ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:52:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:52:56.658108832 +0000 UTC m=+1881.747388998" watchObservedRunningTime="2026-07-13 21:52:56.66001946 +0000 UTC m=+1881.749299612"
Jul 13 21:52:57.393602 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:57.393509    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:57.398329 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:57.398300    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:57.643829 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:57.643751    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:57.644762 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:57.644743    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:52:59.080242 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.080208    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"]
Jul 13 21:52:59.083956 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.083933    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.086870 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.086845    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:52:59.086870 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.086859    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5f8bcbd1-serving-cert\""
Jul 13 21:52:59.087136 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.087120    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:52:59.088054 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.088037    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nq9m7\""
Jul 13 21:52:59.096021 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.095994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"]
Jul 13 21:52:59.178747 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.178703    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e72bb6-45ae-4311-b9f5-9746135aaed9-openshift-service-ca\") pod \"maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.178932 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.178837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phllz\" (UniqueName: \"kubernetes.io/projected/65e72bb6-45ae-4311-b9f5-9746135aaed9-kube-api-access-phllz\") pod \"maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.178982 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.178929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e72bb6-45ae-4311-b9f5-9746135aaed9-maas-api-tls\") pod \"maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.279968 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.279924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phllz\" (UniqueName: \"kubernetes.io/projected/65e72bb6-45ae-4311-b9f5-9746135aaed9-kube-api-access-phllz\") pod \"maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.280153 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.279992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e72bb6-45ae-4311-b9f5-9746135aaed9-maas-api-tls\") pod \"maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.280153 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.280016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e72bb6-45ae-4311-b9f5-9746135aaed9-openshift-service-ca\") pod \"maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.280653 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.280636    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e72bb6-45ae-4311-b9f5-9746135aaed9-openshift-service-ca\") pod \"maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.282742 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.282718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e72bb6-45ae-4311-b9f5-9746135aaed9-maas-api-tls\") pod \"maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.289305 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.289276    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phllz\" (UniqueName: \"kubernetes.io/projected/65e72bb6-45ae-4311-b9f5-9746135aaed9-kube-api-access-phllz\") pod \"maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.395997 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.395904    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:52:59.543064 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.543034    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"]
Jul 13 21:52:59.545451 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:52:59.545424    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e72bb6_45ae_4311_b9f5_9746135aaed9.slice/crio-fd2c84ded476de86a8bf0d8001b843b78cc2d85e889979a158b9cdcb7520413a WatchSource:0}: Error finding container fd2c84ded476de86a8bf0d8001b843b78cc2d85e889979a158b9cdcb7520413a: Status 404 returned error can't find the container with id fd2c84ded476de86a8bf0d8001b843b78cc2d85e889979a158b9cdcb7520413a
Jul 13 21:52:59.546936 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.546917    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:52:59.657752 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:52:59.657664    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl" event={"ID":"65e72bb6-45ae-4311-b9f5-9746135aaed9","Type":"ContainerStarted","Data":"fd2c84ded476de86a8bf0d8001b843b78cc2d85e889979a158b9cdcb7520413a"}
Jul 13 21:53:02.678889 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:02.678852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl" event={"ID":"65e72bb6-45ae-4311-b9f5-9746135aaed9","Type":"ContainerStarted","Data":"6dd5528967f4271b1de9eaf9b15646e2c898ac5b161e5464e3f86ed0c3a643ef"}
Jul 13 21:53:02.679471 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:02.678990    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:53:02.697156 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:02.697106    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl" podStartSLOduration=1.427499195 podStartE2EDuration="3.697091809s" totalImagesPullingTime="2.269592614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:53:02.696741757 +0000 UTC m=+1887.786021911" watchObservedRunningTime="2026-07-13 21:53:02.697091809 +0000 UTC m=+1887.786371962"
Jul 13 21:53:08.689550 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:08.689517    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:53:10.202668 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:10.202632    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6"]
Jul 13 21:53:10.206201 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:10.206181    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6"
Jul 13 21:53:10.209059 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:10.209033    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vjqr5\""
Jul 13 21:53:10.213696 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:10.213661    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6"]
Jul 13 21:53:10.286676 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:10.286643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed76d8a-5c12-4131-8906-096a3359a065-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6\" (UID: \"3ed76d8a-5c12-4131-8906-096a3359a065\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6"
Jul 13 21:53:10.388200 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:10.388106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed76d8a-5c12-4131-8906-096a3359a065-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6\" (UID: \"3ed76d8a-5c12-4131-8906-096a3359a065\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6"
Jul 13 21:53:10.388810 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:10.388790    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed76d8a-5c12-4131-8906-096a3359a065-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6\" (UID: \"3ed76d8a-5c12-4131-8906-096a3359a065\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6"
Jul 13 21:53:10.520351 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:10.520314    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6"
Jul 13 21:53:10.664756 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:10.664668    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6"]
Jul 13 21:53:10.668146 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:53:10.668103    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed76d8a_5c12_4131_8906_096a3359a065.slice/crio-5995403b05e1f1dcd3f08aa7cc0d78d0b622af5a6cae7e8249c1e4cd26bcc817 WatchSource:0}: Error finding container 5995403b05e1f1dcd3f08aa7cc0d78d0b622af5a6cae7e8249c1e4cd26bcc817: Status 404 returned error can't find the container with id 5995403b05e1f1dcd3f08aa7cc0d78d0b622af5a6cae7e8249c1e4cd26bcc817
Jul 13 21:53:10.721565 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:10.721529    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6" event={"ID":"3ed76d8a-5c12-4131-8906-096a3359a065","Type":"ContainerStarted","Data":"5995403b05e1f1dcd3f08aa7cc0d78d0b622af5a6cae7e8249c1e4cd26bcc817"}
Jul 13 21:53:11.728645 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:11.728606    2575 generic.go:356] "Generic (PLEG): container finished" podID="3ed76d8a-5c12-4131-8906-096a3359a065" containerID="9aa62e14db0f2b6f3edfabfd8b2caa613bf7e159f0a803521ef7c3aabb8c5ddf" exitCode=0
Jul 13 21:53:11.729040 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:11.728689    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6" event={"ID":"3ed76d8a-5c12-4131-8906-096a3359a065","Type":"ContainerDied","Data":"9aa62e14db0f2b6f3edfabfd8b2caa613bf7e159f0a803521ef7c3aabb8c5ddf"}
Jul 13 21:53:12.871545 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:12.871522    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6"
Jul 13 21:53:12.912851 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:12.912824    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed76d8a-5c12-4131-8906-096a3359a065-maas-api-service-ca\") pod \"3ed76d8a-5c12-4131-8906-096a3359a065\" (UID: \"3ed76d8a-5c12-4131-8906-096a3359a065\") "
Jul 13 21:53:12.914139 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:12.913159    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ed76d8a-5c12-4131-8906-096a3359a065-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ed76d8a-5c12-4131-8906-096a3359a065" (UID: "3ed76d8a-5c12-4131-8906-096a3359a065"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:53:12.966700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:12.966660    2575 patch_prober.go:28] interesting pod/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:40520->10.132.0.51:15021: read: connection reset by peer" start-of-body=
Jul 13 21:53:12.966828 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:12.966737    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:40520->10.132.0.51:15021: read: connection reset by peer"
Jul 13 21:53:13.013704 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:13.013643    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ed76d8a-5c12-4131-8906-096a3359a065-maas-api-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:13.741438 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:13.741331    2575 generic.go:356] "Generic (PLEG): container finished" podID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerID="c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869" exitCode=0
Jul 13 21:53:13.741438 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:13.741385    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" event={"ID":"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b","Type":"ContainerDied","Data":"c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869"}
Jul 13 21:53:13.741897 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:13.741874    2575 scope.go:117] "RemoveContainer" containerID="c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869"
Jul 13 21:53:13.742812 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:13.742795    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6"
Jul 13 21:53:13.742892 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:13.742830    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6" event={"ID":"3ed76d8a-5c12-4131-8906-096a3359a065","Type":"ContainerDied","Data":"5995403b05e1f1dcd3f08aa7cc0d78d0b622af5a6cae7e8249c1e4cd26bcc817"}
Jul 13 21:53:13.742892 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:13.742872    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5995403b05e1f1dcd3f08aa7cc0d78d0b622af5a6cae7e8249c1e4cd26bcc817"
Jul 13 21:53:13.742990 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:13.742963    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:53:13.743061 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:13.743044    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:53:13.743147 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:13.743130    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:53:14.749802 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:14.749769    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" event={"ID":"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b","Type":"ContainerStarted","Data":"acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c"}
Jul 13 21:53:15.394058 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:15.394018    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:53:15.394314 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:15.394290    2575 patch_prober.go:28] interesting pod/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 13 21:53:15.394441 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:15.394378    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 13 21:53:16.393501 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:16.393465    2575 patch_prober.go:28] interesting pod/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 13 21:53:16.393924 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:16.393558    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 13 21:53:17.393286 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:17.393250    2575 patch_prober.go:28] interesting pod/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 13 21:53:17.393496 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:17.393308    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 13 21:53:18.393249 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:18.393206    2575 patch_prober.go:28] interesting pod/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 13 21:53:18.393746 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:18.393269    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 13 21:53:19.397567 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:19.397534    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:53:19.398047 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:19.397841    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:53:19.398621 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:19.398600    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:53:20.580969 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.580928    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"]
Jul 13 21:53:20.581473 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.581236    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl" podUID="65e72bb6-45ae-4311-b9f5-9746135aaed9" containerName="maas-api" containerID="cri-o://6dd5528967f4271b1de9eaf9b15646e2c898ac5b161e5464e3f86ed0c3a643ef" gracePeriod=30
Jul 13 21:53:20.785356 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.785312    2575 generic.go:356] "Generic (PLEG): container finished" podID="65e72bb6-45ae-4311-b9f5-9746135aaed9" containerID="6dd5528967f4271b1de9eaf9b15646e2c898ac5b161e5464e3f86ed0c3a643ef" exitCode=0
Jul 13 21:53:20.785537 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.785381    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl" event={"ID":"65e72bb6-45ae-4311-b9f5-9746135aaed9","Type":"ContainerDied","Data":"6dd5528967f4271b1de9eaf9b15646e2c898ac5b161e5464e3f86ed0c3a643ef"}
Jul 13 21:53:20.833810 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.833748    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:53:20.894068 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.894036    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e72bb6-45ae-4311-b9f5-9746135aaed9-openshift-service-ca\") pod \"65e72bb6-45ae-4311-b9f5-9746135aaed9\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") "
Jul 13 21:53:20.894280 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.894147    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e72bb6-45ae-4311-b9f5-9746135aaed9-maas-api-tls\") pod \"65e72bb6-45ae-4311-b9f5-9746135aaed9\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") "
Jul 13 21:53:20.894280 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.894187    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phllz\" (UniqueName: \"kubernetes.io/projected/65e72bb6-45ae-4311-b9f5-9746135aaed9-kube-api-access-phllz\") pod \"65e72bb6-45ae-4311-b9f5-9746135aaed9\" (UID: \"65e72bb6-45ae-4311-b9f5-9746135aaed9\") "
Jul 13 21:53:20.894559 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.894519    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65e72bb6-45ae-4311-b9f5-9746135aaed9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65e72bb6-45ae-4311-b9f5-9746135aaed9" (UID: "65e72bb6-45ae-4311-b9f5-9746135aaed9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:53:20.896463 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.896433    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65e72bb6-45ae-4311-b9f5-9746135aaed9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65e72bb6-45ae-4311-b9f5-9746135aaed9" (UID: "65e72bb6-45ae-4311-b9f5-9746135aaed9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:53:20.896561 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.896494    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65e72bb6-45ae-4311-b9f5-9746135aaed9-kube-api-access-phllz" (OuterVolumeSpecName: "kube-api-access-phllz") pod "65e72bb6-45ae-4311-b9f5-9746135aaed9" (UID: "65e72bb6-45ae-4311-b9f5-9746135aaed9"). InnerVolumeSpecName "kube-api-access-phllz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:53:20.994992 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.994948    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65e72bb6-45ae-4311-b9f5-9746135aaed9-maas-api-tls\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:20.994992 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.994986    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phllz\" (UniqueName: \"kubernetes.io/projected/65e72bb6-45ae-4311-b9f5-9746135aaed9-kube-api-access-phllz\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:20.994992 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:20.994996    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e72bb6-45ae-4311-b9f5-9746135aaed9-openshift-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:21.791798 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:21.791718    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"
Jul 13 21:53:21.792450 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:21.791718    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl" event={"ID":"65e72bb6-45ae-4311-b9f5-9746135aaed9","Type":"ContainerDied","Data":"fd2c84ded476de86a8bf0d8001b843b78cc2d85e889979a158b9cdcb7520413a"}
Jul 13 21:53:21.792450 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:21.791851    2575 scope.go:117] "RemoveContainer" containerID="6dd5528967f4271b1de9eaf9b15646e2c898ac5b161e5464e3f86ed0c3a643ef"
Jul 13 21:53:21.809787 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:21.809747    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"]
Jul 13 21:53:21.814665 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:21.814640    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f8bcbd1-64589b4f78-lbxpl"]
Jul 13 21:53:23.469113 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:23.469074    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65e72bb6-45ae-4311-b9f5-9746135aaed9" path="/var/lib/kubelet/pods/65e72bb6-45ae-4311-b9f5-9746135aaed9/volumes"
Jul 13 21:53:35.576799 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:35.576769    2575 scope.go:117] "RemoveContainer" containerID="b9e2e162eb86d340d7ef7caa023a48ea9d8c125a73782ecfdb8bcfa0a5fdc27d"
Jul 13 21:53:35.898581 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:35.898489    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"]
Jul 13 21:53:35.898784 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:35.898754    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy" containerID="cri-o://acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c" gracePeriod=30
Jul 13 21:53:41.161238 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.161215    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:53:41.276666 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.276585    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfvbh\" (UniqueName: \"kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-kube-api-access-tfvbh\") pod \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") "
Jul 13 21:53:41.276666 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.276639    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-token\") pod \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") "
Jul 13 21:53:41.276882 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.276673    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-data\") pod \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") "
Jul 13 21:53:41.276882 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.276775    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-envoy\") pod \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") "
Jul 13 21:53:41.276882 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.276826    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istiod-ca-cert\") pod \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") "
Jul 13 21:53:41.276882 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.276848    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-certs\") pod \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") "
Jul 13 21:53:41.276882 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.276875    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-podinfo\") pod \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") "
Jul 13 21:53:41.277163 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.276926    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-credential-socket\") pod \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") "
Jul 13 21:53:41.277163 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.276969    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-socket\") pod \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\" (UID: \"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b\") "
Jul 13 21:53:41.277273 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.277224    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" (UID: "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:53:41.277392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.277334    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:41.277472 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.277444    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" (UID: "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:53:41.277529 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.277501    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" (UID: "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:53:41.277585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.277543    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" (UID: "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:53:41.277585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.277556    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" (UID: "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:53:41.278963 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.278936    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-kube-api-access-tfvbh" (OuterVolumeSpecName: "kube-api-access-tfvbh") pod "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" (UID: "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b"). InnerVolumeSpecName "kube-api-access-tfvbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:53:41.278963 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.278936    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" (UID: "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:53:41.279107 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.278941    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" (UID: "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:53:41.279184 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.279154    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" (UID: "6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:53:41.378241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.378204    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:41.378241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.378235    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfvbh\" (UniqueName: \"kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-kube-api-access-tfvbh\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:41.378241 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.378249    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:41.378507 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.378261    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:41.378507 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.378271    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:41.378507 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.378281    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:41.378507 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.378292    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:41.378507 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.378303    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:53:41.900231 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.900197    2575 generic.go:356] "Generic (PLEG): container finished" podID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerID="acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c" exitCode=0
Jul 13 21:53:41.900435 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.900236    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"
Jul 13 21:53:41.900435 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.900279    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" event={"ID":"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b","Type":"ContainerDied","Data":"acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c"}
Jul 13 21:53:41.900435 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.900349    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k" event={"ID":"6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b","Type":"ContainerDied","Data":"8d6247254c5d0a6428481c9424335283f01a377af9cb5db8afbee2086c78a1e5"}
Jul 13 21:53:41.900435 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.900377    2575 scope.go:117] "RemoveContainer" containerID="acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c"
Jul 13 21:53:41.910066 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.910044    2575 scope.go:117] "RemoveContainer" containerID="c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869"
Jul 13 21:53:41.918079 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.918056    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"]
Jul 13 21:53:41.918591 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.918577    2575 scope.go:117] "RemoveContainer" containerID="acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c"
Jul 13 21:53:41.918869 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:53:41.918849    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c\": container with ID starting with acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c not found: ID does not exist" containerID="acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c"
Jul 13 21:53:41.918930 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.918884    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c"} err="failed to get container status \"acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c\": rpc error: code = NotFound desc = could not find container \"acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c\": container with ID starting with acda90a84d75ed622eebe36265a40719bc59bee632720539fca3a7933b75526c not found: ID does not exist"
Jul 13 21:53:41.918930 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.918902    2575 scope.go:117] "RemoveContainer" containerID="c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869"
Jul 13 21:53:41.919232 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:53:41.919202    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869\": container with ID starting with c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869 not found: ID does not exist" containerID="c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869"
Jul 13 21:53:41.919402 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.919239    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869"} err="failed to get container status \"c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869\": rpc error: code = NotFound desc = could not find container \"c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869\": container with ID starting with c1749d060a7dcd6240ddfcc2bd174dc7722d1828818f11e0298ce02fa115a869 not found: ID does not exist"
Jul 13 21:53:41.922217 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:41.922195    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5f8bcbd1-openshift-default-55c84b7847-qsj5k"]
Jul 13 21:53:43.469177 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:43.469146    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" path="/var/lib/kubelet/pods/6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b/volumes"
Jul 13 21:53:55.787222 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787193    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"]
Jul 13 21:53:55.787630 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787615    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy"
Jul 13 21:53:55.787630 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787631    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy"
Jul 13 21:53:55.787730 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787647    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy"
Jul 13 21:53:55.787730 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787654    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy"
Jul 13 21:53:55.787730 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787663    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed76d8a-5c12-4131-8906-096a3359a065" containerName="revoke-keys"
Jul 13 21:53:55.787730 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787669    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed76d8a-5c12-4131-8906-096a3359a065" containerName="revoke-keys"
Jul 13 21:53:55.787730 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787676    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65e72bb6-45ae-4311-b9f5-9746135aaed9" containerName="maas-api"
Jul 13 21:53:55.787730 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787681    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="65e72bb6-45ae-4311-b9f5-9746135aaed9" containerName="maas-api"
Jul 13 21:53:55.787944 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787735    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="65e72bb6-45ae-4311-b9f5-9746135aaed9" containerName="maas-api"
Jul 13 21:53:55.787944 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787743    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ed76d8a-5c12-4131-8906-096a3359a065" containerName="revoke-keys"
Jul 13 21:53:55.787944 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787753    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy"
Jul 13 21:53:55.787944 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.787759    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fcbd9d0-9f04-40e2-a5a9-16a5c9acd10b" containerName="istio-proxy"
Jul 13 21:53:55.792198 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.792176    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.796783 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.796760    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bfec26b9-openshift-default-dockercfg-q8k4n\""
Jul 13 21:53:55.803271 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.803244    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-envoy\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.803408 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.803290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-podinfo\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.803408 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.803325    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-data\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.803541 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.803427    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-socket\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.803541 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.803467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njcsd\" (UniqueName: \"kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-kube-api-access-njcsd\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.803541 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.803504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-credential-socket\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.803649 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.803585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-token\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.803649 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.803630    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-certs\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.803730 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.803653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istiod-ca-cert\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.808210 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.808186    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"]
Jul 13 21:53:55.904125 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-credential-socket\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904298 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-token\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904298 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-certs\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904298 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istiod-ca-cert\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904298 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904272    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-envoy\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904554 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904305    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-podinfo\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904554 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904327    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-data\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904554 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904420    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-socket\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904554 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904454    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njcsd\" (UniqueName: \"kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-kube-api-access-njcsd\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904769 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904641    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-certs\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904769 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904700    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-credential-socket\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.904955 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904886    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-data\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.905098 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.904992    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-socket\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.905694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.905665    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istiod-ca-cert\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.908013 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.907988    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-podinfo\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.908151 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.908091    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-envoy\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.914038 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.914010    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-token\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:55.914156 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:55.914097    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njcsd\" (UniqueName: \"kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-kube-api-access-njcsd\") pod \"e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") " pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:56.102882 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:56.102844    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:56.245822 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:56.245785    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"]
Jul 13 21:53:56.247482 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:53:56.247458    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0fe31e_cd13_40cd_ae47_2d65d88fbbb7.slice/crio-8d5f451fc55d3f31ede300db358a5e65cf9fc02a89d809624785009b7593ceba WatchSource:0}: Error finding container 8d5f451fc55d3f31ede300db358a5e65cf9fc02a89d809624785009b7593ceba: Status 404 returned error can't find the container with id 8d5f451fc55d3f31ede300db358a5e65cf9fc02a89d809624785009b7593ceba
Jul 13 21:53:56.249515 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:56.249485    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:53:56.249583 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:56.249549    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:53:56.249583 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:56.249580    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:53:56.975236 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:56.975196    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" event={"ID":"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7","Type":"ContainerStarted","Data":"f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817"}
Jul 13 21:53:56.975658 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:56.975284    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" event={"ID":"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7","Type":"ContainerStarted","Data":"8d5f451fc55d3f31ede300db358a5e65cf9fc02a89d809624785009b7593ceba"}
Jul 13 21:53:56.999107 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:56.999053    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" podStartSLOduration=1.9990376429999999 podStartE2EDuration="1.999037643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:53:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:53:56.996700222 +0000 UTC m=+1942.085980376" watchObservedRunningTime="2026-07-13 21:53:56.999037643 +0000 UTC m=+1942.088317795"
Jul 13 21:53:57.103706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:57.103669    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:57.114688 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:57.114651    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:57.980666 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:57.980632    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:57.981699 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:57.981678    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:53:59.017417 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.017383    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"]
Jul 13 21:53:59.021155 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.021134    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.024047 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.024002    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bfec26b9-serving-cert\""
Jul 13 21:53:59.024182 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.024089    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:53:59.025411 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.025390    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nq9m7\""
Jul 13 21:53:59.025531 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.025418    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:53:59.027464 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.027440    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab188d4f-45ca-4006-bf91-7d4471129961-openshift-service-ca\") pod \"maas-api-e2e-mt-bfec26b9-548884665b-zvql5\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.027595 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.027573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c8f4\" (UniqueName: \"kubernetes.io/projected/ab188d4f-45ca-4006-bf91-7d4471129961-kube-api-access-8c8f4\") pod \"maas-api-e2e-mt-bfec26b9-548884665b-zvql5\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.027816 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.027793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab188d4f-45ca-4006-bf91-7d4471129961-maas-api-tls\") pod \"maas-api-e2e-mt-bfec26b9-548884665b-zvql5\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.044454 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.044433    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"]
Jul 13 21:53:59.128801 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.128767    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c8f4\" (UniqueName: \"kubernetes.io/projected/ab188d4f-45ca-4006-bf91-7d4471129961-kube-api-access-8c8f4\") pod \"maas-api-e2e-mt-bfec26b9-548884665b-zvql5\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.128996 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.128847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab188d4f-45ca-4006-bf91-7d4471129961-maas-api-tls\") pod \"maas-api-e2e-mt-bfec26b9-548884665b-zvql5\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.128996 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.128912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab188d4f-45ca-4006-bf91-7d4471129961-openshift-service-ca\") pod \"maas-api-e2e-mt-bfec26b9-548884665b-zvql5\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.129124 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:53:59.128995    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-serving-cert: secret "maas-api-e2e-mt-bfec26b9-serving-cert" not found
Jul 13 21:53:59.129124 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:53:59.129065    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab188d4f-45ca-4006-bf91-7d4471129961-maas-api-tls podName:ab188d4f-45ca-4006-bf91-7d4471129961 nodeName:}" failed. No retries permitted until 2026-07-13 21:53:59.629042391 +0000 UTC m=+1944.718322537 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ab188d4f-45ca-4006-bf91-7d4471129961-maas-api-tls") pod "maas-api-e2e-mt-bfec26b9-548884665b-zvql5" (UID: "ab188d4f-45ca-4006-bf91-7d4471129961") : secret "maas-api-e2e-mt-bfec26b9-serving-cert" not found
Jul 13 21:53:59.129683 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.129662    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab188d4f-45ca-4006-bf91-7d4471129961-openshift-service-ca\") pod \"maas-api-e2e-mt-bfec26b9-548884665b-zvql5\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.146831 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.146801    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c8f4\" (UniqueName: \"kubernetes.io/projected/ab188d4f-45ca-4006-bf91-7d4471129961-kube-api-access-8c8f4\") pod \"maas-api-e2e-mt-bfec26b9-548884665b-zvql5\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.633932 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.633896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab188d4f-45ca-4006-bf91-7d4471129961-maas-api-tls\") pod \"maas-api-e2e-mt-bfec26b9-548884665b-zvql5\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.636406 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.636383    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab188d4f-45ca-4006-bf91-7d4471129961-maas-api-tls\") pod \"maas-api-e2e-mt-bfec26b9-548884665b-zvql5\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:53:59.934051 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:53:59.933955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:54:00.131353 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:00.131315    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"]
Jul 13 21:54:00.133386 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:54:00.133350    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab188d4f_45ca_4006_bf91_7d4471129961.slice/crio-03bcfd5fabd19e9b50e0be63530b140e8633fe1344fec4fe28448985e6c86428 WatchSource:0}: Error finding container 03bcfd5fabd19e9b50e0be63530b140e8633fe1344fec4fe28448985e6c86428: Status 404 returned error can't find the container with id 03bcfd5fabd19e9b50e0be63530b140e8633fe1344fec4fe28448985e6c86428
Jul 13 21:54:00.999751 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:00.999651    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5" event={"ID":"ab188d4f-45ca-4006-bf91-7d4471129961","Type":"ContainerStarted","Data":"3773a76e83ebdf9d2a06e83f6e797209f310f768c41b1c63a60f9f95e7ab99e9"}
Jul 13 21:54:00.999751 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:00.999705    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5" event={"ID":"ab188d4f-45ca-4006-bf91-7d4471129961","Type":"ContainerStarted","Data":"03bcfd5fabd19e9b50e0be63530b140e8633fe1344fec4fe28448985e6c86428"}
Jul 13 21:54:00.999751 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:00.999731    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:54:07.014221 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:07.014176    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:54:07.042929 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:07.042771    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5" podStartSLOduration=8.594655089 podStartE2EDuration="9.042749614s" totalImagesPullingTime="448.094525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:54:01.021702123 +0000 UTC m=+1946.110982275" watchObservedRunningTime="2026-07-13 21:54:07.042749614 +0000 UTC m=+1952.132029767"
Jul 13 21:54:12.067499 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:12.067466    2575 generic.go:356] "Generic (PLEG): container finished" podID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerID="f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817" exitCode=0
Jul 13 21:54:12.067908 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:12.067542    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" event={"ID":"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7","Type":"ContainerDied","Data":"f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817"}
Jul 13 21:54:12.067908 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:12.067905    2575 scope.go:117] "RemoveContainer" containerID="f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817"
Jul 13 21:54:12.068861 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:12.068832    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:54:12.068943 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:12.068904    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:54:12.068983 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:12.068965    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:54:12.981014 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:12.980961    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:54:13.074451 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:13.074411    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" event={"ID":"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7","Type":"ContainerStarted","Data":"54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6"}
Jul 13 21:54:13.103539 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:13.103506    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:54:13.104701 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:13.104665    2575 patch_prober.go:28] interesting pod/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 13 21:54:13.104836 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:13.104732    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 13 21:54:14.103993 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:14.103962    2575 patch_prober.go:28] interesting pod/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 13 21:54:14.104389 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:14.104012    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 13 21:54:15.104014 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:15.103985    2575 patch_prober.go:28] interesting pod/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 13 21:54:15.104432 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:15.104044    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 13 21:54:16.103676 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:16.103643    2575 patch_prober.go:28] interesting pod/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 13 21:54:16.103854 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:16.103694    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 13 21:54:17.173309 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:17.173278    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:54:17.173772 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:17.173580    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:54:17.174356 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:17.174321    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:54:48.137395 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.137361    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"]
Jul 13 21:54:48.137943 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.137581    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5" podUID="ab188d4f-45ca-4006-bf91-7d4471129961" containerName="maas-api" containerID="cri-o://3773a76e83ebdf9d2a06e83f6e797209f310f768c41b1c63a60f9f95e7ab99e9" gracePeriod=30
Jul 13 21:54:48.254489 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.254461    2575 generic.go:356] "Generic (PLEG): container finished" podID="ab188d4f-45ca-4006-bf91-7d4471129961" containerID="3773a76e83ebdf9d2a06e83f6e797209f310f768c41b1c63a60f9f95e7ab99e9" exitCode=0
Jul 13 21:54:48.254646 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.254522    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5" event={"ID":"ab188d4f-45ca-4006-bf91-7d4471129961","Type":"ContainerDied","Data":"3773a76e83ebdf9d2a06e83f6e797209f310f768c41b1c63a60f9f95e7ab99e9"}
Jul 13 21:54:48.392347 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.392275    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:54:48.471948 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.471912    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab188d4f-45ca-4006-bf91-7d4471129961-maas-api-tls\") pod \"ab188d4f-45ca-4006-bf91-7d4471129961\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") "
Jul 13 21:54:48.472112 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.472034    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab188d4f-45ca-4006-bf91-7d4471129961-openshift-service-ca\") pod \"ab188d4f-45ca-4006-bf91-7d4471129961\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") "
Jul 13 21:54:48.472112 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.472052    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c8f4\" (UniqueName: \"kubernetes.io/projected/ab188d4f-45ca-4006-bf91-7d4471129961-kube-api-access-8c8f4\") pod \"ab188d4f-45ca-4006-bf91-7d4471129961\" (UID: \"ab188d4f-45ca-4006-bf91-7d4471129961\") "
Jul 13 21:54:48.472473 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.472445    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab188d4f-45ca-4006-bf91-7d4471129961-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ab188d4f-45ca-4006-bf91-7d4471129961" (UID: "ab188d4f-45ca-4006-bf91-7d4471129961"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:54:48.473967 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.473944    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab188d4f-45ca-4006-bf91-7d4471129961-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ab188d4f-45ca-4006-bf91-7d4471129961" (UID: "ab188d4f-45ca-4006-bf91-7d4471129961"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:54:48.474068 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.474037    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab188d4f-45ca-4006-bf91-7d4471129961-kube-api-access-8c8f4" (OuterVolumeSpecName: "kube-api-access-8c8f4") pod "ab188d4f-45ca-4006-bf91-7d4471129961" (UID: "ab188d4f-45ca-4006-bf91-7d4471129961"). InnerVolumeSpecName "kube-api-access-8c8f4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:54:48.572674 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.572619    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab188d4f-45ca-4006-bf91-7d4471129961-openshift-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:54:48.572674 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.572665    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c8f4\" (UniqueName: \"kubernetes.io/projected/ab188d4f-45ca-4006-bf91-7d4471129961-kube-api-access-8c8f4\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:54:48.572674 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:48.572675    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ab188d4f-45ca-4006-bf91-7d4471129961-maas-api-tls\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:54:49.260950 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:49.260919    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"
Jul 13 21:54:49.261393 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:49.260965    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5" event={"ID":"ab188d4f-45ca-4006-bf91-7d4471129961","Type":"ContainerDied","Data":"03bcfd5fabd19e9b50e0be63530b140e8633fe1344fec4fe28448985e6c86428"}
Jul 13 21:54:49.261393 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:49.261026    2575 scope.go:117] "RemoveContainer" containerID="3773a76e83ebdf9d2a06e83f6e797209f310f768c41b1c63a60f9f95e7ab99e9"
Jul 13 21:54:49.291046 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:49.291018    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"]
Jul 13 21:54:49.296765 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:49.296744    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bfec26b9-548884665b-zvql5"]
Jul 13 21:54:49.473525 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:54:49.470387    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab188d4f-45ca-4006-bf91-7d4471129961" path="/var/lib/kubelet/pods/ab188d4f-45ca-4006-bf91-7d4471129961/volumes"
Jul 13 21:55:35.612651 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:35.612620    2575 scope.go:117] "RemoveContainer" containerID="cc38ebfd2c3286584280bf26a7206a658d4069f60469aece45df50b273186e49"
Jul 13 21:55:43.968972 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:43.968941    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"]
Jul 13 21:55:43.969386 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:43.969161    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy" containerID="cri-o://54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6" gracePeriod=30
Jul 13 21:55:47.176009 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:47.175974    2575 patch_prober.go:28] interesting pod/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 21:55:47.176401 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:47.176048    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:55:49.227691 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.227667    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:55:49.305615 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.305583    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-credential-socket\") pod \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") "
Jul 13 21:55:49.305763 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.305639    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istiod-ca-cert\") pod \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") "
Jul 13 21:55:49.305763 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.305683    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-socket\") pod \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") "
Jul 13 21:55:49.305763 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.305733    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-certs\") pod \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") "
Jul 13 21:55:49.305941 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.305774    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-envoy\") pod \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") "
Jul 13 21:55:49.305941 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.305825    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-data\") pod \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") "
Jul 13 21:55:49.305941 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.305869    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njcsd\" (UniqueName: \"kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-kube-api-access-njcsd\") pod \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") "
Jul 13 21:55:49.305941 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.305904    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" (UID: "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:49.306150 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.305965    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-podinfo\") pod \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") "
Jul 13 21:55:49.306150 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.305992    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-token\") pod \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\" (UID: \"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7\") "
Jul 13 21:55:49.306150 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.306012    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" (UID: "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:49.306150 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.306118    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" (UID: "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:49.306388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.306167    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" (UID: "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:55:49.306388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.306322    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:55:49.306388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.306366    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:55:49.306388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.306380    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:55:49.306612 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.306391    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:55:49.306794 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.306762    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-data" (OuterVolumeSpecName: "istio-data") pod "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" (UID: "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:49.308223 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.308204    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-token" (OuterVolumeSpecName: "istio-token") pod "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" (UID: "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:55:49.308611 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.308590    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" (UID: "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:55:49.308611 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.308602    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" (UID: "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:55:49.308764 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.308590    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-kube-api-access-njcsd" (OuterVolumeSpecName: "kube-api-access-njcsd") pod "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" (UID: "4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7"). InnerVolumeSpecName "kube-api-access-njcsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:55:49.407413 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.407381    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:55:49.407413 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.407407    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:55:49.407413 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.407415    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:55:49.407635 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.407423    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:55:49.407635 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.407431    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njcsd\" (UniqueName: \"kubernetes.io/projected/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7-kube-api-access-njcsd\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:55:49.570406 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.570299    2575 generic.go:356] "Generic (PLEG): container finished" podID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerID="54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6" exitCode=0
Jul 13 21:55:49.570406 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.570366    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"
Jul 13 21:55:49.570406 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.570389    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" event={"ID":"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7","Type":"ContainerDied","Data":"54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6"}
Jul 13 21:55:49.570640 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.570443    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2" event={"ID":"4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7","Type":"ContainerDied","Data":"8d5f451fc55d3f31ede300db358a5e65cf9fc02a89d809624785009b7593ceba"}
Jul 13 21:55:49.570640 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.570469    2575 scope.go:117] "RemoveContainer" containerID="54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6"
Jul 13 21:55:49.579042 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.579026    2575 scope.go:117] "RemoveContainer" containerID="f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817"
Jul 13 21:55:49.586686 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.586668    2575 scope.go:117] "RemoveContainer" containerID="54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6"
Jul 13 21:55:49.586947 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:55:49.586928    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6\": container with ID starting with 54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6 not found: ID does not exist" containerID="54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6"
Jul 13 21:55:49.587020 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.586963    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6"} err="failed to get container status \"54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6\": rpc error: code = NotFound desc = could not find container \"54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6\": container with ID starting with 54984ac41876b1f74eca11defa9e343e6e62d986bf30c940056ef960fc4189a6 not found: ID does not exist"
Jul 13 21:55:49.587020 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.586989    2575 scope.go:117] "RemoveContainer" containerID="f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817"
Jul 13 21:55:49.587231 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:55:49.587213    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817\": container with ID starting with f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817 not found: ID does not exist" containerID="f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817"
Jul 13 21:55:49.587270 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.587237    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817"} err="failed to get container status \"f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817\": rpc error: code = NotFound desc = could not find container \"f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817\": container with ID starting with f8259a9a90bc7ab55a7852512ef2f2b9da7d88642514e7381deb4f4f752ed817 not found: ID does not exist"
Jul 13 21:55:49.590245 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.590225    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"]
Jul 13 21:55:49.596721 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:49.596702    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bfec26b9-openshift-default-8cbc6bd9f-j4gd2"]
Jul 13 21:55:51.470724 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:55:51.470689    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" path="/var/lib/kubelet/pods/4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7/volumes"
Jul 13 21:56:35.513927 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:35.513900    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:56:35.517295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:35.517271    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:56:35.522284 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:35.522262    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 21:56:35.525495 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:35.525481    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 21:56:35.637220 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:35.637191    2575 scope.go:117] "RemoveContainer" containerID="2cb47e82e932f537560d22c35010a70ff74e1736e39b97400d50e32d9989e3f1"
Jul 13 21:56:38.706398 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.706358    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"]
Jul 13 21:56:38.706951 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.706935    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab188d4f-45ca-4006-bf91-7d4471129961" containerName="maas-api"
Jul 13 21:56:38.707001 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.706954    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab188d4f-45ca-4006-bf91-7d4471129961" containerName="maas-api"
Jul 13 21:56:38.707001 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.706991    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy"
Jul 13 21:56:38.707068 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.707000    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy"
Jul 13 21:56:38.707102 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.707092    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab188d4f-45ca-4006-bf91-7d4471129961" containerName="maas-api"
Jul 13 21:56:38.707135 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.707105    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy"
Jul 13 21:56:38.707135 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.707115    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy"
Jul 13 21:56:38.713685 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.713665    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.716684 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.716661    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-6100d7-openshift-default-dockercfg-546np\""
Jul 13 21:56:38.721684 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.721658    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"]
Jul 13 21:56:38.821706 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.821672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-certs\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.821906 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.821713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kc72\" (UniqueName: \"kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-kube-api-access-4kc72\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.821906 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.821741    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-socket\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.821906 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.821782    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-envoy\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.821906 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.821796    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-podinfo\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.821906 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.821830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-credential-socket\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.821906 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.821861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-data\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.822129 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.821925    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-token\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.822129 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.821941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istiod-ca-cert\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.922840 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.922806    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-token\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.922840 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.922841    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istiod-ca-cert\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923099 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.922944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-certs\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923099 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.922973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kc72\" (UniqueName: \"kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-kube-api-access-4kc72\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923099 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.922994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-socket\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923099 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.923022    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-envoy\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923099 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.923039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-podinfo\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.923242    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-credential-socket\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.923309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-data\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923529 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.923500    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-socket\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923674 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.923650    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-data\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923790 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.923686    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-certs\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923790 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.923729    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-credential-socket\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.923790 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.923752    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istiod-ca-cert\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.925463 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.925435    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-envoy\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.925582 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.925535    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-podinfo\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.931625 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.931605    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-token\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:38.931870 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:38.931846    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kc72\" (UniqueName: \"kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-kube-api-access-4kc72\") pod \"e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") " pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:39.024827 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:39.024734    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:39.165224 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:39.165198    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"]
Jul 13 21:56:39.166587 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:56:39.166561    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab53326_404d_4a7d_a94d_bb6e567fbbcb.slice/crio-be7f8e225491d11d11fa86859ff74e8576ebafcd421a40106b147b679f70e9eb WatchSource:0}: Error finding container be7f8e225491d11d11fa86859ff74e8576ebafcd421a40106b147b679f70e9eb: Status 404 returned error can't find the container with id be7f8e225491d11d11fa86859ff74e8576ebafcd421a40106b147b679f70e9eb
Jul 13 21:56:39.168730 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:39.168694    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:56:39.168826 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:39.168763    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:56:39.168826 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:39.168790    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:56:39.824511 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:39.824473    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" event={"ID":"aab53326-404d-4a7d-a94d-bb6e567fbbcb","Type":"ContainerStarted","Data":"ed3cf313d05b0017663d64d19874fa736724523d8573b742282393dd150b6e89"}
Jul 13 21:56:39.824885 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:39.824526    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" event={"ID":"aab53326-404d-4a7d-a94d-bb6e567fbbcb","Type":"ContainerStarted","Data":"be7f8e225491d11d11fa86859ff74e8576ebafcd421a40106b147b679f70e9eb"}
Jul 13 21:56:39.848608 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:39.848556    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" podStartSLOduration=1.848540479 podStartE2EDuration="1.848540479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:56:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:56:39.84755385 +0000 UTC m=+2104.936834027" watchObservedRunningTime="2026-07-13 21:56:39.848540479 +0000 UTC m=+2104.937820632"
Jul 13 21:56:40.025020 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:40.024979    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:40.030042 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:40.030013    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:40.829959 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:40.829926    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:40.831114 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:40.831091    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:41.827320 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.827289    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"]
Jul 13 21:56:41.827708 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.827694    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy"
Jul 13 21:56:41.827754 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.827710    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d0fe31e-cd13-40cd-ae47-2d65d88fbbb7" containerName="istio-proxy"
Jul 13 21:56:41.830946 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.830921    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:41.833627 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.833575    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-6100d7-serving-cert\""
Jul 13 21:56:41.833772 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.833663    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nq9m7\""
Jul 13 21:56:41.833772 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.833741    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:56:41.834664 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.834646    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:56:41.839566 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.839535    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"]
Jul 13 21:56:41.950094 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.950054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vwx7\" (UniqueName: \"kubernetes.io/projected/35988fcd-1fb4-4c85-9310-5d8255feea65-kube-api-access-8vwx7\") pod \"maas-api-e2e-inf-a-6100d7-6b58744795-kh99z\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:41.950303 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.950265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35988fcd-1fb4-4c85-9310-5d8255feea65-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6100d7-6b58744795-kh99z\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:41.950407 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:41.950380    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35988fcd-1fb4-4c85-9310-5d8255feea65-maas-api-tls\") pod \"maas-api-e2e-inf-a-6100d7-6b58744795-kh99z\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:42.051762 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:42.051719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35988fcd-1fb4-4c85-9310-5d8255feea65-maas-api-tls\") pod \"maas-api-e2e-inf-a-6100d7-6b58744795-kh99z\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:42.051976 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:42.051778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vwx7\" (UniqueName: \"kubernetes.io/projected/35988fcd-1fb4-4c85-9310-5d8255feea65-kube-api-access-8vwx7\") pod \"maas-api-e2e-inf-a-6100d7-6b58744795-kh99z\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:42.051976 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:56:42.051883    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-serving-cert: secret "maas-api-e2e-inf-a-6100d7-serving-cert" not found
Jul 13 21:56:42.051976 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:42.051908    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35988fcd-1fb4-4c85-9310-5d8255feea65-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6100d7-6b58744795-kh99z\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:42.051976 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:56:42.051955    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35988fcd-1fb4-4c85-9310-5d8255feea65-maas-api-tls podName:35988fcd-1fb4-4c85-9310-5d8255feea65 nodeName:}" failed. No retries permitted until 2026-07-13 21:56:42.551935032 +0000 UTC m=+2107.641215181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/35988fcd-1fb4-4c85-9310-5d8255feea65-maas-api-tls") pod "maas-api-e2e-inf-a-6100d7-6b58744795-kh99z" (UID: "35988fcd-1fb4-4c85-9310-5d8255feea65") : secret "maas-api-e2e-inf-a-6100d7-serving-cert" not found
Jul 13 21:56:42.052675 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:42.052655    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35988fcd-1fb4-4c85-9310-5d8255feea65-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6100d7-6b58744795-kh99z\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:42.061560 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:42.061536    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vwx7\" (UniqueName: \"kubernetes.io/projected/35988fcd-1fb4-4c85-9310-5d8255feea65-kube-api-access-8vwx7\") pod \"maas-api-e2e-inf-a-6100d7-6b58744795-kh99z\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:42.555781 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:42.555747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35988fcd-1fb4-4c85-9310-5d8255feea65-maas-api-tls\") pod \"maas-api-e2e-inf-a-6100d7-6b58744795-kh99z\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:42.558055 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:42.558033    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35988fcd-1fb4-4c85-9310-5d8255feea65-maas-api-tls\") pod \"maas-api-e2e-inf-a-6100d7-6b58744795-kh99z\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:42.744013 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:42.743970    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:42.879413 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:42.879391    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"]
Jul 13 21:56:42.881689 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:56:42.881658    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35988fcd_1fb4_4c85_9310_5d8255feea65.slice/crio-8ec88fc94c6b58d2fe4f097f1892a9c623f65acbc0496886fa59044c8a29aa4d WatchSource:0}: Error finding container 8ec88fc94c6b58d2fe4f097f1892a9c623f65acbc0496886fa59044c8a29aa4d: Status 404 returned error can't find the container with id 8ec88fc94c6b58d2fe4f097f1892a9c623f65acbc0496886fa59044c8a29aa4d
Jul 13 21:56:43.847694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:43.847655    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z" event={"ID":"35988fcd-1fb4-4c85-9310-5d8255feea65","Type":"ContainerStarted","Data":"0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945"}
Jul 13 21:56:43.847885 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:43.847707    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z" event={"ID":"35988fcd-1fb4-4c85-9310-5d8255feea65","Type":"ContainerStarted","Data":"8ec88fc94c6b58d2fe4f097f1892a9c623f65acbc0496886fa59044c8a29aa4d"}
Jul 13 21:56:43.847885 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:43.847749    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:43.867309 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:43.867268    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z" podStartSLOduration=2.296241396 podStartE2EDuration="2.867254278s" totalImagesPullingTime="571.012882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:56:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:56:43.864995269 +0000 UTC m=+2108.954275445" watchObservedRunningTime="2026-07-13 21:56:43.867254278 +0000 UTC m=+2108.956534431"
Jul 13 21:56:46.819404 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.819373    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"]
Jul 13 21:56:46.823184 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.823163    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.826150 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.826132    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-04c954-openshift-default-dockercfg-zfw2d\""
Jul 13 21:56:46.839071 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.839045    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"]
Jul 13 21:56:46.895647 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.895616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-token\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.895647 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.895650    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kwzl\" (UniqueName: \"kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-kube-api-access-4kwzl\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.895848 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.895673    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-podinfo\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.895848 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.895748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-socket\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.895848 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.895769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8325ae6e-219e-4f4c-a3d1-5690de94040e-istiod-ca-cert\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.895848 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.895800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-credential-socket\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.895848 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.895817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-data\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.896063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.895859    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-envoy\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.896063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.895895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-certs\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.996509 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996470    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-socket\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.996509 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996510    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8325ae6e-219e-4f4c-a3d1-5690de94040e-istiod-ca-cert\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.996756 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-credential-socket\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.996756 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-data\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.996756 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996586    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-envoy\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.996756 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996611    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-certs\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.996756 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-token\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.996756 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kwzl\" (UniqueName: \"kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-kube-api-access-4kwzl\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.996756 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-podinfo\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.997102 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996893    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-socket\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.997102 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.996950    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-credential-socket\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.997363 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.997300    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-certs\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.997363 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.997330    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8325ae6e-219e-4f4c-a3d1-5690de94040e-istiod-ca-cert\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.997559 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.997373    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-data\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.999184 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.999162    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-envoy\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:46.999349 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:46.999313    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-podinfo\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:47.006295 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:47.006272    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-token\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:47.006620 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:47.006601    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kwzl\" (UniqueName: \"kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-kube-api-access-4kwzl\") pod \"e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") " pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:47.134165 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:47.134082    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:47.285229 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:47.285199    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"]
Jul 13 21:56:47.286778 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:56:47.286754    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8325ae6e_219e_4f4c_a3d1_5690de94040e.slice/crio-db0ca39818c2dd08a328a3ffd889138a707ba9ccb1ded28571112753fd0babdc WatchSource:0}: Error finding container db0ca39818c2dd08a328a3ffd889138a707ba9ccb1ded28571112753fd0babdc: Status 404 returned error can't find the container with id db0ca39818c2dd08a328a3ffd889138a707ba9ccb1ded28571112753fd0babdc
Jul 13 21:56:47.289266 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:47.289222    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:56:47.289373 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:47.289306    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:56:47.289373 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:47.289361    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:56:47.870025 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:47.869992    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" event={"ID":"8325ae6e-219e-4f4c-a3d1-5690de94040e","Type":"ContainerStarted","Data":"3bc57f883a1be32ca1a62b20f367162599a46538c3a44eef5c4911585b2780e8"}
Jul 13 21:56:47.870426 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:47.870049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" event={"ID":"8325ae6e-219e-4f4c-a3d1-5690de94040e","Type":"ContainerStarted","Data":"db0ca39818c2dd08a328a3ffd889138a707ba9ccb1ded28571112753fd0babdc"}
Jul 13 21:56:47.891031 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:47.890979    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" podStartSLOduration=1.890965038 podStartE2EDuration="1.890965038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:56:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:56:47.889590727 +0000 UTC m=+2112.978870890" watchObservedRunningTime="2026-07-13 21:56:47.890965038 +0000 UTC m=+2112.980245191"
Jul 13 21:56:48.135250 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:48.135172    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:48.139960 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:48.139935    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:48.875157 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:48.875125    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:48.876199 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:48.876181    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:56:49.829628 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:49.829590    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"]
Jul 13 21:56:49.836895 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:49.836860    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:49.843148 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:49.843108    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"]
Jul 13 21:56:49.843577 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:49.843554    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-04c954-serving-cert\""
Jul 13 21:56:49.866392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:49.866365    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:56:49.926454 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:49.926422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7cq6\" (UniqueName: \"kubernetes.io/projected/87236d44-787b-44f9-8adf-3daceaf63c5d-kube-api-access-z7cq6\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:49.926888 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:49.926783    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:49.926888 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:49.926839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87236d44-787b-44f9-8adf-3daceaf63c5d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:50.027654 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:50.027618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:50.028045 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:50.028020    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87236d44-787b-44f9-8adf-3daceaf63c5d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:50.028240 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:50.028210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7cq6\" (UniqueName: \"kubernetes.io/projected/87236d44-787b-44f9-8adf-3daceaf63c5d-kube-api-access-z7cq6\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:50.029173 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:50.029078    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87236d44-787b-44f9-8adf-3daceaf63c5d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:50.029309 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:56:50.027973    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-serving-cert: secret "maas-api-e2e-inf-b-04c954-serving-cert" not found
Jul 13 21:56:50.029489 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:56:50.029478    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls podName:87236d44-787b-44f9-8adf-3daceaf63c5d nodeName:}" failed. No retries permitted until 2026-07-13 21:56:50.529456016 +0000 UTC m=+2115.618736150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls") pod "maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms" (UID: "87236d44-787b-44f9-8adf-3daceaf63c5d") : secret "maas-api-e2e-inf-b-04c954-serving-cert" not found
Jul 13 21:56:50.052290 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:50.052260    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7cq6\" (UniqueName: \"kubernetes.io/projected/87236d44-787b-44f9-8adf-3daceaf63c5d-kube-api-access-z7cq6\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:50.534645 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:50.534600    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:50.534894 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:56:50.534860    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-serving-cert: secret "maas-api-e2e-inf-b-04c954-serving-cert" not found
Jul 13 21:56:50.535108 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:56:50.535095    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls podName:87236d44-787b-44f9-8adf-3daceaf63c5d nodeName:}" failed. No retries permitted until 2026-07-13 21:56:51.535072709 +0000 UTC m=+2116.624352863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls") pod "maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms" (UID: "87236d44-787b-44f9-8adf-3daceaf63c5d") : secret "maas-api-e2e-inf-b-04c954-serving-cert" not found
Jul 13 21:56:51.547155 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:51.547119    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:51.553201 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:51.551095    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls\") pod \"maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:51.654582 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:51.654534    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:52.018767 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:52.018736    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"]
Jul 13 21:56:52.021917 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:56:52.021886    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87236d44_787b_44f9_8adf_3daceaf63c5d.slice/crio-a6abd4e01ce83434eeee339063e42ff02dc997da15a2ff1835a35ea3eb6a5964 WatchSource:0}: Error finding container a6abd4e01ce83434eeee339063e42ff02dc997da15a2ff1835a35ea3eb6a5964: Status 404 returned error can't find the container with id a6abd4e01ce83434eeee339063e42ff02dc997da15a2ff1835a35ea3eb6a5964
Jul 13 21:56:52.900214 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:52.900170    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms" event={"ID":"87236d44-787b-44f9-8adf-3daceaf63c5d","Type":"ContainerStarted","Data":"f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90"}
Jul 13 21:56:52.900622 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:52.900227    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms" event={"ID":"87236d44-787b-44f9-8adf-3daceaf63c5d","Type":"ContainerStarted","Data":"a6abd4e01ce83434eeee339063e42ff02dc997da15a2ff1835a35ea3eb6a5964"}
Jul 13 21:56:52.900622 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:52.900249    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:52.919771 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:52.919728    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms" podStartSLOduration=3.459263385 podStartE2EDuration="3.919712869s" totalImagesPullingTime="460.449484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:56:52.918812632 +0000 UTC m=+2118.008092810" watchObservedRunningTime="2026-07-13 21:56:52.919712869 +0000 UTC m=+2118.008993022"
Jul 13 21:56:56.573289 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:56.572570    2575 patch_prober.go:28] interesting pod/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:42116->10.132.0.56:15021: read: connection reset by peer" start-of-body=
Jul 13 21:56:56.573289 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:56.572735    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:42116->10.132.0.56:15021: read: connection reset by peer"
Jul 13 21:56:56.923209 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:56.923112    2575 generic.go:356] "Generic (PLEG): container finished" podID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerID="ed3cf313d05b0017663d64d19874fa736724523d8573b742282393dd150b6e89" exitCode=0
Jul 13 21:56:56.923209 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:56.923189    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" event={"ID":"aab53326-404d-4a7d-a94d-bb6e567fbbcb","Type":"ContainerDied","Data":"ed3cf313d05b0017663d64d19874fa736724523d8573b742282393dd150b6e89"}
Jul 13 21:56:56.923664 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:56.923645    2575 scope.go:117] "RemoveContainer" containerID="ed3cf313d05b0017663d64d19874fa736724523d8573b742282393dd150b6e89"
Jul 13 21:56:56.924628 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:56.924603    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:56:56.924680 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:56.924664    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:56:56.924714 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:56.924702    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:56:57.961364 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:57.961220    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" event={"ID":"aab53326-404d-4a7d-a94d-bb6e567fbbcb","Type":"ContainerStarted","Data":"4d865328ff74a18534599a02fb4d07f6e1937d6bd832af5b1b50987cdaa425c7"}
Jul 13 21:56:58.024971 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:58.024918    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:56:58.025385 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:58.025326    2575 patch_prober.go:28] interesting pod/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 13 21:56:58.025455 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:58.025414    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 13 21:56:58.910392 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:58.910328    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:56:59.025755 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:59.025720    2575 patch_prober.go:28] interesting pod/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 13 21:56:59.026209 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:56:59.025775    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 13 21:57:00.026698 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:00.026662    2575 patch_prober.go:28] interesting pod/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 13 21:57:00.027099 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:00.026719    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 13 21:57:01.025811 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:01.025764    2575 patch_prober.go:28] interesting pod/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 13 21:57:01.025986 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:01.025840    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 13 21:57:02.026047 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:02.026010    2575 patch_prober.go:28] interesting pod/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 13 21:57:02.026598 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:02.026067    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 13 21:57:03.028713 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:03.028681    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:57:03.029105 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:03.029038    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:57:03.029718 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:03.029701    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:57:03.876619 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:03.876587    2575 patch_prober.go:28] interesting pod/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 13 21:57:03.876813 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:03.876643    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 13 21:57:04.000929 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:04.000896    2575 generic.go:356] "Generic (PLEG): container finished" podID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerID="3bc57f883a1be32ca1a62b20f367162599a46538c3a44eef5c4911585b2780e8" exitCode=0
Jul 13 21:57:04.001110 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:04.000966    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" event={"ID":"8325ae6e-219e-4f4c-a3d1-5690de94040e","Type":"ContainerDied","Data":"3bc57f883a1be32ca1a62b20f367162599a46538c3a44eef5c4911585b2780e8"}
Jul 13 21:57:04.001371 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:04.001354    2575 scope.go:117] "RemoveContainer" containerID="3bc57f883a1be32ca1a62b20f367162599a46538c3a44eef5c4911585b2780e8"
Jul 13 21:57:04.002318 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:04.002291    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:57:04.002433 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:04.002378    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:57:04.002433 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:04.002412    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:57:05.007769 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:05.007731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" event={"ID":"8325ae6e-219e-4f4c-a3d1-5690de94040e","Type":"ContainerStarted","Data":"ffeee1129faba27e75d4a20253a1063d6ab0067d921435d9beba2a1d6d583a5f"}
Jul 13 21:57:05.134778 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:05.134725    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:57:05.135031 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:05.135000    2575 patch_prober.go:28] interesting pod/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 13 21:57:05.135108 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:05.135067    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 13 21:57:06.140667 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:06.140631    2575 patch_prober.go:28] interesting pod/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 13 21:57:06.141205 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:06.141174    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 13 21:57:07.135473 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:07.135437    2575 patch_prober.go:28] interesting pod/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 13 21:57:07.135756 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:07.135728    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 13 21:57:08.134406 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:08.134373    2575 patch_prober.go:28] interesting pod/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Jul 13 21:57:08.134950 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:08.134919    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Jul 13 21:57:09.139086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:09.139053    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:57:09.139566 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:09.139549    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:57:09.140181 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:57:09.140161    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:58:03.925559 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:03.925527    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"]
Jul 13 21:58:03.926183 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:03.925729    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z" podUID="35988fcd-1fb4-4c85-9310-5d8255feea65" containerName="maas-api" containerID="cri-o://0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945" gracePeriod=30
Jul 13 21:58:04.184484 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.184426    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:58:04.225219 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.225190    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35988fcd-1fb4-4c85-9310-5d8255feea65-openshift-service-ca\") pod \"35988fcd-1fb4-4c85-9310-5d8255feea65\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") "
Jul 13 21:58:04.225384 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.225243    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35988fcd-1fb4-4c85-9310-5d8255feea65-maas-api-tls\") pod \"35988fcd-1fb4-4c85-9310-5d8255feea65\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") "
Jul 13 21:58:04.225384 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.225278    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vwx7\" (UniqueName: \"kubernetes.io/projected/35988fcd-1fb4-4c85-9310-5d8255feea65-kube-api-access-8vwx7\") pod \"35988fcd-1fb4-4c85-9310-5d8255feea65\" (UID: \"35988fcd-1fb4-4c85-9310-5d8255feea65\") "
Jul 13 21:58:04.225650 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.225622    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35988fcd-1fb4-4c85-9310-5d8255feea65-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "35988fcd-1fb4-4c85-9310-5d8255feea65" (UID: "35988fcd-1fb4-4c85-9310-5d8255feea65"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:58:04.227388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.227355    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35988fcd-1fb4-4c85-9310-5d8255feea65-kube-api-access-8vwx7" (OuterVolumeSpecName: "kube-api-access-8vwx7") pod "35988fcd-1fb4-4c85-9310-5d8255feea65" (UID: "35988fcd-1fb4-4c85-9310-5d8255feea65"). InnerVolumeSpecName "kube-api-access-8vwx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:58:04.227388 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.227363    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35988fcd-1fb4-4c85-9310-5d8255feea65-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "35988fcd-1fb4-4c85-9310-5d8255feea65" (UID: "35988fcd-1fb4-4c85-9310-5d8255feea65"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:58:04.316740 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.316706    2575 generic.go:356] "Generic (PLEG): container finished" podID="35988fcd-1fb4-4c85-9310-5d8255feea65" containerID="0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945" exitCode=0
Jul 13 21:58:04.316913 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.316752    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z" event={"ID":"35988fcd-1fb4-4c85-9310-5d8255feea65","Type":"ContainerDied","Data":"0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945"}
Jul 13 21:58:04.316913 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.316789    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z" event={"ID":"35988fcd-1fb4-4c85-9310-5d8255feea65","Type":"ContainerDied","Data":"8ec88fc94c6b58d2fe4f097f1892a9c623f65acbc0496886fa59044c8a29aa4d"}
Jul 13 21:58:04.316913 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.316808    2575 scope.go:117] "RemoveContainer" containerID="0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945"
Jul 13 21:58:04.316913 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.316751    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"
Jul 13 21:58:04.326213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.326188    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35988fcd-1fb4-4c85-9310-5d8255feea65-openshift-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:04.326320 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.326218    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35988fcd-1fb4-4c85-9310-5d8255feea65-maas-api-tls\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:04.326320 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.326233    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vwx7\" (UniqueName: \"kubernetes.io/projected/35988fcd-1fb4-4c85-9310-5d8255feea65-kube-api-access-8vwx7\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:04.328819 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.328800    2575 scope.go:117] "RemoveContainer" containerID="0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945"
Jul 13 21:58:04.329324 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:58:04.329296    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945\": container with ID starting with 0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945 not found: ID does not exist" containerID="0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945"
Jul 13 21:58:04.329455 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.329356    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945"} err="failed to get container status \"0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945\": rpc error: code = NotFound desc = could not find container \"0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945\": container with ID starting with 0979bc9d493a8a8bdc812c4cb00114bc744b62c67a9c2026e0f5dc73ac059945 not found: ID does not exist"
Jul 13 21:58:04.339317 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.339286    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"]
Jul 13 21:58:04.343146 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:04.343126    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6100d7-6b58744795-kh99z"]
Jul 13 21:58:05.468744 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:05.468702    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35988fcd-1fb4-4c85-9310-5d8255feea65" path="/var/lib/kubelet/pods/35988fcd-1fb4-4c85-9310-5d8255feea65/volumes"
Jul 13 21:58:19.252327 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:19.252294    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"]
Jul 13 21:58:19.252816 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:19.252571    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy" containerID="cri-o://4d865328ff74a18534599a02fb4d07f6e1937d6bd832af5b1b50987cdaa425c7" gracePeriod=30
Jul 13 21:58:24.433881 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.433848    2575 generic.go:356] "Generic (PLEG): container finished" podID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerID="4d865328ff74a18534599a02fb4d07f6e1937d6bd832af5b1b50987cdaa425c7" exitCode=0
Jul 13 21:58:24.434222 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.433879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" event={"ID":"aab53326-404d-4a7d-a94d-bb6e567fbbcb","Type":"ContainerDied","Data":"4d865328ff74a18534599a02fb4d07f6e1937d6bd832af5b1b50987cdaa425c7"}
Jul 13 21:58:24.434222 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.433945    2575 scope.go:117] "RemoveContainer" containerID="ed3cf313d05b0017663d64d19874fa736724523d8573b742282393dd150b6e89"
Jul 13 21:58:24.515429 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.515371    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:58:24.615220 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615189    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-certs\") pod \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") "
Jul 13 21:58:24.615398 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615225    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-credential-socket\") pod \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") "
Jul 13 21:58:24.615398 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615243    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-token\") pod \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") "
Jul 13 21:58:24.615398 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615259    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-envoy\") pod \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") "
Jul 13 21:58:24.615398 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615280    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istiod-ca-cert\") pod \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") "
Jul 13 21:58:24.615398 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615313    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kc72\" (UniqueName: \"kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-kube-api-access-4kc72\") pod \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") "
Jul 13 21:58:24.615687 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615423    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-socket\") pod \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") "
Jul 13 21:58:24.615687 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615451    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-data\") pod \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") "
Jul 13 21:58:24.615687 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615493    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-podinfo\") pod \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\" (UID: \"aab53326-404d-4a7d-a94d-bb6e567fbbcb\") "
Jul 13 21:58:24.615687 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615538    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aab53326-404d-4a7d-a94d-bb6e567fbbcb" (UID: "aab53326-404d-4a7d-a94d-bb6e567fbbcb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:24.615687 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615547    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aab53326-404d-4a7d-a94d-bb6e567fbbcb" (UID: "aab53326-404d-4a7d-a94d-bb6e567fbbcb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:24.615947 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615724    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aab53326-404d-4a7d-a94d-bb6e567fbbcb" (UID: "aab53326-404d-4a7d-a94d-bb6e567fbbcb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:58:24.615947 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615842    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:24.615947 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615860    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:24.615947 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615878    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:24.615947 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.615918    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aab53326-404d-4a7d-a94d-bb6e567fbbcb" (UID: "aab53326-404d-4a7d-a94d-bb6e567fbbcb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:24.616216 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.616197    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-data" (OuterVolumeSpecName: "istio-data") pod "aab53326-404d-4a7d-a94d-bb6e567fbbcb" (UID: "aab53326-404d-4a7d-a94d-bb6e567fbbcb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:24.617561 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.617530    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-token" (OuterVolumeSpecName: "istio-token") pod "aab53326-404d-4a7d-a94d-bb6e567fbbcb" (UID: "aab53326-404d-4a7d-a94d-bb6e567fbbcb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:58:24.617685 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.617585    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-kube-api-access-4kc72" (OuterVolumeSpecName: "kube-api-access-4kc72") pod "aab53326-404d-4a7d-a94d-bb6e567fbbcb" (UID: "aab53326-404d-4a7d-a94d-bb6e567fbbcb"). InnerVolumeSpecName "kube-api-access-4kc72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:58:24.617850 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.617831    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aab53326-404d-4a7d-a94d-bb6e567fbbcb" (UID: "aab53326-404d-4a7d-a94d-bb6e567fbbcb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:24.617912 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.617881    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aab53326-404d-4a7d-a94d-bb6e567fbbcb" (UID: "aab53326-404d-4a7d-a94d-bb6e567fbbcb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:58:24.717323 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.717292    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:24.717323 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.717315    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:24.717323 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.717325    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:24.717560 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.717333    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:24.717560 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.717377    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aab53326-404d-4a7d-a94d-bb6e567fbbcb-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:24.717560 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:24.717385    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kc72\" (UniqueName: \"kubernetes.io/projected/aab53326-404d-4a7d-a94d-bb6e567fbbcb-kube-api-access-4kc72\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:25.440391 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:25.440355    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6" event={"ID":"aab53326-404d-4a7d-a94d-bb6e567fbbcb","Type":"ContainerDied","Data":"be7f8e225491d11d11fa86859ff74e8576ebafcd421a40106b147b679f70e9eb"}
Jul 13 21:58:25.440955 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:25.440401    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"
Jul 13 21:58:25.440955 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:25.440458    2575 scope.go:117] "RemoveContainer" containerID="4d865328ff74a18534599a02fb4d07f6e1937d6bd832af5b1b50987cdaa425c7"
Jul 13 21:58:25.462643 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:25.462621    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"]
Jul 13 21:58:25.469869 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:25.469848    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-6100d7-openshift-default-7f84cf75cc-mkbm6"]
Jul 13 21:58:27.468637 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:27.468603    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" path="/var/lib/kubelet/pods/aab53326-404d-4a7d-a94d-bb6e567fbbcb/volumes"
Jul 13 21:58:30.008354 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.008314    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"]
Jul 13 21:58:30.008830 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.008634    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms" podUID="87236d44-787b-44f9-8adf-3daceaf63c5d" containerName="maas-api" containerID="cri-o://f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90" gracePeriod=30
Jul 13 21:58:30.463979 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.463953    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:58:30.468037 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.468006    2575 generic.go:356] "Generic (PLEG): container finished" podID="87236d44-787b-44f9-8adf-3daceaf63c5d" containerID="f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90" exitCode=0
Jul 13 21:58:30.468175 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.468040    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"
Jul 13 21:58:30.468175 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.468060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms" event={"ID":"87236d44-787b-44f9-8adf-3daceaf63c5d","Type":"ContainerDied","Data":"f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90"}
Jul 13 21:58:30.468175 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.468106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms" event={"ID":"87236d44-787b-44f9-8adf-3daceaf63c5d","Type":"ContainerDied","Data":"a6abd4e01ce83434eeee339063e42ff02dc997da15a2ff1835a35ea3eb6a5964"}
Jul 13 21:58:30.468175 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.468135    2575 scope.go:117] "RemoveContainer" containerID="f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90"
Jul 13 21:58:30.476396 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.476377    2575 scope.go:117] "RemoveContainer" containerID="f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90"
Jul 13 21:58:30.476649 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:58:30.476627    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90\": container with ID starting with f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90 not found: ID does not exist" containerID="f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90"
Jul 13 21:58:30.476729 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.476658    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90"} err="failed to get container status \"f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90\": rpc error: code = NotFound desc = could not find container \"f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90\": container with ID starting with f31fcb05efe756f85299cd9a78442d72fb3aace409ba59267d1291f503790a90 not found: ID does not exist"
Jul 13 21:58:30.571999 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.571973    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls\") pod \"87236d44-787b-44f9-8adf-3daceaf63c5d\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") "
Jul 13 21:58:30.572162 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.572015    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7cq6\" (UniqueName: \"kubernetes.io/projected/87236d44-787b-44f9-8adf-3daceaf63c5d-kube-api-access-z7cq6\") pod \"87236d44-787b-44f9-8adf-3daceaf63c5d\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") "
Jul 13 21:58:30.572162 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.572079    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87236d44-787b-44f9-8adf-3daceaf63c5d-openshift-service-ca\") pod \"87236d44-787b-44f9-8adf-3daceaf63c5d\" (UID: \"87236d44-787b-44f9-8adf-3daceaf63c5d\") "
Jul 13 21:58:30.572511 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.572481    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87236d44-787b-44f9-8adf-3daceaf63c5d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "87236d44-787b-44f9-8adf-3daceaf63c5d" (UID: "87236d44-787b-44f9-8adf-3daceaf63c5d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:58:30.574193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.574167    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87236d44-787b-44f9-8adf-3daceaf63c5d-kube-api-access-z7cq6" (OuterVolumeSpecName: "kube-api-access-z7cq6") pod "87236d44-787b-44f9-8adf-3daceaf63c5d" (UID: "87236d44-787b-44f9-8adf-3daceaf63c5d"). InnerVolumeSpecName "kube-api-access-z7cq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:58:30.574193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.574176    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "87236d44-787b-44f9-8adf-3daceaf63c5d" (UID: "87236d44-787b-44f9-8adf-3daceaf63c5d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:58:30.673143 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.673109    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87236d44-787b-44f9-8adf-3daceaf63c5d-maas-api-tls\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:30.673143 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.673140    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7cq6\" (UniqueName: \"kubernetes.io/projected/87236d44-787b-44f9-8adf-3daceaf63c5d-kube-api-access-z7cq6\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:30.673143 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.673150    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87236d44-787b-44f9-8adf-3daceaf63c5d-openshift-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:30.792131 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.792103    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"]
Jul 13 21:58:30.796841 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:30.796814    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-04c954-6f84bc5d65-czmms"]
Jul 13 21:58:31.471771 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:31.471719    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87236d44-787b-44f9-8adf-3daceaf63c5d" path="/var/lib/kubelet/pods/87236d44-787b-44f9-8adf-3daceaf63c5d/volumes"
Jul 13 21:58:45.352080 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:45.352044    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"]
Jul 13 21:58:45.352595 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:45.352311    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy" containerID="cri-o://ffeee1129faba27e75d4a20253a1063d6ab0067d921435d9beba2a1d6d583a5f" gracePeriod=30
Jul 13 21:58:46.185091 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185054    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"]
Jul 13 21:58:46.185500 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185479    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35988fcd-1fb4-4c85-9310-5d8255feea65" containerName="maas-api"
Jul 13 21:58:46.185500 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185502    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="35988fcd-1fb4-4c85-9310-5d8255feea65" containerName="maas-api"
Jul 13 21:58:46.185694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185516    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87236d44-787b-44f9-8adf-3daceaf63c5d" containerName="maas-api"
Jul 13 21:58:46.185694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185522    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="87236d44-787b-44f9-8adf-3daceaf63c5d" containerName="maas-api"
Jul 13 21:58:46.185694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185539    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy"
Jul 13 21:58:46.185694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185545    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy"
Jul 13 21:58:46.185694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185553    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy"
Jul 13 21:58:46.185694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185559    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy"
Jul 13 21:58:46.185694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185638    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy"
Jul 13 21:58:46.185694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185646    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="87236d44-787b-44f9-8adf-3daceaf63c5d" containerName="maas-api"
Jul 13 21:58:46.185694 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.185657    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="35988fcd-1fb4-4c85-9310-5d8255feea65" containerName="maas-api"
Jul 13 21:58:46.188682 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.188663    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.192035 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.192017    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-09f5ac-openshift-default-dockercfg-47rz5\""
Jul 13 21:58:46.200665 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.200643    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"]
Jul 13 21:58:46.205967 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.205941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-token\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.206079 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.205982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-envoy\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.206079 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.206039    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8v4f\" (UniqueName: \"kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-kube-api-access-r8v4f\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.206205 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.206082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-certs\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.206205 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.206097    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-podinfo\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.206205 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.206131    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-socket\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.206205 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.206166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-credential-socket\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.206455 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.206217    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-data\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.206455 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.206234    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istiod-ca-cert\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.306750 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.306719    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-envoy\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.306936 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.306775    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8v4f\" (UniqueName: \"kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-kube-api-access-r8v4f\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.306936 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.306830    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-certs\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.306936 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.306849    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-podinfo\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.306936 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.306905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-socket\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.306936 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.306928    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-credential-socket\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.307213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.306955    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-data\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.307213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.306977    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istiod-ca-cert\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.307213 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.307009    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-token\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.307417 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.307236    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-certs\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.307417 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.307366    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-socket\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.307654 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.307630    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-credential-socket\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.307709 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.307680    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-data\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.307747 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.307702    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istiod-ca-cert\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.309124 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.309100    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-envoy\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.309372 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.309351    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-podinfo\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.315048 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.315025    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-token\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.315144 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.315095    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8v4f\" (UniqueName: \"kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-kube-api-access-r8v4f\") pod \"e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") " pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.499441 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.499322    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:46.638661 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.638631    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"]
Jul 13 21:58:46.640055 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:58:46.640027    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd77bd43_baea_4d64_936a_ddb7eb5c50c7.slice/crio-e8229228921eea9adbcda61c346688340a94c0eb84379da34a29a8e4c7be4017 WatchSource:0}: Error finding container e8229228921eea9adbcda61c346688340a94c0eb84379da34a29a8e4c7be4017: Status 404 returned error can't find the container with id e8229228921eea9adbcda61c346688340a94c0eb84379da34a29a8e4c7be4017
Jul 13 21:58:46.642188 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.642149    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:58:46.642251 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.642237    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:58:46.642301 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:46.642285    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:58:47.564038 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:47.564004    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" event={"ID":"dd77bd43-baea-4d64-936a-ddb7eb5c50c7","Type":"ContainerStarted","Data":"2b6f83cc47d2ef1d34d48d425621845e08b8ae282e08d3b5b28ccc0b246d60bd"}
Jul 13 21:58:47.564441 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:47.564060    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" event={"ID":"dd77bd43-baea-4d64-936a-ddb7eb5c50c7","Type":"ContainerStarted","Data":"e8229228921eea9adbcda61c346688340a94c0eb84379da34a29a8e4c7be4017"}
Jul 13 21:58:47.586432 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:47.586389    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" podStartSLOduration=1.58637359 podStartE2EDuration="1.58637359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:58:47.584125528 +0000 UTC m=+2232.673405708" watchObservedRunningTime="2026-07-13 21:58:47.58637359 +0000 UTC m=+2232.675653742"
Jul 13 21:58:48.499597 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:48.499566    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:48.504405 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:48.504379    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:48.573121 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:48.573072    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:48.575911 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:48.575889    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:58:49.692480 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.692445    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"]
Jul 13 21:58:49.693063 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.693043    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="aab53326-404d-4a7d-a94d-bb6e567fbbcb" containerName="istio-proxy"
Jul 13 21:58:49.696253 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.696233    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:49.699271 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.699239    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 21:58:49.699424 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.699242    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nq9m7\""
Jul 13 21:58:49.699424 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.699273    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-09f5ac-serving-cert\""
Jul 13 21:58:49.700313 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.700294    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 21:58:49.711759 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.711735    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"]
Jul 13 21:58:49.736029 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.736002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krwk5\" (UniqueName: \"kubernetes.io/projected/fa989952-d3d5-4f86-910a-9c523aefc511-kube-api-access-krwk5\") pod \"maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:49.736140 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.736037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa989952-d3d5-4f86-910a-9c523aefc511-maas-api-tls\") pod \"maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:49.736192 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.736144    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa989952-d3d5-4f86-910a-9c523aefc511-openshift-service-ca\") pod \"maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:49.836646 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.836613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krwk5\" (UniqueName: \"kubernetes.io/projected/fa989952-d3d5-4f86-910a-9c523aefc511-kube-api-access-krwk5\") pod \"maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:49.836844 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.836652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa989952-d3d5-4f86-910a-9c523aefc511-maas-api-tls\") pod \"maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:49.836844 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.836729    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa989952-d3d5-4f86-910a-9c523aefc511-openshift-service-ca\") pod \"maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:49.837015 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:58:49.836858    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-serving-cert: secret "maas-api-e2e-api-a-09f5ac-serving-cert" not found
Jul 13 21:58:49.837015 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:58:49.836948    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa989952-d3d5-4f86-910a-9c523aefc511-maas-api-tls podName:fa989952-d3d5-4f86-910a-9c523aefc511 nodeName:}" failed. No retries permitted until 2026-07-13 21:58:50.336925123 +0000 UTC m=+2235.426205266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa989952-d3d5-4f86-910a-9c523aefc511-maas-api-tls") pod "maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c" (UID: "fa989952-d3d5-4f86-910a-9c523aefc511") : secret "maas-api-e2e-api-a-09f5ac-serving-cert" not found
Jul 13 21:58:49.837402 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.837385    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa989952-d3d5-4f86-910a-9c523aefc511-openshift-service-ca\") pod \"maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:49.863624 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:49.863602    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krwk5\" (UniqueName: \"kubernetes.io/projected/fa989952-d3d5-4f86-910a-9c523aefc511-kube-api-access-krwk5\") pod \"maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:50.341353 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.341314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa989952-d3d5-4f86-910a-9c523aefc511-maas-api-tls\") pod \"maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:50.343737 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.343719    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa989952-d3d5-4f86-910a-9c523aefc511-maas-api-tls\") pod \"maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:50.585655 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.585623    2575 generic.go:356] "Generic (PLEG): container finished" podID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerID="ffeee1129faba27e75d4a20253a1063d6ab0067d921435d9beba2a1d6d583a5f" exitCode=0
Jul 13 21:58:50.585864 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.585701    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" event={"ID":"8325ae6e-219e-4f4c-a3d1-5690de94040e","Type":"ContainerDied","Data":"ffeee1129faba27e75d4a20253a1063d6ab0067d921435d9beba2a1d6d583a5f"}
Jul 13 21:58:50.585864 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.585776    2575 scope.go:117] "RemoveContainer" containerID="3bc57f883a1be32ca1a62b20f367162599a46538c3a44eef5c4911585b2780e8"
Jul 13 21:58:50.607476 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.607452    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:50.616309 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.616286    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:58:50.643838 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.643808    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-data\") pod \"8325ae6e-219e-4f4c-a3d1-5690de94040e\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") "
Jul 13 21:58:50.644011 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.643865    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-token\") pod \"8325ae6e-219e-4f4c-a3d1-5690de94040e\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") "
Jul 13 21:58:50.644011 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.643893    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kwzl\" (UniqueName: \"kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-kube-api-access-4kwzl\") pod \"8325ae6e-219e-4f4c-a3d1-5690de94040e\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") "
Jul 13 21:58:50.644011 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.643948    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-envoy\") pod \"8325ae6e-219e-4f4c-a3d1-5690de94040e\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") "
Jul 13 21:58:50.644011 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.643989    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-certs\") pod \"8325ae6e-219e-4f4c-a3d1-5690de94040e\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") "
Jul 13 21:58:50.644193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.644013    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8325ae6e-219e-4f4c-a3d1-5690de94040e-istiod-ca-cert\") pod \"8325ae6e-219e-4f4c-a3d1-5690de94040e\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") "
Jul 13 21:58:50.644193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.644070    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-podinfo\") pod \"8325ae6e-219e-4f4c-a3d1-5690de94040e\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") "
Jul 13 21:58:50.644193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.644099    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-credential-socket\") pod \"8325ae6e-219e-4f4c-a3d1-5690de94040e\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") "
Jul 13 21:58:50.644193 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.644139    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-socket\") pod \"8325ae6e-219e-4f4c-a3d1-5690de94040e\" (UID: \"8325ae6e-219e-4f4c-a3d1-5690de94040e\") "
Jul 13 21:58:50.645173 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.644987    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8325ae6e-219e-4f4c-a3d1-5690de94040e" (UID: "8325ae6e-219e-4f4c-a3d1-5690de94040e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:50.645173 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.645051    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-data" (OuterVolumeSpecName: "istio-data") pod "8325ae6e-219e-4f4c-a3d1-5690de94040e" (UID: "8325ae6e-219e-4f4c-a3d1-5690de94040e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:50.645557 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.645366    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8325ae6e-219e-4f4c-a3d1-5690de94040e" (UID: "8325ae6e-219e-4f4c-a3d1-5690de94040e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:50.645557 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.645406    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8325ae6e-219e-4f4c-a3d1-5690de94040e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8325ae6e-219e-4f4c-a3d1-5690de94040e" (UID: "8325ae6e-219e-4f4c-a3d1-5690de94040e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:58:50.645557 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.645487    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8325ae6e-219e-4f4c-a3d1-5690de94040e" (UID: "8325ae6e-219e-4f4c-a3d1-5690de94040e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:50.647113 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.647088    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-token" (OuterVolumeSpecName: "istio-token") pod "8325ae6e-219e-4f4c-a3d1-5690de94040e" (UID: "8325ae6e-219e-4f4c-a3d1-5690de94040e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:58:50.647408 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.647387    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8325ae6e-219e-4f4c-a3d1-5690de94040e" (UID: "8325ae6e-219e-4f4c-a3d1-5690de94040e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:58:50.647707 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.647676    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-kube-api-access-4kwzl" (OuterVolumeSpecName: "kube-api-access-4kwzl") pod "8325ae6e-219e-4f4c-a3d1-5690de94040e" (UID: "8325ae6e-219e-4f4c-a3d1-5690de94040e"). InnerVolumeSpecName "kube-api-access-4kwzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:58:50.648086 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.648065    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8325ae6e-219e-4f4c-a3d1-5690de94040e" (UID: "8325ae6e-219e-4f4c-a3d1-5690de94040e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:58:50.745553 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.745523    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:50.745553 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.745551    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:50.745553 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.745560    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:50.745962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.745569    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:50.745962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.745577    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:50.745962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.745585    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kwzl\" (UniqueName: \"kubernetes.io/projected/8325ae6e-219e-4f4c-a3d1-5690de94040e-kube-api-access-4kwzl\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:50.745962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.745593    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:50.745962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.745600    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8325ae6e-219e-4f4c-a3d1-5690de94040e-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:50.745962 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.745608    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8325ae6e-219e-4f4c-a3d1-5690de94040e-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:58:50.751607 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.751584    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"]
Jul 13 21:58:50.752852 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:58:50.752826    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa989952_d3d5_4f86_910a_9c523aefc511.slice/crio-4386c771c518747aa3f9a38cbbef3f8512242f3eda9534fa6c8ffabdf0a673d9 WatchSource:0}: Error finding container 4386c771c518747aa3f9a38cbbef3f8512242f3eda9534fa6c8ffabdf0a673d9: Status 404 returned error can't find the container with id 4386c771c518747aa3f9a38cbbef3f8512242f3eda9534fa6c8ffabdf0a673d9
Jul 13 21:58:50.754470 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:50.754451    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:58:51.593190 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:51.593162    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"
Jul 13 21:58:51.593396 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:51.593186    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq" event={"ID":"8325ae6e-219e-4f4c-a3d1-5690de94040e","Type":"ContainerDied","Data":"db0ca39818c2dd08a328a3ffd889138a707ba9ccb1ded28571112753fd0babdc"}
Jul 13 21:58:51.593396 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:51.593249    2575 scope.go:117] "RemoveContainer" containerID="ffeee1129faba27e75d4a20253a1063d6ab0067d921435d9beba2a1d6d583a5f"
Jul 13 21:58:51.594906 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:51.594881    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c" event={"ID":"fa989952-d3d5-4f86-910a-9c523aefc511","Type":"ContainerStarted","Data":"26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9"}
Jul 13 21:58:51.595039 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:51.594933    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c" event={"ID":"fa989952-d3d5-4f86-910a-9c523aefc511","Type":"ContainerStarted","Data":"4386c771c518747aa3f9a38cbbef3f8512242f3eda9534fa6c8ffabdf0a673d9"}
Jul 13 21:58:51.595039 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:51.594968    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:51.617687 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:51.617648    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c" podStartSLOduration=2.135566915 podStartE2EDuration="2.617635807s" totalImagesPullingTime="482.068892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:58:51.615687236 +0000 UTC m=+2236.704967408" watchObservedRunningTime="2026-07-13 21:58:51.617635807 +0000 UTC m=+2236.706915959"
Jul 13 21:58:51.629554 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:51.629532    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"]
Jul 13 21:58:51.635214 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:51.635194    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-04c954-openshift-default-fbb545545-bnrnq"]
Jul 13 21:58:53.469452 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:53.469421    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" path="/var/lib/kubelet/pods/8325ae6e-219e-4f4c-a3d1-5690de94040e/volumes"
Jul 13 21:58:54.686420 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.686388    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"]
Jul 13 21:58:54.686970 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.686955    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy"
Jul 13 21:58:54.687022 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.686973    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy"
Jul 13 21:58:54.687022 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.687004    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy"
Jul 13 21:58:54.687022 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.687012    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy"
Jul 13 21:58:54.687127 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.687114    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy"
Jul 13 21:58:54.691736 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.691714    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.697831 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.697810    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f5029e-openshift-default-dockercfg-hrx8w\""
Jul 13 21:58:54.714057 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.714030    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"]
Jul 13 21:58:54.783285 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.783255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-token\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.783501 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.783296    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-podinfo\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.783501 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.783333    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istiod-ca-cert\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.783501 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.783403    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-certs\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.783501 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.783435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc7gq\" (UniqueName: \"kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-kube-api-access-qc7gq\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.783501 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.783464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-socket\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.783700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.783517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-envoy\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.783700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.783544    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-data\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.783700 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.783564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-credential-socket\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884160 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-podinfo\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884380 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884177    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istiod-ca-cert\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884380 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884203    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-certs\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884380 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884230    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc7gq\" (UniqueName: \"kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-kube-api-access-qc7gq\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884380 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-socket\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884380 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-envoy\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884651 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-data\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884651 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884406    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-credential-socket\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884651 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884470    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-token\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884800 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884771    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-data\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884800 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884792    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-certs\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884921 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884904    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-socket\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884989 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884957    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-credential-socket\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.884989 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.884976    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istiod-ca-cert\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.886678 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.886653    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-envoy\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.886793 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.886658    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-podinfo\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.894368 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.894321    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-token\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:54.894482 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:54.894456    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc7gq\" (UniqueName: \"kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-kube-api-access-qc7gq\") pod \"e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") " pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:55.002565 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:55.002476    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:55.137853 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:55.137823    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"]
Jul 13 21:58:55.139608 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:58:55.139578    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15cdd0e0_ce2b_45e0_b5d6_9bed43524713.slice/crio-65b4ea343226c796b9f928bb2be10daf4440de1b570fbda30c3931cd3323722c WatchSource:0}: Error finding container 65b4ea343226c796b9f928bb2be10daf4440de1b570fbda30c3931cd3323722c: Status 404 returned error can't find the container with id 65b4ea343226c796b9f928bb2be10daf4440de1b570fbda30c3931cd3323722c
Jul 13 21:58:55.141978 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:55.141938    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:58:55.142052 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:55.142031    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:58:55.142092 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:55.142081    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:58:55.618106 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:55.618074    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" event={"ID":"15cdd0e0-ce2b-45e0-b5d6-9bed43524713","Type":"ContainerStarted","Data":"bc39c8e0cb012949198ea4c00ec63bdb7b3de05fb041bcc212700037fbc823c0"}
Jul 13 21:58:55.618294 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:55.618128    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" event={"ID":"15cdd0e0-ce2b-45e0-b5d6-9bed43524713","Type":"ContainerStarted","Data":"65b4ea343226c796b9f928bb2be10daf4440de1b570fbda30c3931cd3323722c"}
Jul 13 21:58:55.646884 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:55.646830    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" podStartSLOduration=1.646814912 podStartE2EDuration="1.646814912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:58:55.644963394 +0000 UTC m=+2240.734243547" watchObservedRunningTime="2026-07-13 21:58:55.646814912 +0000 UTC m=+2240.736095065"
Jul 13 21:58:56.002931 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:56.002832    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:56.007720 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:56.007695    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:56.623015 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:56.622981    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:56.624020 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:56.623997    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:58:57.606302 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:57.606223    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:58:57.880639 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:57.880556    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"]
Jul 13 21:58:57.881002 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:57.880989    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8325ae6e-219e-4f4c-a3d1-5690de94040e" containerName="istio-proxy"
Jul 13 21:58:57.884165 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:57.884144    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:57.886768 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:57.886748    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f5029e-serving-cert\""
Jul 13 21:58:57.897283 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:57.897261    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"]
Jul 13 21:58:57.912451 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:57.912429    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-openshift-service-ca\") pod \"maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:57.912544 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:57.912468    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t28gg\" (UniqueName: \"kubernetes.io/projected/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-kube-api-access-t28gg\") pod \"maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:57.912544 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:57.912509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-maas-api-tls\") pod \"maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:58.013843 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:58.013799    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-maas-api-tls\") pod \"maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:58.014051 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:58.013915    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-openshift-service-ca\") pod \"maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:58.014051 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:58:58.013941    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-serving-cert: secret "maas-api-e2e-api-b-f5029e-serving-cert" not found
Jul 13 21:58:58.014051 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:58.013955    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t28gg\" (UniqueName: \"kubernetes.io/projected/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-kube-api-access-t28gg\") pod \"maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:58.014051 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:58:58.014012    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-maas-api-tls podName:2a7621c7-7e06-4b3f-922e-baf0afef8aa7 nodeName:}" failed. No retries permitted until 2026-07-13 21:58:58.513994721 +0000 UTC m=+2243.603274855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-maas-api-tls") pod "maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247" (UID: "2a7621c7-7e06-4b3f-922e-baf0afef8aa7") : secret "maas-api-e2e-api-b-f5029e-serving-cert" not found
Jul 13 21:58:58.014598 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:58.014579    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-openshift-service-ca\") pod \"maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:58.022651 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:58.022626    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t28gg\" (UniqueName: \"kubernetes.io/projected/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-kube-api-access-t28gg\") pod \"maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:58.518993 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:58.518956    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-maas-api-tls\") pod \"maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:58.521386 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:58.521354    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-maas-api-tls\") pod \"maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:58.797219 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:58.797125    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:58:59.183220 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:59.183193    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"]
Jul 13 21:58:59.184799 ip-10-0-143-189 kubenswrapper[2575]: W0713 21:58:59.184768    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7621c7_7e06_4b3f_922e_baf0afef8aa7.slice/crio-d3eaf1c4ba07d210fc419a7efc2b7ad0abd76f11f0f5ccb8b24e97b1220f3a51 WatchSource:0}: Error finding container d3eaf1c4ba07d210fc419a7efc2b7ad0abd76f11f0f5ccb8b24e97b1220f3a51: Status 404 returned error can't find the container with id d3eaf1c4ba07d210fc419a7efc2b7ad0abd76f11f0f5ccb8b24e97b1220f3a51
Jul 13 21:58:59.656585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:58:59.656542    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247" event={"ID":"2a7621c7-7e06-4b3f-922e-baf0afef8aa7","Type":"ContainerStarted","Data":"d3eaf1c4ba07d210fc419a7efc2b7ad0abd76f11f0f5ccb8b24e97b1220f3a51"}
Jul 13 21:59:00.663376 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:00.663273    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247" event={"ID":"2a7621c7-7e06-4b3f-922e-baf0afef8aa7","Type":"ContainerStarted","Data":"4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9"}
Jul 13 21:59:00.663735 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:00.663413    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:59:00.683472 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:00.683422    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247" podStartSLOduration=3.288504705 podStartE2EDuration="3.68340468s" totalImagesPullingTime="394.899975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:59:00.682607452 +0000 UTC m=+2245.771887624" watchObservedRunningTime="2026-07-13 21:59:00.68340468 +0000 UTC m=+2245.772684834"
Jul 13 21:59:03.575000 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:03.574927    2575 patch_prober.go:28] interesting pod/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 13 21:59:03.575000 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:03.574983    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 13 21:59:03.681296 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:03.681261    2575 generic.go:356] "Generic (PLEG): container finished" podID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerID="2b6f83cc47d2ef1d34d48d425621845e08b8ae282e08d3b5b28ccc0b246d60bd" exitCode=0
Jul 13 21:59:03.681490 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:03.681332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" event={"ID":"dd77bd43-baea-4d64-936a-ddb7eb5c50c7","Type":"ContainerDied","Data":"2b6f83cc47d2ef1d34d48d425621845e08b8ae282e08d3b5b28ccc0b246d60bd"}
Jul 13 21:59:03.681773 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:03.681760    2575 scope.go:117] "RemoveContainer" containerID="2b6f83cc47d2ef1d34d48d425621845e08b8ae282e08d3b5b28ccc0b246d60bd"
Jul 13 21:59:03.682803 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:03.682773    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:59:03.682875 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:03.682840    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:59:03.682875 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:03.682870    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:59:04.692246 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:04.692205    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" event={"ID":"dd77bd43-baea-4d64-936a-ddb7eb5c50c7","Type":"ContainerStarted","Data":"874a2d69490a3e1555a0a4607d9396367228a028df687e47ceb4a8a257a24e7b"}
Jul 13 21:59:05.499701 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:05.499668    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:59:05.499922 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:05.499727    2575 patch_prober.go:28] interesting pod/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 13 21:59:05.499922 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:05.499790    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 13 21:59:06.500458 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:06.500379    2575 patch_prober.go:28] interesting pod/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 13 21:59:06.500458 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:06.500438    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 13 21:59:06.675009 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:06.674982    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:59:07.500575 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:07.500534    2575 patch_prober.go:28] interesting pod/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 13 21:59:07.500970 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:07.500602    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 13 21:59:08.500221 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:08.500188    2575 patch_prober.go:28] interesting pod/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 13 21:59:08.500416 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:08.500241    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 13 21:59:09.504514 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:09.504485    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:59:09.504909 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:09.504830    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:59:09.505496 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:09.505475    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:59:09.722103 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:09.722007    2575 generic.go:356] "Generic (PLEG): container finished" podID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerID="bc39c8e0cb012949198ea4c00ec63bdb7b3de05fb041bcc212700037fbc823c0" exitCode=0
Jul 13 21:59:09.722103 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:09.722078    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" event={"ID":"15cdd0e0-ce2b-45e0-b5d6-9bed43524713","Type":"ContainerDied","Data":"bc39c8e0cb012949198ea4c00ec63bdb7b3de05fb041bcc212700037fbc823c0"}
Jul 13 21:59:09.722593 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:09.722576    2575 scope.go:117] "RemoveContainer" containerID="bc39c8e0cb012949198ea4c00ec63bdb7b3de05fb041bcc212700037fbc823c0"
Jul 13 21:59:09.723585 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:09.723560    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:59:09.723648 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:09.723621    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:59:09.723684 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:09.723651    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 21:59:10.731517 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:10.731471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" event={"ID":"15cdd0e0-ce2b-45e0-b5d6-9bed43524713","Type":"ContainerStarted","Data":"b4c9e2fecf12e8edcc1810519318adbd93db1e42b6575bd4b3d67c126cc83df7"}
Jul 13 21:59:11.003464 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:11.003371    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:59:11.004460 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:11.004437    2575 patch_prober.go:28] interesting pod/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 13 21:59:11.004534 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:11.004486    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 13 21:59:11.623114 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:11.623073    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:59:12.003488 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:12.003401    2575 patch_prober.go:28] interesting pod/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 13 21:59:12.003488 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:12.003457    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 13 21:59:13.003598 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:13.003554    2575 patch_prober.go:28] interesting pod/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 13 21:59:13.004079 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:13.003619    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 13 21:59:14.003300 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:14.003259    2575 patch_prober.go:28] interesting pod/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 13 21:59:14.003508 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:14.003361    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 13 21:59:15.007228 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:15.007198    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:59:15.008236 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:15.008213    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 21:59:20.919519 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:20.919486    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"]
Jul 13 21:59:20.919984 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:20.919728    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c" podUID="fa989952-d3d5-4f86-910a-9c523aefc511" containerName="maas-api" containerID="cri-o://26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9" gracePeriod=30
Jul 13 21:59:21.181308 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.181247    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:59:21.357731 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.357698    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa989952-d3d5-4f86-910a-9c523aefc511-maas-api-tls\") pod \"fa989952-d3d5-4f86-910a-9c523aefc511\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") "
Jul 13 21:59:21.357912 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.357841    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krwk5\" (UniqueName: \"kubernetes.io/projected/fa989952-d3d5-4f86-910a-9c523aefc511-kube-api-access-krwk5\") pod \"fa989952-d3d5-4f86-910a-9c523aefc511\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") "
Jul 13 21:59:21.357912 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.357865    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa989952-d3d5-4f86-910a-9c523aefc511-openshift-service-ca\") pod \"fa989952-d3d5-4f86-910a-9c523aefc511\" (UID: \"fa989952-d3d5-4f86-910a-9c523aefc511\") "
Jul 13 21:59:21.358270 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.358239    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa989952-d3d5-4f86-910a-9c523aefc511-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa989952-d3d5-4f86-910a-9c523aefc511" (UID: "fa989952-d3d5-4f86-910a-9c523aefc511"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:59:21.359792 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.359762    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa989952-d3d5-4f86-910a-9c523aefc511-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa989952-d3d5-4f86-910a-9c523aefc511" (UID: "fa989952-d3d5-4f86-910a-9c523aefc511"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:59:21.359866 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.359841    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa989952-d3d5-4f86-910a-9c523aefc511-kube-api-access-krwk5" (OuterVolumeSpecName: "kube-api-access-krwk5") pod "fa989952-d3d5-4f86-910a-9c523aefc511" (UID: "fa989952-d3d5-4f86-910a-9c523aefc511"). InnerVolumeSpecName "kube-api-access-krwk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:59:21.459649 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.459567    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa989952-d3d5-4f86-910a-9c523aefc511-maas-api-tls\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:21.459649 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.459597    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krwk5\" (UniqueName: \"kubernetes.io/projected/fa989952-d3d5-4f86-910a-9c523aefc511-kube-api-access-krwk5\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:21.459649 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.459607    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa989952-d3d5-4f86-910a-9c523aefc511-openshift-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:21.798673 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.798592    2575 generic.go:356] "Generic (PLEG): container finished" podID="fa989952-d3d5-4f86-910a-9c523aefc511" containerID="26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9" exitCode=0
Jul 13 21:59:21.798673 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.798636    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"
Jul 13 21:59:21.798860 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.798677    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c" event={"ID":"fa989952-d3d5-4f86-910a-9c523aefc511","Type":"ContainerDied","Data":"26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9"}
Jul 13 21:59:21.798860 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.798732    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c" event={"ID":"fa989952-d3d5-4f86-910a-9c523aefc511","Type":"ContainerDied","Data":"4386c771c518747aa3f9a38cbbef3f8512242f3eda9534fa6c8ffabdf0a673d9"}
Jul 13 21:59:21.798860 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.798760    2575 scope.go:117] "RemoveContainer" containerID="26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9"
Jul 13 21:59:21.807539 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.807522    2575 scope.go:117] "RemoveContainer" containerID="26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9"
Jul 13 21:59:21.807782 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:59:21.807764    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9\": container with ID starting with 26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9 not found: ID does not exist" containerID="26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9"
Jul 13 21:59:21.807840 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.807790    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9"} err="failed to get container status \"26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9\": rpc error: code = NotFound desc = could not find container \"26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9\": container with ID starting with 26c6e52c3a0518ef0b446589129b8fd1357c1feefa60f7c73c6e1bbe33dda2b9 not found: ID does not exist"
Jul 13 21:59:21.816268 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.816249    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"]
Jul 13 21:59:21.820903 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:21.820882    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09f5ac-6b568cdfc6-h4s5c"]
Jul 13 21:59:23.469305 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:23.469269    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa989952-d3d5-4f86-910a-9c523aefc511" path="/var/lib/kubelet/pods/fa989952-d3d5-4f86-910a-9c523aefc511/volumes"
Jul 13 21:59:35.723208 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:35.723177    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"]
Jul 13 21:59:35.723561 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:35.723412    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy" containerID="cri-o://874a2d69490a3e1555a0a4607d9396367228a028df687e47ceb4a8a257a24e7b" gracePeriod=30
Jul 13 21:59:39.507096 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:39.507054    2575 patch_prober.go:28] interesting pod/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 21:59:39.507597 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:39.507109    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:59:40.897078 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:40.897043    2575 generic.go:356] "Generic (PLEG): container finished" podID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerID="874a2d69490a3e1555a0a4607d9396367228a028df687e47ceb4a8a257a24e7b" exitCode=0
Jul 13 21:59:40.897497 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:40.897114    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" event={"ID":"dd77bd43-baea-4d64-936a-ddb7eb5c50c7","Type":"ContainerDied","Data":"874a2d69490a3e1555a0a4607d9396367228a028df687e47ceb4a8a257a24e7b"}
Jul 13 21:59:40.897497 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:40.897208    2575 scope.go:117] "RemoveContainer" containerID="2b6f83cc47d2ef1d34d48d425621845e08b8ae282e08d3b5b28ccc0b246d60bd"
Jul 13 21:59:40.994403 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:40.994326    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:59:41.038641 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.038607    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8v4f\" (UniqueName: \"kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-kube-api-access-r8v4f\") pod \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") "
Jul 13 21:59:41.038839 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.038662    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istiod-ca-cert\") pod \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") "
Jul 13 21:59:41.038839 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.038719    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-credential-socket\") pod \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") "
Jul 13 21:59:41.038839 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.038751    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-token\") pod \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") "
Jul 13 21:59:41.038839 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.038799    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-envoy\") pod \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") "
Jul 13 21:59:41.038839 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.038827    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-certs\") pod \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") "
Jul 13 21:59:41.039100 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.038863    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-podinfo\") pod \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") "
Jul 13 21:59:41.039100 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.038908    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-socket\") pod \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") "
Jul 13 21:59:41.039100 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.038946    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-data\") pod \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\" (UID: \"dd77bd43-baea-4d64-936a-ddb7eb5c50c7\") "
Jul 13 21:59:41.039100 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.039015    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd77bd43-baea-4d64-936a-ddb7eb5c50c7" (UID: "dd77bd43-baea-4d64-936a-ddb7eb5c50c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:59:41.039306 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.039135    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd77bd43-baea-4d64-936a-ddb7eb5c50c7" (UID: "dd77bd43-baea-4d64-936a-ddb7eb5c50c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:59:41.039404 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.039359    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:41.039404 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.039382    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:41.039506 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.039404    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd77bd43-baea-4d64-936a-ddb7eb5c50c7" (UID: "dd77bd43-baea-4d64-936a-ddb7eb5c50c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:59:41.039506 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.039458    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd77bd43-baea-4d64-936a-ddb7eb5c50c7" (UID: "dd77bd43-baea-4d64-936a-ddb7eb5c50c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:59:41.039949 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.039921    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd77bd43-baea-4d64-936a-ddb7eb5c50c7" (UID: "dd77bd43-baea-4d64-936a-ddb7eb5c50c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:59:41.041248 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.041221    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd77bd43-baea-4d64-936a-ddb7eb5c50c7" (UID: "dd77bd43-baea-4d64-936a-ddb7eb5c50c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:59:41.041437 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.041416    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd77bd43-baea-4d64-936a-ddb7eb5c50c7" (UID: "dd77bd43-baea-4d64-936a-ddb7eb5c50c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:59:41.041562 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.041545    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd77bd43-baea-4d64-936a-ddb7eb5c50c7" (UID: "dd77bd43-baea-4d64-936a-ddb7eb5c50c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 21:59:41.041728 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.041713    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-kube-api-access-r8v4f" (OuterVolumeSpecName: "kube-api-access-r8v4f") pod "dd77bd43-baea-4d64-936a-ddb7eb5c50c7" (UID: "dd77bd43-baea-4d64-936a-ddb7eb5c50c7"). InnerVolumeSpecName "kube-api-access-r8v4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:59:41.140396 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.140358    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8v4f\" (UniqueName: \"kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-kube-api-access-r8v4f\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:41.140396 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.140392    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:41.140396 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.140402    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:41.140396 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.140410    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:41.140664 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.140419    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:41.140664 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.140427    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:41.140664 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.140436    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd77bd43-baea-4d64-936a-ddb7eb5c50c7-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:41.903447 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.903417    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"
Jul 13 21:59:41.903868 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.903438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44" event={"ID":"dd77bd43-baea-4d64-936a-ddb7eb5c50c7","Type":"ContainerDied","Data":"e8229228921eea9adbcda61c346688340a94c0eb84379da34a29a8e4c7be4017"}
Jul 13 21:59:41.903868 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.903511    2575 scope.go:117] "RemoveContainer" containerID="874a2d69490a3e1555a0a4607d9396367228a028df687e47ceb4a8a257a24e7b"
Jul 13 21:59:41.920876 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.920849    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"]
Jul 13 21:59:41.924266 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:41.924243    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-09f5ac-openshift-default-7cb6677cf5-r7w44"]
Jul 13 21:59:43.469323 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:43.469287    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" path="/var/lib/kubelet/pods/dd77bd43-baea-4d64-936a-ddb7eb5c50c7/volumes"
Jul 13 21:59:46.527575 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.527536    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"]
Jul 13 21:59:46.528027 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.527994    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247" podUID="2a7621c7-7e06-4b3f-922e-baf0afef8aa7" containerName="maas-api" containerID="cri-o://4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9" gracePeriod=30
Jul 13 21:59:46.670445 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.670407    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247" podUID="2a7621c7-7e06-4b3f-922e-baf0afef8aa7" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.63:8443/health\": dial tcp 10.132.0.63:8443: connect: connection refused"
Jul 13 21:59:46.789217 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.789154    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:59:46.896271 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.896240    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-openshift-service-ca\") pod \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") "
Jul 13 21:59:46.896472 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.896285    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-maas-api-tls\") pod \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") "
Jul 13 21:59:46.896472 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.896309    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t28gg\" (UniqueName: \"kubernetes.io/projected/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-kube-api-access-t28gg\") pod \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\" (UID: \"2a7621c7-7e06-4b3f-922e-baf0afef8aa7\") "
Jul 13 21:59:46.896652 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.896630    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a7621c7-7e06-4b3f-922e-baf0afef8aa7" (UID: "2a7621c7-7e06-4b3f-922e-baf0afef8aa7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:59:46.898523 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.898496    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a7621c7-7e06-4b3f-922e-baf0afef8aa7" (UID: "2a7621c7-7e06-4b3f-922e-baf0afef8aa7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:59:46.898624 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.898570    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-kube-api-access-t28gg" (OuterVolumeSpecName: "kube-api-access-t28gg") pod "2a7621c7-7e06-4b3f-922e-baf0afef8aa7" (UID: "2a7621c7-7e06-4b3f-922e-baf0afef8aa7"). InnerVolumeSpecName "kube-api-access-t28gg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:59:46.930603 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.930566    2575 generic.go:356] "Generic (PLEG): container finished" podID="2a7621c7-7e06-4b3f-922e-baf0afef8aa7" containerID="4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9" exitCode=0
Jul 13 21:59:46.930746 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.930615    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"
Jul 13 21:59:46.930746 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.930656    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247" event={"ID":"2a7621c7-7e06-4b3f-922e-baf0afef8aa7","Type":"ContainerDied","Data":"4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9"}
Jul 13 21:59:46.930746 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.930714    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247" event={"ID":"2a7621c7-7e06-4b3f-922e-baf0afef8aa7","Type":"ContainerDied","Data":"d3eaf1c4ba07d210fc419a7efc2b7ad0abd76f11f0f5ccb8b24e97b1220f3a51"}
Jul 13 21:59:46.930746 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.930743    2575 scope.go:117] "RemoveContainer" containerID="4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9"
Jul 13 21:59:46.939785 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.939770    2575 scope.go:117] "RemoveContainer" containerID="4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9"
Jul 13 21:59:46.940071 ip-10-0-143-189 kubenswrapper[2575]: E0713 21:59:46.940050    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9\": container with ID starting with 4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9 not found: ID does not exist" containerID="4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9"
Jul 13 21:59:46.940123 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.940080    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9"} err="failed to get container status \"4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9\": rpc error: code = NotFound desc = could not find container \"4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9\": container with ID starting with 4744081d1c1061b1788488ae35e237bda3ee9c5c3b60631a167d9dbc29fb5dd9 not found: ID does not exist"
Jul 13 21:59:46.952569 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.952541    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"]
Jul 13 21:59:46.956744 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.956725    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f5029e-7cd4b47c6-7m247"]
Jul 13 21:59:46.997269 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.997244    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-maas-api-tls\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:46.997269 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.997268    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t28gg\" (UniqueName: \"kubernetes.io/projected/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-kube-api-access-t28gg\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:46.997434 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:46.997279    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7621c7-7e06-4b3f-922e-baf0afef8aa7-openshift-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 21:59:47.468673 ip-10-0-143-189 kubenswrapper[2575]: I0713 21:59:47.468634    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a7621c7-7e06-4b3f-922e-baf0afef8aa7" path="/var/lib/kubelet/pods/2a7621c7-7e06-4b3f-922e-baf0afef8aa7/volumes"
Jul 13 22:00:01.810387 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:01.810350    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"]
Jul 13 22:00:01.810783 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:01.810615    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy" containerID="cri-o://b4c9e2fecf12e8edcc1810519318adbd93db1e42b6575bd4b3d67c126cc83df7" gracePeriod=30
Jul 13 22:00:02.658402 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.658366    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"]
Jul 13 22:00:02.658814 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.658799    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a7621c7-7e06-4b3f-922e-baf0afef8aa7" containerName="maas-api"
Jul 13 22:00:02.658814 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.658815    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a7621c7-7e06-4b3f-922e-baf0afef8aa7" containerName="maas-api"
Jul 13 22:00:02.658965 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.658830    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy"
Jul 13 22:00:02.658965 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.658839    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy"
Jul 13 22:00:02.658965 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.658881    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa989952-d3d5-4f86-910a-9c523aefc511" containerName="maas-api"
Jul 13 22:00:02.658965 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.658892    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa989952-d3d5-4f86-910a-9c523aefc511" containerName="maas-api"
Jul 13 22:00:02.659112 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.658999    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa989952-d3d5-4f86-910a-9c523aefc511" containerName="maas-api"
Jul 13 22:00:02.659112 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.659013    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy"
Jul 13 22:00:02.659112 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.659025    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a7621c7-7e06-4b3f-922e-baf0afef8aa7" containerName="maas-api"
Jul 13 22:00:02.663675 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.663653    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.667006 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.666977    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-44ef67-openshift-default-dockercfg-q98pk\""
Jul 13 22:00:02.674496 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.674466    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"]
Jul 13 22:00:02.843674 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.843630    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txt52\" (UniqueName: \"kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-kube-api-access-txt52\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.843674 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.843678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-data\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.844160 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.843715    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-certs\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.844160 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.843739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-socket\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.844160 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.843817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-token\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.844160 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.843846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-podinfo\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.844160 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.843872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istiod-ca-cert\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.844160 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.843951    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-credential-socket\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.844160 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.844006    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-envoy\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945075 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.944982    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-certs\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945075 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-socket\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945259 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-token\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945259 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945126    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-podinfo\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945259 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945183    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istiod-ca-cert\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945259 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945237    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-credential-socket\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945482 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945276    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-envoy\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945482 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txt52\" (UniqueName: \"kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-kube-api-access-txt52\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945482 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-data\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945627 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945489    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-certs\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945627 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945522    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-socket\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945742 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945664    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-data\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945795 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945761    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-credential-socket\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.945907 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.945886    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istiod-ca-cert\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.947766 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.947742    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-envoy\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.947976 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.947960    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-podinfo\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.953974 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.953945    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-token\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.954108 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.954057    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txt52\" (UniqueName: \"kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-kube-api-access-txt52\") pod \"e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") " pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:02.975307 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:02.975282    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:03.119169 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:03.119142    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"]
Jul 13 22:00:03.120834 ip-10-0-143-189 kubenswrapper[2575]: W0713 22:00:03.120802    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d446dd_e2d0_4804_a81b_4f0bf46cdf1c.slice/crio-58eba208fde99a4cef36a511c61ca3f01b5effc3431196f9c0217dcd2c97dcc2 WatchSource:0}: Error finding container 58eba208fde99a4cef36a511c61ca3f01b5effc3431196f9c0217dcd2c97dcc2: Status 404 returned error can't find the container with id 58eba208fde99a4cef36a511c61ca3f01b5effc3431196f9c0217dcd2c97dcc2
Jul 13 22:00:03.123137 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:03.123104    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:03.123207 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:03.123166    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:03.123207 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:03.123195    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:04.017603 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:04.017560    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" event={"ID":"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c","Type":"ContainerStarted","Data":"0fd1e64427981e924e446822c28f4faa6ef53c07034fdbab25f3d9c701108661"}
Jul 13 22:00:04.018009 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:04.017630    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" event={"ID":"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c","Type":"ContainerStarted","Data":"58eba208fde99a4cef36a511c61ca3f01b5effc3431196f9c0217dcd2c97dcc2"}
Jul 13 22:00:04.039079 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:04.039028    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" podStartSLOduration=2.039013247 podStartE2EDuration="2.039013247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:00:04.037590954 +0000 UTC m=+2309.126871131" watchObservedRunningTime="2026-07-13 22:00:04.039013247 +0000 UTC m=+2309.128293399"
Jul 13 22:00:04.975709 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:04.975669    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:04.980746 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:04.980717    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:05.022982 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:05.022953    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:05.023881 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:05.023864    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:06.000310 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.000282    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"]
Jul 13 22:00:06.000838 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.000813    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy"
Jul 13 22:00:06.000838 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.000836    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy"
Jul 13 22:00:06.001044 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.000925    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd77bd43-baea-4d64-936a-ddb7eb5c50c7" containerName="istio-proxy"
Jul 13 22:00:06.004433 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.004409    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.007563 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.007541    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nq9m7\""
Jul 13 22:00:06.007898 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.007875    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-44ef67-serving-cert\""
Jul 13 22:00:06.008029 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.007935    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 22:00:06.008700 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.008680    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 22:00:06.015267 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.015233    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"]
Jul 13 22:00:06.074327 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.074294    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b88f51fc-bce3-413a-b611-7887a26e275a-maas-api-tls\") pod \"maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.074717 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.074466    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbqmz\" (UniqueName: \"kubernetes.io/projected/b88f51fc-bce3-413a-b611-7887a26e275a-kube-api-access-dbqmz\") pod \"maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.074717 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.074515    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b88f51fc-bce3-413a-b611-7887a26e275a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.175632 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.175594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b88f51fc-bce3-413a-b611-7887a26e275a-maas-api-tls\") pod \"maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.175799 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.175685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbqmz\" (UniqueName: \"kubernetes.io/projected/b88f51fc-bce3-413a-b611-7887a26e275a-kube-api-access-dbqmz\") pod \"maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.175799 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.175728    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b88f51fc-bce3-413a-b611-7887a26e275a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.175799 ip-10-0-143-189 kubenswrapper[2575]: E0713 22:00:06.175733    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-serving-cert: secret "maas-api-e2e-shared-a-44ef67-serving-cert" not found
Jul 13 22:00:06.175957 ip-10-0-143-189 kubenswrapper[2575]: E0713 22:00:06.175808    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88f51fc-bce3-413a-b611-7887a26e275a-maas-api-tls podName:b88f51fc-bce3-413a-b611-7887a26e275a nodeName:}" failed. No retries permitted until 2026-07-13 22:00:06.675783557 +0000 UTC m=+2311.765063688 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b88f51fc-bce3-413a-b611-7887a26e275a-maas-api-tls") pod "maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd" (UID: "b88f51fc-bce3-413a-b611-7887a26e275a") : secret "maas-api-e2e-shared-a-44ef67-serving-cert" not found
Jul 13 22:00:06.176537 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.176514    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b88f51fc-bce3-413a-b611-7887a26e275a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.199985 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.199958    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbqmz\" (UniqueName: \"kubernetes.io/projected/b88f51fc-bce3-413a-b611-7887a26e275a-kube-api-access-dbqmz\") pod \"maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.679494 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.679455    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b88f51fc-bce3-413a-b611-7887a26e275a-maas-api-tls\") pod \"maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.682016 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.681986    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b88f51fc-bce3-413a-b611-7887a26e275a-maas-api-tls\") pod \"maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:06.919627 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:06.919584    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:07.037534 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.037399    2575 generic.go:356] "Generic (PLEG): container finished" podID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerID="b4c9e2fecf12e8edcc1810519318adbd93db1e42b6575bd4b3d67c126cc83df7" exitCode=0
Jul 13 22:00:07.037534 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.037477    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" event={"ID":"15cdd0e0-ce2b-45e0-b5d6-9bed43524713","Type":"ContainerDied","Data":"b4c9e2fecf12e8edcc1810519318adbd93db1e42b6575bd4b3d67c126cc83df7"}
Jul 13 22:00:07.037796 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.037570    2575 scope.go:117] "RemoveContainer" containerID="bc39c8e0cb012949198ea4c00ec63bdb7b3de05fb041bcc212700037fbc823c0"
Jul 13 22:00:07.075611 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.075526    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 22:00:07.078146 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.078122    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"]
Jul 13 22:00:07.080096 ip-10-0-143-189 kubenswrapper[2575]: W0713 22:00:07.080072    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88f51fc_bce3_413a_b611_7887a26e275a.slice/crio-4a46f26e67ff507669a4e6135e6e7bf251c58a932c4754e19cb70efa2cde9935 WatchSource:0}: Error finding container 4a46f26e67ff507669a4e6135e6e7bf251c58a932c4754e19cb70efa2cde9935: Status 404 returned error can't find the container with id 4a46f26e67ff507669a4e6135e6e7bf251c58a932c4754e19cb70efa2cde9935
Jul 13 22:00:07.083238 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.083217    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istiod-ca-cert\") pod \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") "
Jul 13 22:00:07.083631 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.083605    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15cdd0e0-ce2b-45e0-b5d6-9bed43524713" (UID: "15cdd0e0-ce2b-45e0-b5d6-9bed43524713"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 22:00:07.184187 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184098    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-envoy\") pod \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") "
Jul 13 22:00:07.184187 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184136    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-token\") pod \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") "
Jul 13 22:00:07.184187 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184155    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc7gq\" (UniqueName: \"kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-kube-api-access-qc7gq\") pod \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") "
Jul 13 22:00:07.184187 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184171    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-credential-socket\") pod \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") "
Jul 13 22:00:07.184580 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184301    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-certs\") pod \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") "
Jul 13 22:00:07.184580 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184406    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-data\") pod \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") "
Jul 13 22:00:07.184580 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184440    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-podinfo\") pod \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") "
Jul 13 22:00:07.184580 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184477    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15cdd0e0-ce2b-45e0-b5d6-9bed43524713" (UID: "15cdd0e0-ce2b-45e0-b5d6-9bed43524713"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:00:07.184580 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184541    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-socket\") pod \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\" (UID: \"15cdd0e0-ce2b-45e0-b5d6-9bed43524713\") "
Jul 13 22:00:07.184850 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184644    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15cdd0e0-ce2b-45e0-b5d6-9bed43524713" (UID: "15cdd0e0-ce2b-45e0-b5d6-9bed43524713"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:00:07.184910 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184844    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15cdd0e0-ce2b-45e0-b5d6-9bed43524713" (UID: "15cdd0e0-ce2b-45e0-b5d6-9bed43524713"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:00:07.185000 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184931    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:00:07.185000 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184948    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:00:07.185000 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184963    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:00:07.185000 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.184977    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:00:07.185381 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.185315    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-data" (OuterVolumeSpecName: "istio-data") pod "15cdd0e0-ce2b-45e0-b5d6-9bed43524713" (UID: "15cdd0e0-ce2b-45e0-b5d6-9bed43524713"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:00:07.186469 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.186441    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15cdd0e0-ce2b-45e0-b5d6-9bed43524713" (UID: "15cdd0e0-ce2b-45e0-b5d6-9bed43524713"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:00:07.186552 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.186464    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-token" (OuterVolumeSpecName: "istio-token") pod "15cdd0e0-ce2b-45e0-b5d6-9bed43524713" (UID: "15cdd0e0-ce2b-45e0-b5d6-9bed43524713"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:00:07.186552 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.186481    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15cdd0e0-ce2b-45e0-b5d6-9bed43524713" (UID: "15cdd0e0-ce2b-45e0-b5d6-9bed43524713"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 22:00:07.186632 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.186589    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-kube-api-access-qc7gq" (OuterVolumeSpecName: "kube-api-access-qc7gq") pod "15cdd0e0-ce2b-45e0-b5d6-9bed43524713" (UID: "15cdd0e0-ce2b-45e0-b5d6-9bed43524713"). InnerVolumeSpecName "kube-api-access-qc7gq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:00:07.285789 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.285754    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:00:07.285789 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.285785    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:00:07.285789 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.285794    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc7gq\" (UniqueName: \"kubernetes.io/projected/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-kube-api-access-qc7gq\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:00:07.286037 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.285811    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:00:07.286037 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:07.285820    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15cdd0e0-ce2b-45e0-b5d6-9bed43524713-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:00:08.044175 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:08.044139    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd" event={"ID":"b88f51fc-bce3-413a-b611-7887a26e275a","Type":"ContainerStarted","Data":"6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5"}
Jul 13 22:00:08.044420 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:08.044195    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd" event={"ID":"b88f51fc-bce3-413a-b611-7887a26e275a","Type":"ContainerStarted","Data":"4a46f26e67ff507669a4e6135e6e7bf251c58a932c4754e19cb70efa2cde9935"}
Jul 13 22:00:08.044420 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:08.044249    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:08.045819 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:08.045774    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn" event={"ID":"15cdd0e0-ce2b-45e0-b5d6-9bed43524713","Type":"ContainerDied","Data":"65b4ea343226c796b9f928bb2be10daf4440de1b570fbda30c3931cd3323722c"}
Jul 13 22:00:08.045819 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:08.045790    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"
Jul 13 22:00:08.046177 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:08.045850    2575 scope.go:117] "RemoveContainer" containerID="b4c9e2fecf12e8edcc1810519318adbd93db1e42b6575bd4b3d67c126cc83df7"
Jul 13 22:00:08.062583 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:08.062534    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd" podStartSLOduration=2.657500117 podStartE2EDuration="3.062520237s" totalImagesPullingTime="405.02012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:00:08.059726503 +0000 UTC m=+2313.149006656" watchObservedRunningTime="2026-07-13 22:00:08.062520237 +0000 UTC m=+2313.151800390"
Jul 13 22:00:08.074383 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:08.074351    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"]
Jul 13 22:00:08.084104 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:08.084065    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f5029e-openshift-default-7b46c668f9-9lhtn"]
Jul 13 22:00:09.469564 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:09.469534    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" path="/var/lib/kubelet/pods/15cdd0e0-ce2b-45e0-b5d6-9bed43524713/volumes"
Jul 13 22:00:10.998241 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:10.998208    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"]
Jul 13 22:00:10.998769 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:10.998685    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy"
Jul 13 22:00:10.998769 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:10.998701    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy"
Jul 13 22:00:10.998769 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:10.998712    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy"
Jul 13 22:00:10.998769 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:10.998718    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy"
Jul 13 22:00:10.998905 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:10.998778    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy"
Jul 13 22:00:11.002319 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.002302    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.005112 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.005088    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f0e328-openshift-default-dockercfg-pct7s\""
Jul 13 22:00:11.012787 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.012763    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"]
Jul 13 22:00:11.020996 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.020972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-certs\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.021105 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.021009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-token\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.021105 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.021041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-envoy\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.021105 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.021088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-podinfo\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.021229 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.021160    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-credential-socket\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.021229 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.021215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istiod-ca-cert\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.021359 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.021324    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-socket\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.021423 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.021386    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-data\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.021472 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.021432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtp4\" (UniqueName: \"kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-kube-api-access-tbtp4\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.121896 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.121863    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-socket\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.121896 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.121901    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-data\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122135 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.121935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtp4\" (UniqueName: \"kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-kube-api-access-tbtp4\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122135 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.121973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-certs\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122135 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.122016    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-token\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122135 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.122044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-envoy\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122135 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.122067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-podinfo\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122135 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.122107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-credential-socket\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122476 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.122161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istiod-ca-cert\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122476 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.122273    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-socket\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122476 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.122316    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-data\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122629 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.122588    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-credential-socket\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122666 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.122647    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-certs\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.122972 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.122949    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istiod-ca-cert\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.124355 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.124323    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-envoy\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.124906 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.124887    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-podinfo\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.130642 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.130614    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtp4\" (UniqueName: \"kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-kube-api-access-tbtp4\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.130736 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.130718    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-token\") pod \"e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") " pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.313783 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.313749    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:11.459575 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.459549    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"]
Jul 13 22:00:11.461492 ip-10-0-143-189 kubenswrapper[2575]: W0713 22:00:11.461468    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91116d2a_e9e1_4273_8ac2_3a0355c61efd.slice/crio-1271cd3f14e007d720adf4c3e1df298d7a29fda77078fe27f1797347b928e621 WatchSource:0}: Error finding container 1271cd3f14e007d720adf4c3e1df298d7a29fda77078fe27f1797347b928e621: Status 404 returned error can't find the container with id 1271cd3f14e007d720adf4c3e1df298d7a29fda77078fe27f1797347b928e621
Jul 13 22:00:11.463768 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.463727    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:11.463869 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.463795    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:11.463869 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:11.463823    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:12.068961 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:12.068923    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" event={"ID":"91116d2a-e9e1-4273-8ac2-3a0355c61efd","Type":"ContainerStarted","Data":"d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07"}
Jul 13 22:00:12.069394 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:12.068987    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" event={"ID":"91116d2a-e9e1-4273-8ac2-3a0355c61efd","Type":"ContainerStarted","Data":"1271cd3f14e007d720adf4c3e1df298d7a29fda77078fe27f1797347b928e621"}
Jul 13 22:00:12.090024 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:12.089968    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" podStartSLOduration=2.08995064 podStartE2EDuration="2.08995064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:00:12.088442095 +0000 UTC m=+2317.177722266" watchObservedRunningTime="2026-07-13 22:00:12.08995064 +0000 UTC m=+2317.179230793"
Jul 13 22:00:12.313933 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:12.313891    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:12.319596 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:12.319518    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:13.074703 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:13.074666    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:13.075800 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:13.075779    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:14.057693 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.057663    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:00:14.078234 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.078202    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"]
Jul 13 22:00:14.078946 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.078925    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="15cdd0e0-ce2b-45e0-b5d6-9bed43524713" containerName="istio-proxy"
Jul 13 22:00:14.082817 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.082795    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.085241 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.085217    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f0e328-serving-cert\""
Jul 13 22:00:14.094680 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.094634    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"]
Jul 13 22:00:14.159407 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.159040    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv8c6\" (UniqueName: \"kubernetes.io/projected/ec3793b3-76bc-441d-b7f4-58b504758d8c-kube-api-access-dv8c6\") pod \"maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.159407 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.159206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3793b3-76bc-441d-b7f4-58b504758d8c-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.159407 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.159253    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3793b3-76bc-441d-b7f4-58b504758d8c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.260125 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.260081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv8c6\" (UniqueName: \"kubernetes.io/projected/ec3793b3-76bc-441d-b7f4-58b504758d8c-kube-api-access-dv8c6\") pod \"maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.260319 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.260163    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3793b3-76bc-441d-b7f4-58b504758d8c-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.260319 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.260188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3793b3-76bc-441d-b7f4-58b504758d8c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.260428 ip-10-0-143-189 kubenswrapper[2575]: E0713 22:00:14.260356    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-serving-cert: secret "maas-api-e2e-shared-b-f0e328-serving-cert" not found
Jul 13 22:00:14.260471 ip-10-0-143-189 kubenswrapper[2575]: E0713 22:00:14.260456    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec3793b3-76bc-441d-b7f4-58b504758d8c-maas-api-tls podName:ec3793b3-76bc-441d-b7f4-58b504758d8c nodeName:}" failed. No retries permitted until 2026-07-13 22:00:14.760433239 +0000 UTC m=+2319.849713383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ec3793b3-76bc-441d-b7f4-58b504758d8c-maas-api-tls") pod "maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp" (UID: "ec3793b3-76bc-441d-b7f4-58b504758d8c") : secret "maas-api-e2e-shared-b-f0e328-serving-cert" not found
Jul 13 22:00:14.260810 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.260793    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3793b3-76bc-441d-b7f4-58b504758d8c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.280194 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.280158    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv8c6\" (UniqueName: \"kubernetes.io/projected/ec3793b3-76bc-441d-b7f4-58b504758d8c-kube-api-access-dv8c6\") pod \"maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.764761 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.764725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3793b3-76bc-441d-b7f4-58b504758d8c-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.767224 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.767199    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3793b3-76bc-441d-b7f4-58b504758d8c-maas-api-tls\") pod \"maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:14.996642 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:14.996607    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:15.182208 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:15.182184    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"]
Jul 13 22:00:15.184002 ip-10-0-143-189 kubenswrapper[2575]: W0713 22:00:15.183976    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3793b3_76bc_441d_b7f4_58b504758d8c.slice/crio-413358887b043b9a0dd8f93e717a70c9963bf54e4fe68130b323c99d9aa6cadf WatchSource:0}: Error finding container 413358887b043b9a0dd8f93e717a70c9963bf54e4fe68130b323c99d9aa6cadf: Status 404 returned error can't find the container with id 413358887b043b9a0dd8f93e717a70c9963bf54e4fe68130b323c99d9aa6cadf
Jul 13 22:00:16.096256 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:16.096216    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp" event={"ID":"ec3793b3-76bc-441d-b7f4-58b504758d8c","Type":"ContainerStarted","Data":"4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded"}
Jul 13 22:00:16.096474 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:16.096275    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp" event={"ID":"ec3793b3-76bc-441d-b7f4-58b504758d8c","Type":"ContainerStarted","Data":"413358887b043b9a0dd8f93e717a70c9963bf54e4fe68130b323c99d9aa6cadf"}
Jul 13 22:00:16.096474 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:16.096296    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:16.115073 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:16.115024    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp" podStartSLOduration=1.634484679 podStartE2EDuration="2.115006461s" totalImagesPullingTime="480.521782ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 22:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:00:16.114233357 +0000 UTC m=+2321.203513535" watchObservedRunningTime="2026-07-13 22:00:16.115006461 +0000 UTC m=+2321.204286615"
Jul 13 22:00:20.171395 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:20.170605    2575 patch_prober.go:28] interesting pod/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": read tcp 10.132.0.2:45210->10.132.0.64:15021: read: connection reset by peer" start-of-body=
Jul 13 22:00:20.171395 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:20.170671    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": read tcp 10.132.0.2:45210->10.132.0.64:15021: read: connection reset by peer"
Jul 13 22:00:21.125175 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:21.125143    2575 generic.go:356] "Generic (PLEG): container finished" podID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerID="0fd1e64427981e924e446822c28f4faa6ef53c07034fdbab25f3d9c701108661" exitCode=0
Jul 13 22:00:21.125467 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:21.125201    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" event={"ID":"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c","Type":"ContainerDied","Data":"0fd1e64427981e924e446822c28f4faa6ef53c07034fdbab25f3d9c701108661"}
Jul 13 22:00:21.125674 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:21.125645    2575 scope.go:117] "RemoveContainer" containerID="0fd1e64427981e924e446822c28f4faa6ef53c07034fdbab25f3d9c701108661"
Jul 13 22:00:21.126682 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:21.126648    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:21.126769 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:21.126736    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:21.126769 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:21.126766    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:22.108027 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:22.107999    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:00:22.133141 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:22.133057    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" event={"ID":"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c","Type":"ContainerStarted","Data":"9bdf8dd4c2cbb66007f077b6adf3e1e573053c66743624d5c639397df28d72f0"}
Jul 13 22:00:22.975696 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:22.975648    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:22.975948 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:22.975924    2575 patch_prober.go:28] interesting pod/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 13 22:00:22.976011 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:22.975977    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 13 22:00:23.976262 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:23.976222    2575 patch_prober.go:28] interesting pod/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 13 22:00:23.976769 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:23.976285    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 13 22:00:24.976149 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:24.976104    2575 patch_prober.go:28] interesting pod/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 13 22:00:24.976381 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:24.976166    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 13 22:00:25.975879 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:25.975842    2575 patch_prober.go:28] interesting pod/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Jul 13 22:00:25.976110 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:25.975897    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Jul 13 22:00:26.165794 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:26.165757    2575 generic.go:356] "Generic (PLEG): container finished" podID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerID="d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07" exitCode=0
Jul 13 22:00:26.166182 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:26.165834    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" event={"ID":"91116d2a-e9e1-4273-8ac2-3a0355c61efd","Type":"ContainerDied","Data":"d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07"}
Jul 13 22:00:26.166235 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:26.166221    2575 scope.go:117] "RemoveContainer" containerID="d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07"
Jul 13 22:00:26.167353 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:26.167313    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:26.167418 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:26.167398    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:26.167461 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:26.167431    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 13 22:00:26.980100 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:26.980071    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:26.980465 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:26.980448    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:26.981041 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:26.981021    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:00:27.173972 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:27.173939    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" event={"ID":"91116d2a-e9e1-4273-8ac2-3a0355c61efd","Type":"ContainerStarted","Data":"4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8"}
Jul 13 22:00:27.314354 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:27.314310    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:27.315131 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:27.315114    2575 patch_prober.go:28] interesting pod/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 13 22:00:27.315183 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:27.315164    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 13 22:00:28.074831 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:28.074801    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:28.314154 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:28.314106    2575 patch_prober.go:28] interesting pod/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 13 22:00:28.314562 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:28.314179    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 13 22:00:29.314485 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:29.314447    2575 patch_prober.go:28] interesting pod/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 13 22:00:29.314952 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:29.314502    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 13 22:00:30.314647 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:30.314613    2575 patch_prober.go:28] interesting pod/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 13 22:00:30.315038 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:30.314667    2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 13 22:00:31.317974 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:31.317946    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:00:31.318816 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:00:31.318795    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:01:35.544905 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:01:35.544869    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 22:01:35.548450 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:01:35.548429    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 22:01:35.555077 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:01:35.555058    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 22:01:35.558208 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:01:35.558191    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 22:06:10.532137 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.532096    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"]
Jul 13 22:06:10.532808 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.532376    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd" podUID="b88f51fc-bce3-413a-b611-7887a26e275a" containerName="maas-api" containerID="cri-o://6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5" gracePeriod=30
Jul 13 22:06:10.791826 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.791762    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:06:10.856134 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.856100    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b88f51fc-bce3-413a-b611-7887a26e275a-openshift-service-ca\") pod \"b88f51fc-bce3-413a-b611-7887a26e275a\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") "
Jul 13 22:06:10.856317 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.856175    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b88f51fc-bce3-413a-b611-7887a26e275a-maas-api-tls\") pod \"b88f51fc-bce3-413a-b611-7887a26e275a\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") "
Jul 13 22:06:10.856317 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.856233    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbqmz\" (UniqueName: \"kubernetes.io/projected/b88f51fc-bce3-413a-b611-7887a26e275a-kube-api-access-dbqmz\") pod \"b88f51fc-bce3-413a-b611-7887a26e275a\" (UID: \"b88f51fc-bce3-413a-b611-7887a26e275a\") "
Jul 13 22:06:10.856569 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.856541    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b88f51fc-bce3-413a-b611-7887a26e275a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b88f51fc-bce3-413a-b611-7887a26e275a" (UID: "b88f51fc-bce3-413a-b611-7887a26e275a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 22:06:10.858324 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.858297    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b88f51fc-bce3-413a-b611-7887a26e275a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b88f51fc-bce3-413a-b611-7887a26e275a" (UID: "b88f51fc-bce3-413a-b611-7887a26e275a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 22:06:10.858426 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.858299    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b88f51fc-bce3-413a-b611-7887a26e275a-kube-api-access-dbqmz" (OuterVolumeSpecName: "kube-api-access-dbqmz") pod "b88f51fc-bce3-413a-b611-7887a26e275a" (UID: "b88f51fc-bce3-413a-b611-7887a26e275a"). InnerVolumeSpecName "kube-api-access-dbqmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:06:10.949923 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.949886    2575 generic.go:356] "Generic (PLEG): container finished" podID="b88f51fc-bce3-413a-b611-7887a26e275a" containerID="6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5" exitCode=0
Jul 13 22:06:10.950115 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.949934    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd" event={"ID":"b88f51fc-bce3-413a-b611-7887a26e275a","Type":"ContainerDied","Data":"6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5"}
Jul 13 22:06:10.950115 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.949973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd" event={"ID":"b88f51fc-bce3-413a-b611-7887a26e275a","Type":"ContainerDied","Data":"4a46f26e67ff507669a4e6135e6e7bf251c58a932c4754e19cb70efa2cde9935"}
Jul 13 22:06:10.950115 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.949993    2575 scope.go:117] "RemoveContainer" containerID="6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5"
Jul 13 22:06:10.950115 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.949935    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"
Jul 13 22:06:10.957844 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.957816    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b88f51fc-bce3-413a-b611-7887a26e275a-openshift-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:10.957989 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.957846    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b88f51fc-bce3-413a-b611-7887a26e275a-maas-api-tls\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:10.957989 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.957861    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbqmz\" (UniqueName: \"kubernetes.io/projected/b88f51fc-bce3-413a-b611-7887a26e275a-kube-api-access-dbqmz\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:10.960047 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.960028    2575 scope.go:117] "RemoveContainer" containerID="6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5"
Jul 13 22:06:10.960324 ip-10-0-143-189 kubenswrapper[2575]: E0713 22:06:10.960302    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5\": container with ID starting with 6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5 not found: ID does not exist" containerID="6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5"
Jul 13 22:06:10.960390 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.960363    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5"} err="failed to get container status \"6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5\": rpc error: code = NotFound desc = could not find container \"6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5\": container with ID starting with 6c8c017cf36eb0f94716460b7225dd6560abb3e73d46abbf5001c267476043c5 not found: ID does not exist"
Jul 13 22:06:10.973297 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.973264    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"]
Jul 13 22:06:10.977161 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:10.977139    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-44ef67-7f7bcdb7f-gqmnd"]
Jul 13 22:06:11.469999 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:11.469964    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b88f51fc-bce3-413a-b611-7887a26e275a" path="/var/lib/kubelet/pods/b88f51fc-bce3-413a-b611-7887a26e275a/volumes"
Jul 13 22:06:25.888028 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:25.887989    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"]
Jul 13 22:06:25.888503 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:25.888273    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy" containerID="cri-o://9bdf8dd4c2cbb66007f077b6adf3e1e573053c66743624d5c639397df28d72f0" gracePeriod=30
Jul 13 22:06:26.982967 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:26.982923    2575 patch_prober.go:28] interesting pod/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 22:06:26.983404 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:26.982998    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 22:06:31.061244 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.060949    2575 generic.go:356] "Generic (PLEG): container finished" podID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerID="9bdf8dd4c2cbb66007f077b6adf3e1e573053c66743624d5c639397df28d72f0" exitCode=0
Jul 13 22:06:31.061244 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.061005    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" event={"ID":"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c","Type":"ContainerDied","Data":"9bdf8dd4c2cbb66007f077b6adf3e1e573053c66743624d5c639397df28d72f0"}
Jul 13 22:06:31.061244 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.061061    2575 scope.go:117] "RemoveContainer" containerID="0fd1e64427981e924e446822c28f4faa6ef53c07034fdbab25f3d9c701108661"
Jul 13 22:06:31.149878 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.149850    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:06:31.247210 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247124    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-envoy\") pod \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") "
Jul 13 22:06:31.247210 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247160    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txt52\" (UniqueName: \"kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-kube-api-access-txt52\") pod \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") "
Jul 13 22:06:31.247210 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247181    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-data\") pod \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") "
Jul 13 22:06:31.247585 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247221    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-socket\") pod \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") "
Jul 13 22:06:31.247585 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247281    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istiod-ca-cert\") pod \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") "
Jul 13 22:06:31.247585 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247354    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-credential-socket\") pod \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") "
Jul 13 22:06:31.247585 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247405    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-token\") pod \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") "
Jul 13 22:06:31.247585 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247428    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-certs\") pod \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") "
Jul 13 22:06:31.247585 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247478    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-podinfo\") pod \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\" (UID: \"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c\") "
Jul 13 22:06:31.247883 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247615    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" (UID: "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:06:31.247883 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247691    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" (UID: "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 22:06:31.247883 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247609    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" (UID: "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:06:31.248045 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247920    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" (UID: "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:06:31.248045 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.247995    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:31.248045 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.248021    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:31.248045 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.248037    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:31.248765 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.248731    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-data" (OuterVolumeSpecName: "istio-data") pod "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" (UID: "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:06:31.249613 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.249588    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-kube-api-access-txt52" (OuterVolumeSpecName: "kube-api-access-txt52") pod "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" (UID: "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c"). InnerVolumeSpecName "kube-api-access-txt52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:06:31.249727 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.249687    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-token" (OuterVolumeSpecName: "istio-token") pod "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" (UID: "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:06:31.249826 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.249809    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" (UID: "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:06:31.249919 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.249898    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" (UID: "06d446dd-e2d0-4804-a81b-4f0bf46cdf1c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 22:06:31.348744 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.348717    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:31.348744 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.348739    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:31.348744 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.348748    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:31.348958 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.348759    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:31.348958 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.348768    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txt52\" (UniqueName: \"kubernetes.io/projected/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-kube-api-access-txt52\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:31.348958 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:31.348776    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:32.068993 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:32.068960    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"
Jul 13 22:06:32.069416 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:32.068983    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs" event={"ID":"06d446dd-e2d0-4804-a81b-4f0bf46cdf1c","Type":"ContainerDied","Data":"58eba208fde99a4cef36a511c61ca3f01b5effc3431196f9c0217dcd2c97dcc2"}
Jul 13 22:06:32.069416 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:32.069075    2575 scope.go:117] "RemoveContainer" containerID="9bdf8dd4c2cbb66007f077b6adf3e1e573053c66743624d5c639397df28d72f0"
Jul 13 22:06:32.088420 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:32.088395    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"]
Jul 13 22:06:32.093327 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:32.093306    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-44ef67-openshift-default-7c574b94dc-zljxs"]
Jul 13 22:06:33.469395 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:33.469361    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" path="/var/lib/kubelet/pods/06d446dd-e2d0-4804-a81b-4f0bf46cdf1c/volumes"
Jul 13 22:06:35.574496 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:35.574467    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 22:06:35.577775 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:35.577755    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 22:06:35.586062 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:35.586044    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 22:06:35.589099 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:35.589084    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-67fcq_c3a03093-bfaf-40cd-b141-1bee13064cb6/ovn-acl-logging/0.log"
Jul 13 22:06:37.116350 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.116313    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"]
Jul 13 22:06:37.116732 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.116556    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp" podUID="ec3793b3-76bc-441d-b7f4-58b504758d8c" containerName="maas-api" containerID="cri-o://4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded" gracePeriod=30
Jul 13 22:06:37.375968 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.375912    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:06:37.403013 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.402987    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3793b3-76bc-441d-b7f4-58b504758d8c-openshift-service-ca\") pod \"ec3793b3-76bc-441d-b7f4-58b504758d8c\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") "
Jul 13 22:06:37.403145 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.403024    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv8c6\" (UniqueName: \"kubernetes.io/projected/ec3793b3-76bc-441d-b7f4-58b504758d8c-kube-api-access-dv8c6\") pod \"ec3793b3-76bc-441d-b7f4-58b504758d8c\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") "
Jul 13 22:06:37.403145 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.403103    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3793b3-76bc-441d-b7f4-58b504758d8c-maas-api-tls\") pod \"ec3793b3-76bc-441d-b7f4-58b504758d8c\" (UID: \"ec3793b3-76bc-441d-b7f4-58b504758d8c\") "
Jul 13 22:06:37.403417 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.403391    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3793b3-76bc-441d-b7f4-58b504758d8c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec3793b3-76bc-441d-b7f4-58b504758d8c" (UID: "ec3793b3-76bc-441d-b7f4-58b504758d8c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 22:06:37.403495 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.403483    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec3793b3-76bc-441d-b7f4-58b504758d8c-openshift-service-ca\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:37.405117 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.405096    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3793b3-76bc-441d-b7f4-58b504758d8c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec3793b3-76bc-441d-b7f4-58b504758d8c" (UID: "ec3793b3-76bc-441d-b7f4-58b504758d8c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 22:06:37.405170 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.405132    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec3793b3-76bc-441d-b7f4-58b504758d8c-kube-api-access-dv8c6" (OuterVolumeSpecName: "kube-api-access-dv8c6") pod "ec3793b3-76bc-441d-b7f4-58b504758d8c" (UID: "ec3793b3-76bc-441d-b7f4-58b504758d8c"). InnerVolumeSpecName "kube-api-access-dv8c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:06:37.504842 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.504819    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv8c6\" (UniqueName: \"kubernetes.io/projected/ec3793b3-76bc-441d-b7f4-58b504758d8c-kube-api-access-dv8c6\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:37.504842 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:37.504843    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec3793b3-76bc-441d-b7f4-58b504758d8c-maas-api-tls\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:38.102742 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:38.102710    2575 generic.go:356] "Generic (PLEG): container finished" podID="ec3793b3-76bc-441d-b7f4-58b504758d8c" containerID="4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded" exitCode=0
Jul 13 22:06:38.102928 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:38.102755    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"
Jul 13 22:06:38.102928 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:38.102795    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp" event={"ID":"ec3793b3-76bc-441d-b7f4-58b504758d8c","Type":"ContainerDied","Data":"4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded"}
Jul 13 22:06:38.102928 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:38.102845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp" event={"ID":"ec3793b3-76bc-441d-b7f4-58b504758d8c","Type":"ContainerDied","Data":"413358887b043b9a0dd8f93e717a70c9963bf54e4fe68130b323c99d9aa6cadf"}
Jul 13 22:06:38.102928 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:38.102871    2575 scope.go:117] "RemoveContainer" containerID="4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded"
Jul 13 22:06:38.111868 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:38.111843    2575 scope.go:117] "RemoveContainer" containerID="4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded"
Jul 13 22:06:38.112126 ip-10-0-143-189 kubenswrapper[2575]: E0713 22:06:38.112100    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded\": container with ID starting with 4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded not found: ID does not exist" containerID="4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded"
Jul 13 22:06:38.112176 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:38.112130    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded"} err="failed to get container status \"4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded\": rpc error: code = NotFound desc = could not find container \"4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded\": container with ID starting with 4b034889de34d5e56498274844e7fb5c6a85e77274c6037da69e6dd24afcdded not found: ID does not exist"
Jul 13 22:06:38.138607 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:38.138573    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"]
Jul 13 22:06:38.151074 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:38.151043    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f0e328-7b9dd746b4-bdnxp"]
Jul 13 22:06:39.470019 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:39.469989    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec3793b3-76bc-441d-b7f4-58b504758d8c" path="/var/lib/kubelet/pods/ec3793b3-76bc-441d-b7f4-58b504758d8c/volumes"
Jul 13 22:06:52.101964 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:52.101927    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"]
Jul 13 22:06:52.102504 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:52.102138    2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy" containerID="cri-o://4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8" gracePeriod=30
Jul 13 22:06:57.354946 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.354916    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:06:57.499483 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.499403    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-envoy\") pod \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") "
Jul 13 22:06:57.499483 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.499446    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-data\") pod \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") "
Jul 13 22:06:57.499700 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.499491    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbtp4\" (UniqueName: \"kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-kube-api-access-tbtp4\") pod \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") "
Jul 13 22:06:57.499700 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.499513    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-token\") pod \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") "
Jul 13 22:06:57.499700 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.499536    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-credential-socket\") pod \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") "
Jul 13 22:06:57.499700 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.499636    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-podinfo\") pod \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") "
Jul 13 22:06:57.499700 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.499693    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istiod-ca-cert\") pod \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") "
Jul 13 22:06:57.499957 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.499748    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-certs\") pod \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") "
Jul 13 22:06:57.499957 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.499772    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-socket\") pod \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\" (UID: \"91116d2a-e9e1-4273-8ac2-3a0355c61efd\") "
Jul 13 22:06:57.499957 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.499831    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91116d2a-e9e1-4273-8ac2-3a0355c61efd" (UID: "91116d2a-e9e1-4273-8ac2-3a0355c61efd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:06:57.500330 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.500114    2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-credential-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:57.500330 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.500130    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91116d2a-e9e1-4273-8ac2-3a0355c61efd" (UID: "91116d2a-e9e1-4273-8ac2-3a0355c61efd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 22:06:57.500517 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.500379    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91116d2a-e9e1-4273-8ac2-3a0355c61efd" (UID: "91116d2a-e9e1-4273-8ac2-3a0355c61efd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:06:57.500517 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.500470    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91116d2a-e9e1-4273-8ac2-3a0355c61efd" (UID: "91116d2a-e9e1-4273-8ac2-3a0355c61efd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:06:57.500592 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.500550    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-data" (OuterVolumeSpecName: "istio-data") pod "91116d2a-e9e1-4273-8ac2-3a0355c61efd" (UID: "91116d2a-e9e1-4273-8ac2-3a0355c61efd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:06:57.501861 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.501832    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91116d2a-e9e1-4273-8ac2-3a0355c61efd" (UID: "91116d2a-e9e1-4273-8ac2-3a0355c61efd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 22:06:57.501861 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.501850    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91116d2a-e9e1-4273-8ac2-3a0355c61efd" (UID: "91116d2a-e9e1-4273-8ac2-3a0355c61efd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 22:06:57.502152 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.502131    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-token" (OuterVolumeSpecName: "istio-token") pod "91116d2a-e9e1-4273-8ac2-3a0355c61efd" (UID: "91116d2a-e9e1-4273-8ac2-3a0355c61efd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:06:57.502220 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.502143    2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-kube-api-access-tbtp4" (OuterVolumeSpecName: "kube-api-access-tbtp4") pod "91116d2a-e9e1-4273-8ac2-3a0355c61efd" (UID: "91116d2a-e9e1-4273-8ac2-3a0355c61efd"). InnerVolumeSpecName "kube-api-access-tbtp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 22:06:57.601572 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.601516    2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istiod-ca-cert\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:57.601572 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.601564    2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-certs\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:57.601572 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.601577    2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-workload-socket\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:57.601836 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.601589    2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-envoy\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:57.601836 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.601601    2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-data\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:57.601836 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.601614    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbtp4\" (UniqueName: \"kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-kube-api-access-tbtp4\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:57.601836 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.601625    2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-token\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:57.601836 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.601636    2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91116d2a-e9e1-4273-8ac2-3a0355c61efd-istio-podinfo\") on node \"ip-10-0-143-189.ec2.internal\" DevicePath \"\""
Jul 13 22:06:57.886150 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:57.886120    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cqpbr_7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6/manager/0.log"
Jul 13 22:06:58.024532 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.024501    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-sjnlw_be9d3335-b014-4c27-a89b-cf58ab584088/manager/0.log"
Jul 13 22:06:58.212508 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.212417    2575 generic.go:356] "Generic (PLEG): container finished" podID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerID="4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8" exitCode=0
Jul 13 22:06:58.212508 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.212460    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"
Jul 13 22:06:58.212508 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.212498    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" event={"ID":"91116d2a-e9e1-4273-8ac2-3a0355c61efd","Type":"ContainerDied","Data":"4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8"}
Jul 13 22:06:58.212746 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.212551    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf" event={"ID":"91116d2a-e9e1-4273-8ac2-3a0355c61efd","Type":"ContainerDied","Data":"1271cd3f14e007d720adf4c3e1df298d7a29fda77078fe27f1797347b928e621"}
Jul 13 22:06:58.212746 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.212575    2575 scope.go:117] "RemoveContainer" containerID="4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8"
Jul 13 22:06:58.222387 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.222232    2575 scope.go:117] "RemoveContainer" containerID="d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07"
Jul 13 22:06:58.230162 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.230144    2575 scope.go:117] "RemoveContainer" containerID="4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8"
Jul 13 22:06:58.230408 ip-10-0-143-189 kubenswrapper[2575]: E0713 22:06:58.230392    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8\": container with ID starting with 4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8 not found: ID does not exist" containerID="4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8"
Jul 13 22:06:58.230465 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.230416    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8"} err="failed to get container status \"4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8\": rpc error: code = NotFound desc = could not find container \"4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8\": container with ID starting with 4bf9f56943fe354724dd4a8d86aa34b7cd1d73eefd90e7f12b62926519a4c1c8 not found: ID does not exist"
Jul 13 22:06:58.230465 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.230431    2575 scope.go:117] "RemoveContainer" containerID="d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07"
Jul 13 22:06:58.230670 ip-10-0-143-189 kubenswrapper[2575]: E0713 22:06:58.230651    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07\": container with ID starting with d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07 not found: ID does not exist" containerID="d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07"
Jul 13 22:06:58.230716 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.230677    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07"} err="failed to get container status \"d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07\": rpc error: code = NotFound desc = could not find container \"d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07\": container with ID starting with d486cb4417fbd3303ea5edd1dfda0dcaf610a994b09b5aa026fcbae124cbfc07 not found: ID does not exist"
Jul 13 22:06:58.238673 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.238642    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"]
Jul 13 22:06:58.241064 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.241043    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f0e328-openshift-default-79df646c4c-zvbkf"]
Jul 13 22:06:58.611987 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.611962    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f98b9f4-sxpqg_c59e849e-4bb0-45de-a177-7ee4a10aae6b/manager/0.log"
Jul 13 22:06:58.621661 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:58.621639    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f98b9f4-sxpqg_c59e849e-4bb0-45de-a177-7ee4a10aae6b/copy-manifests/0.log"
Jul 13 22:06:59.448200 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:59.448168    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-8a043b23-6tbr6_bb8a4c13-10af-49f5-905f-220fe540d0a2/revoke-keys/0.log"
Jul 13 22:06:59.469098 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:59.469067    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" path="/var/lib/kubelet/pods/91116d2a-e9e1-4273-8ac2-3a0355c61efd/volumes"
Jul 13 22:06:59.555840 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:59.555798    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-9b188814-89c9w_27bd48e8-faff-4dd8-a748-fce857bce011/revoke-keys/0.log"
Jul 13 22:06:59.898484 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:06:59.898452    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-7fdae48e-5z78p_ac786246-3893-408e-b53d-b02c9ec5c4d1/revoke-keys/0.log"
Jul 13 22:07:00.225029 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:00.224942    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-c9a3e9a3-cqd2g_8a982937-4ed7-45dd-8104-9d02288a690f/revoke-keys/0.log"
Jul 13 22:07:00.332971 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:00.332938    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-5f8bcbd1-m59l6_3ed76d8a-5c12-4131-8906-096a3359a065/revoke-keys/0.log"
Jul 13 22:07:03.175948 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:03.175914    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mkf4b_57128c30-3cb2-4a5a-ae16-3edb2e563820/istio-proxy/0.log"
Jul 13 22:07:03.631955 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:03.631913    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dv98p_f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc/istio-proxy/1.log"
Jul 13 22:07:03.867043 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:03.867010    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8vwpd_c3ac8a89-1b8a-421b-aed0-73630fdc50c9/payload-processing/0.log"
Jul 13 22:07:03.971235 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:03.971156    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c7d7cf9fb-cs5pw_1e9dcb4a-fc5c-4225-8408-451aa5bf4b22/router/0.log"
Jul 13 22:07:04.422646 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:04.422590    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qj68t_a476321c-c6ec-4a54-bcdf-272cc0d310d0/main/0.log"
Jul 13 22:07:04.757974 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:04.757899    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4csxn_5d9fffdb-ee14-4926-b51d-8686018913d2/main/0.log"
Jul 13 22:07:11.794347 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:11.794298    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-89tsm_4e67ebcf-f921-48f9-a5e7-80e0012b81d9/global-pull-secret-syncer/0.log"
Jul 13 22:07:12.020637 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:12.020603    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qwqgw_48866136-7857-4f79-b780-79b899f0a01d/konnectivity-agent/0.log"
Jul 13 22:07:12.096148 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:12.096116    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-189.ec2.internal_d1510e5818da91f39e4176b6a7f0e5fd/haproxy/0.log"
Jul 13 22:07:20.065633 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:20.065600    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-gxhht_25abff9a-a168-4b5d-81fd-ff850378dbf6/cluster-monitoring-operator/0.log"
Jul 13 22:07:20.359665 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:20.359582    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tc7h_ca3c81d5-728f-4512-929b-d2b9a15c25b4/node-exporter/0.log"
Jul 13 22:07:20.387288 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:20.387264    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tc7h_ca3c81d5-728f-4512-929b-d2b9a15c25b4/kube-rbac-proxy/0.log"
Jul 13 22:07:20.413761 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:20.413733    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tc7h_ca3c81d5-728f-4512-929b-d2b9a15c25b4/init-textfile/0.log"
Jul 13 22:07:20.930002 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:20.929972    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-2br7n_34aedcdf-76ca-4216-9208-ee76f69057f8/prometheus-operator-admission-webhook/0.log"
Jul 13 22:07:21.852749 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.852714    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"]
Jul 13 22:07:21.853126 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853063    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy"
Jul 13 22:07:21.853126 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853074    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy"
Jul 13 22:07:21.853126 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853086    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy"
Jul 13 22:07:21.853126 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853092    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy"
Jul 13 22:07:21.853126 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853100    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy"
Jul 13 22:07:21.853126 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853105    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy"
Jul 13 22:07:21.853126 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853118    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b88f51fc-bce3-413a-b611-7887a26e275a" containerName="maas-api"
Jul 13 22:07:21.853126 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853123    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b88f51fc-bce3-413a-b611-7887a26e275a" containerName="maas-api"
Jul 13 22:07:21.853126 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853131    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy"
Jul 13 22:07:21.853450 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853136    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy"
Jul 13 22:07:21.853450 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853151    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3793b3-76bc-441d-b7f4-58b504758d8c" containerName="maas-api"
Jul 13 22:07:21.853450 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853156    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3793b3-76bc-441d-b7f4-58b504758d8c" containerName="maas-api"
Jul 13 22:07:21.853450 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853211    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b88f51fc-bce3-413a-b611-7887a26e275a" containerName="maas-api"
Jul 13 22:07:21.853450 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853218    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy"
Jul 13 22:07:21.853450 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853226    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec3793b3-76bc-441d-b7f4-58b504758d8c" containerName="maas-api"
Jul 13 22:07:21.853450 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853232    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy"
Jul 13 22:07:21.853450 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853239    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d446dd-e2d0-4804-a81b-4f0bf46cdf1c" containerName="istio-proxy"
Jul 13 22:07:21.853450 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.853246    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="91116d2a-e9e1-4273-8ac2-3a0355c61efd" containerName="istio-proxy"
Jul 13 22:07:21.856411 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.856390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:21.859104 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.859084    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jl7zj\"/\"openshift-service-ca.crt\""
Jul 13 22:07:21.859181 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.859106    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jl7zj\"/\"kube-root-ca.crt\""
Jul 13 22:07:21.860255 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.860236    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jl7zj\"/\"default-dockercfg-qtxmd\""
Jul 13 22:07:21.866760 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.866736    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"]
Jul 13 22:07:21.932827 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.932786    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-proc\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:21.933035 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.932847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb4hb\" (UniqueName: \"kubernetes.io/projected/55906b79-ad97-4cbf-a70a-d59a61f1f883-kube-api-access-cb4hb\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:21.933035 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.932964    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-podres\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:21.933035 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.933003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-lib-modules\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:21.933190 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:21.933070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-sys\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.033905 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.033861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-podres\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.033905 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.033907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-lib-modules\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.034119 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.033951    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-sys\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.034119 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.033980    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-proc\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.034119 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.034039    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb4hb\" (UniqueName: \"kubernetes.io/projected/55906b79-ad97-4cbf-a70a-d59a61f1f883-kube-api-access-cb4hb\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.034119 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.034045    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-podres\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.034119 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.034075    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-sys\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.034280 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.034116    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-lib-modules\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.034280 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.034151    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55906b79-ad97-4cbf-a70a-d59a61f1f883-proc\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.043687 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.043652    2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb4hb\" (UniqueName: \"kubernetes.io/projected/55906b79-ad97-4cbf-a70a-d59a61f1f883-kube-api-access-cb4hb\") pod \"perf-node-gather-daemonset-rkj9q\" (UID: \"55906b79-ad97-4cbf-a70a-d59a61f1f883\") " pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.167539 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.167455    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:22.308065 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.308031    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"]
Jul 13 22:07:22.310920 ip-10-0-143-189 kubenswrapper[2575]: W0713 22:07:22.310879    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod55906b79_ad97_4cbf_a70a_d59a61f1f883.slice/crio-a6cdecb3e81247f66b6aee9c7a63ed9d841b80b5434930c4fadc3088541938d4 WatchSource:0}: Error finding container a6cdecb3e81247f66b6aee9c7a63ed9d841b80b5434930c4fadc3088541938d4: Status 404 returned error can't find the container with id a6cdecb3e81247f66b6aee9c7a63ed9d841b80b5434930c4fadc3088541938d4
Jul 13 22:07:22.338404 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.338374    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q" event={"ID":"55906b79-ad97-4cbf-a70a-d59a61f1f883","Type":"ContainerStarted","Data":"a6cdecb3e81247f66b6aee9c7a63ed9d841b80b5434930c4fadc3088541938d4"}
Jul 13 22:07:22.389656 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.389625    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-rhbzx_ed0a11bd-06f9-4058-bd40-a411090cfc56/networking-console-plugin/0.log"
Jul 13 22:07:22.973610 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.973569    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/1.log"
Jul 13 22:07:22.978405 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:22.978387    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4s2vp_fe01c8d4-4ca1-4a78-ba03-93c77e5ab482/console-operator/2.log"
Jul 13 22:07:23.352164 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:23.352124    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q" event={"ID":"55906b79-ad97-4cbf-a70a-d59a61f1f883","Type":"ContainerStarted","Data":"5757e8da11f9882987a0972c4bc7f6718c6bfb46054d841adf2152c8f333b54b"}
Jul 13 22:07:23.352491 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:23.352224    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:23.369828 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:23.369778    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q" podStartSLOduration=2.369762184 podStartE2EDuration="2.369762184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 22:07:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 22:07:23.368060967 +0000 UTC m=+2748.457341121" watchObservedRunningTime="2026-07-13 22:07:23.369762184 +0000 UTC m=+2748.459042338"
Jul 13 22:07:23.472605 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:23.472578    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-ldhch_ed09acd4-0a9b-4e4b-b72c-335b78fc60c1/download-server/0.log"
Jul 13 22:07:24.041961 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:24.041928    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-c74c9_32fb6130-69ee-48f3-88a9-b08582803f42/volume-data-source-validator/0.log"
Jul 13 22:07:25.160536 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:25.160498    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qs8p2_db616dd4-a0c5-4beb-8c07-95de1e4b51f1/dns/0.log"
Jul 13 22:07:25.181581 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:25.181556    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qs8p2_db616dd4-a0c5-4beb-8c07-95de1e4b51f1/kube-rbac-proxy/0.log"
Jul 13 22:07:25.231540 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:25.231506    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s877s_1a096c9e-9916-4b64-8232-4c990125ce94/dns-node-resolver/0.log"
Jul 13 22:07:25.881054 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:25.881025    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ntbrp_a3f84f41-9272-4f07-951f-8e5451436d80/node-ca/0.log"
Jul 13 22:07:26.825133 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:26.825106    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mkf4b_57128c30-3cb2-4a5a-ae16-3edb2e563820/istio-proxy/0.log"
Jul 13 22:07:27.128804 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:27.128718    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dv98p_f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc/istio-proxy/0.log"
Jul 13 22:07:27.156528 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:27.156493    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dv98p_f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc/istio-proxy/1.log"
Jul 13 22:07:27.229045 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:27.229009    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8vwpd_c3ac8a89-1b8a-421b-aed0-73630fdc50c9/payload-processing/0.log"
Jul 13 22:07:27.250831 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:27.250794    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c7d7cf9fb-cs5pw_1e9dcb4a-fc5c-4225-8408-451aa5bf4b22/router/0.log"
Jul 13 22:07:27.968479 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:27.968452    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7bl66_0cdb947b-b2b7-42ab-b5e7-7933641becf7/serve-healthcheck-canary/0.log"
Jul 13 22:07:28.472935 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:28.472903    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-c2qb9_883ed7f6-38f8-4626-8467-00f1a732c497/insights-operator/0.log"
Jul 13 22:07:28.473808 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:28.473792    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-c2qb9_883ed7f6-38f8-4626-8467-00f1a732c497/insights-operator/1.log"
Jul 13 22:07:28.632317 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:28.632284    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4gw5_8df1d10b-fd51-42f3-8df4-290226630026/kube-rbac-proxy/0.log"
Jul 13 22:07:28.653544 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:28.653514    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4gw5_8df1d10b-fd51-42f3-8df4-290226630026/exporter/0.log"
Jul 13 22:07:28.674517 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:28.674489    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z4gw5_8df1d10b-fd51-42f3-8df4-290226630026/extractor/0.log"
Jul 13 22:07:29.367724 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:29.367691    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jl7zj/perf-node-gather-daemonset-rkj9q"
Jul 13 22:07:31.116058 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:31.116032    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cqpbr_7ca9463a-069a-4ebf-88b6-f7bfb6d7c7b6/manager/0.log"
Jul 13 22:07:31.260614 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:31.260586    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-sjnlw_be9d3335-b014-4c27-a89b-cf58ab584088/manager/0.log"
Jul 13 22:07:31.685933 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:31.685903    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f98b9f4-sxpqg_c59e849e-4bb0-45de-a177-7ee4a10aae6b/manager/0.log"
Jul 13 22:07:31.713143 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:31.713119    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f98b9f4-sxpqg_c59e849e-4bb0-45de-a177-7ee4a10aae6b/copy-manifests/0.log"
Jul 13 22:07:33.083220 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:33.083185    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mkf4b_57128c30-3cb2-4a5a-ae16-3edb2e563820/istio-proxy/0.log"
Jul 13 22:07:33.224146 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:33.224120    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74864c9df6-tgd8x_616c82c8-97e4-45dd-a174-6ae96da5a59e/manager/0.log"
Jul 13 22:07:33.352593 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:33.352554    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dv98p_f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc/istio-proxy/0.log"
Jul 13 22:07:33.380844 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:33.380813    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dv98p_f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc/istio-proxy/1.log"
Jul 13 22:07:33.441289 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:33.441259    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8vwpd_c3ac8a89-1b8a-421b-aed0-73630fdc50c9/payload-processing/0.log"
Jul 13 22:07:33.454703 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:33.454675    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c7d7cf9fb-cs5pw_1e9dcb4a-fc5c-4225-8408-451aa5bf4b22/router/0.log"
Jul 13 22:07:34.679526 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:34.679495    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4mkf4b_57128c30-3cb2-4a5a-ae16-3edb2e563820/istio-proxy/0.log"
Jul 13 22:07:35.010444 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:35.010357    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dv98p_f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc/istio-proxy/0.log"
Jul 13 22:07:35.046631 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:35.046598    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-dv98p_f6db1aa7-cfa5-4fb6-a054-4e47c532c0bc/istio-proxy/1.log"
Jul 13 22:07:35.102576 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:35.102549    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-8vwpd_c3ac8a89-1b8a-421b-aed0-73630fdc50c9/payload-processing/0.log"
Jul 13 22:07:35.120066 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:35.120034    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c7d7cf9fb-cs5pw_1e9dcb4a-fc5c-4225-8408-451aa5bf4b22/router/0.log"
Jul 13 22:07:38.479856 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:38.479771    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hkpzw_d5b5a43d-4e87-46c8-9df3-c2ba39890cca/migrator/0.log"
Jul 13 22:07:38.500457 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:38.500420    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hkpzw_d5b5a43d-4e87-46c8-9df3-c2ba39890cca/graceful-termination/0.log"
Jul 13 22:07:38.871072 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:38.871035    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tqrlr_8ab1b994-4573-4b8c-ab6b-0dca52fc98cb/kube-storage-version-migrator-operator/1.log"
Jul 13 22:07:38.871882 ip-10-0-143-189 kubenswrapper[2575]: I0713 22:07:38.871858    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-tqrlr_8ab1b994-4573-4b8c-ab6b-0dca52fc98cb/kube-storage-version-migrator-operator/0.log"