Jul 26 17:55:22.985065 ip-10-0-143-214 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 26 17:55:22.985077 ip-10-0-143-214 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 26 17:55:22.985087 ip-10-0-143-214 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 26 17:55:22.985420 ip-10-0-143-214 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 26 17:55:33.216385 ip-10-0-143-214 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 26 17:55:33.216423 ip-10-0-143-214 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0cf78f5d70194fbe8cc176d21c6df51b --
Jul 26 17:57:22.783449 ip-10-0-143-214 systemd[1]: Starting Kubernetes Kubelet...
Jul 26 17:57:23.173712 ip-10-0-143-214 kubenswrapper[2548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 17:57:23.173712 ip-10-0-143-214 kubenswrapper[2548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 26 17:57:23.173712 ip-10-0-143-214 kubenswrapper[2548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 17:57:23.173712 ip-10-0-143-214 kubenswrapper[2548]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 26 17:57:23.173712 ip-10-0-143-214 kubenswrapper[2548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 26 17:57:23.175476 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.175410    2548 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 26 17:57:23.179776 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179756    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 17:57:23.179776 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179772    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 17:57:23.179776 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179776    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 17:57:23.179776 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179779    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 17:57:23.179776 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179782    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179786    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179789    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179792    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179799    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179801    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179804    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179807    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179810    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179813    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179816    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179819    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179822    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179824    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179829    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179831    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179834    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179839    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179842    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 17:57:23.179950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179845    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179848    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179851    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179854    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179857    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179860    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179862    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179865    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179868    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179870    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179873    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179878    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179881    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179884    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179887    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179891    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179894    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179898    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179902    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179905    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 17:57:23.180442 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179908    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179911    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179914    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179919    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179924    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179927    2548 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179930    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179933    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179936    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179939    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179943    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179947    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179950    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179954    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179957    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.179962    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180002    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180034    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180154    2548 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180164    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 17:57:23.180952 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180169    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180172    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180176    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180179    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180182    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180184    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180187    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180203    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180206    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180209    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180223    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180227    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180230    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180233    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180236    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180265    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180268    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180271    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180274    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 17:57:23.181454 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180277    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180280    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180282    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180285    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180288    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180291    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180294    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180297    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180299    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180302    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180305    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180308    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180311    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180313    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180316    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180319    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.180321    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181026    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181034    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 17:57:23.181908 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181038    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181042    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181045    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181048    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181051    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181053    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181056    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181058    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181061    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181063    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181066    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181069    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181071    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181074    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181076    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181078    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181081    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181084    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181086    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181089    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 17:57:23.182390 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181092    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181094    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181096    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181101    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181103    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181106    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181108    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181111    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181113    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181116    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181118    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181121    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181123    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181126    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181128    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181131    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181133    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181136    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181138    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181141    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 17:57:23.182879 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181143    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181146    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181149    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181151    2548 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181154    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181158    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181161    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181164    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181167    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181170    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181173    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181175    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181178    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181181    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181183    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181206    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181210    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181212    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181215    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 17:57:23.183384 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181217    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181220    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181223    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181226    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181228    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181231    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181233    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181236    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181238    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181241    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181244    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181246    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181249    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181251    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181254    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181258    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181260    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181263    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181265    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181267    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 17:57:23.183856 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181270    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181272    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181276    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181279    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181281    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181284    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181286    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181289    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181293    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181297    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181301    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181304    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181307    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181309    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181312    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181314    2548 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181317    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181319    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181692    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 17:57:23.184349 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181697    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181700    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181703    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181706    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181708    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181711    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181714    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181716    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181719    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181722    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181724    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181727    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181731    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181734    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181737    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181740    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181743    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181745    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181748    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 17:57:23.184820 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181750    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181753    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181758    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181762    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181765    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181767    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181770    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181773    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181776    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181778    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181781    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181784    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181787    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181789    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181792    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181794    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181796    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181799    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181801    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 17:57:23.185294 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181804    2548 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181807    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181809    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181812    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181814    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181817    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181819    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181822    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181824    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181827    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181830    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181832    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181835    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181837    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181839    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181844    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181847    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181849    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181852    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 17:57:23.185802 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181854    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181857    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181859    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181862    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181864    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181867    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181869    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181872    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181875    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181877    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181879    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181882    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181887    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181890    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181892    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181895    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181897    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181899    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181902    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181905    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 17:57:23.186285 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181907    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181909    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181912    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181915    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181918    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181920    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181923    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181925    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181929    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181932    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181934    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181937    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181939    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181942    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181945    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181947    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181950    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181952    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181954    2548 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181957    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 17:57:23.186770 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.181960    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182025    2548 flags.go:64] FLAG: --address="0.0.0.0"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182032    2548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182037    2548 flags.go:64] FLAG: --anonymous-auth="true"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182042    2548 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182047    2548 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182052    2548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182059    2548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182065    2548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182070    2548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182074    2548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182077    2548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182080    2548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182083    2548 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182086    2548 flags.go:64] FLAG: --cgroup-root=""
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182089    2548 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182092    2548 flags.go:64] FLAG: --client-ca-file=""
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182097    2548 flags.go:64] FLAG: --cloud-provider="external"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182100    2548 flags.go:64] FLAG: --cluster-dns="[]"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182104    2548 flags.go:64] FLAG: --cluster-domain=""
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182107    2548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182110    2548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182114    2548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182117    2548 flags.go:64] FLAG: --container-log-max-files="5"
Jul 26 17:57:23.187265 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182121    2548 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182124    2548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182127    2548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182130    2548 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182133    2548 flags.go:64] FLAG: --contention-profiling="false"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182136    2548 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182139    2548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182142    2548 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182145    2548 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182149    2548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182152    2548 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182155    2548 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182158    2548 flags.go:64] FLAG: --enable-load-reader="false"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182161    2548 flags.go:64] FLAG: --enable-server="true"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182164    2548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182168    2548 flags.go:64] FLAG: --event-burst="100"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182172    2548 flags.go:64] FLAG: --event-qps="50"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182175    2548 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182178    2548 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182181    2548 flags.go:64] FLAG: --eviction-hard=""
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182184    2548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182187    2548 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182202    2548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182205    2548 flags.go:64] FLAG: --eviction-soft=""
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182208    2548 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 26 17:57:23.187835 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182211    2548 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182215    2548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182218    2548 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182221    2548 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182224    2548 flags.go:64] FLAG: --fail-swap-on="true"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182227    2548 flags.go:64] FLAG: --feature-gates=""
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182230    2548 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182233    2548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182236    2548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182239    2548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182242    2548 flags.go:64] FLAG: --healthz-port="10248"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182245    2548 flags.go:64] FLAG: --help="false"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182248    2548 flags.go:64] FLAG: --hostname-override="ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182251    2548 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182254    2548 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182257    2548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182261    2548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182264    2548 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182267    2548 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182270    2548 flags.go:64] FLAG: --image-service-endpoint=""
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182273    2548 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182276    2548 flags.go:64] FLAG: --kube-api-burst="100"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182279    2548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182282    2548 flags.go:64] FLAG: --kube-api-qps="50"
Jul 26 17:57:23.188494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182285    2548 flags.go:64] FLAG: --kube-reserved=""
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182288    2548 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182290    2548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182293    2548 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182296    2548 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182299    2548 flags.go:64] FLAG: --lock-file=""
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182302    2548 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182305    2548 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182308    2548 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182313    2548 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182317    2548 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182319    2548 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182322    2548 flags.go:64] FLAG: --logging-format="text"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182325    2548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182328    2548 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182331    2548 flags.go:64] FLAG: --manifest-url=""
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182334    2548 flags.go:64] FLAG: --manifest-url-header=""
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182338    2548 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182341    2548 flags.go:64] FLAG: --max-open-files="1000000"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182345    2548 flags.go:64] FLAG: --max-pods="110"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182348    2548 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182350    2548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182353    2548 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182356    2548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182359    2548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 26 17:57:23.189119 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182362    2548 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182365    2548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182372    2548 flags.go:64] FLAG: --node-status-max-images="50"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182375    2548 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182378    2548 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182381    2548 flags.go:64] FLAG: --pod-cidr=""
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182384    2548 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182389    2548 flags.go:64] FLAG: --pod-manifest-path=""
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182391    2548 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182395    2548 flags.go:64] FLAG: --pods-per-core="0"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182398    2548 flags.go:64] FLAG: --port="10250"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182401    2548 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182404    2548 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09a5028f5e380c088"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182407    2548 flags.go:64] FLAG: --qos-reserved=""
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182412    2548 flags.go:64] FLAG: --read-only-port="10255"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182415    2548 flags.go:64] FLAG: --register-node="true"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182418    2548 flags.go:64] FLAG: --register-with-taints=""
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182421    2548 flags.go:64] FLAG: --registry-burst="10"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182425    2548 flags.go:64] FLAG: --registry-qps="5"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182428    2548 flags.go:64] FLAG: --reserved-cpus=""
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182430    2548 flags.go:64] FLAG: --reserved-memory=""
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182434    2548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182437    2548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182440    2548 flags.go:64] FLAG: --rotate-certificates="false"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182443    2548 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 26 17:57:23.189736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182446    2548 flags.go:64] FLAG: --runonce="false"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182449    2548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182452    2548 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182455    2548 flags.go:64] FLAG: --seccomp-default="false"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182458    2548 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182461    2548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182464    2548 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182467    2548 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182470    2548 flags.go:64] FLAG: --storage-driver-password="root"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182474    2548 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182477    2548 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182480    2548 flags.go:64] FLAG: --storage-driver-user="root"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182482    2548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182485    2548 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182488    2548 flags.go:64] FLAG: --system-cgroups=""
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182491    2548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182496    2548 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182499    2548 flags.go:64] FLAG: --tls-cert-file=""
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182502    2548 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182506    2548 flags.go:64] FLAG: --tls-min-version=""
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182509    2548 flags.go:64] FLAG: --tls-private-key-file=""
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182513    2548 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182516    2548 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182519    2548 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182522    2548 flags.go:64] FLAG: --v="2"
Jul 26 17:57:23.190362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182526    2548 flags.go:64] FLAG: --version="false"
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182530    2548 flags.go:64] FLAG: --vmodule=""
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182534    2548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.182537    2548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182654    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182658    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182661    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182663    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182666    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182669    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182673    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182677    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182680    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182683    2548 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182685    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182688    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182694    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182698    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182701    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182704    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 17:57:23.190960 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182707    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182710    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182713    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182716    2548 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182719    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182721    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182724    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182727    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182731    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182733    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182736    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182739    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182741    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182744    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182747    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182750    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182753    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182755    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182758    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182761    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 17:57:23.191460 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182763    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182766    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182768    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182771    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182774    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182776    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182779    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182781    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182789    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182791    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182794    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182796    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182799    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182801    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182804    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182806    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182809    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182812    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182814    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182817    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 17:57:23.191950 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182820    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182823    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182826    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182829    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182831    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182834    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182837    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182840    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182843    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182845    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182848    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182851    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182853    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182856    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182858    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182861    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182863    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182865    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182868    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182871    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 17:57:23.192523 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182874    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182878    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182882    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182885    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182889    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182892    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182895    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182898    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182901    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182904    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182906    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182909    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182913    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182915    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182918    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182920    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182923    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182925    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182928    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182931    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 17:57:23.193014 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182934    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182937    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.182940    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.183472    2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.189336    2548 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.189353    2548 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.190161    2548 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.190169    2548 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190237    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190243    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190247    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190250    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190253    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190257    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190259    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 17:57:23.193578 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190262    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190265    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190268    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190270    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190273    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190275    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190278    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190282    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190286    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190289    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190292    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190295    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190297    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190300    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190303    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190305    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190308    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190311    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190314    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190316    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 17:57:23.193945 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190319    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190321    2548 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190326    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190331    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190334    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190336    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190339    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190341    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190344    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190347    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190349    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190352    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190355    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190357    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190360    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190363    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190366    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190368    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190371    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 17:57:23.194437 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190374    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190377    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190381    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190384    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190387    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190390    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190393    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190396    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190399    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190401    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190404    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190406    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190409    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190412    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190415    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190419    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190422    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190424    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190427    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 17:57:23.194930 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190429    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190432    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190434    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190437    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190440    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190442    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190445    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190447    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190450    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190452    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190455    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190457    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190460    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190463    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190465    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190468    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190470    2548 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190473    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190475    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190478    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 17:57:23.195418 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190480    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190483    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190485    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190488    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190490    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190493    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190496    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190499    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190502    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190504    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190508    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190510    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190513    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190515    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.190521    2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 17:57:23.195896 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190646    2548 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190650    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190653    2548 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190657    2548 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190660    2548 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190663    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190665    2548 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190668    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190671    2548 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190673    2548 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190676    2548 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190679    2548 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190681    2548 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190684    2548 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190686    2548 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190689    2548 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190691    2548 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190694    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190697    2548 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190699    2548 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 26 17:57:23.196372 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190702    2548 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190704    2548 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190707    2548 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190709    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190712    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190714    2548 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190717    2548 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190720    2548 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190723    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190725    2548 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190728    2548 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190730    2548 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190733    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190735    2548 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190738    2548 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190740    2548 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190743    2548 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190746    2548 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190748    2548 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190750    2548 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 26 17:57:23.196877 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190753    2548 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190756    2548 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190758    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190760    2548 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190763    2548 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190765    2548 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190768    2548 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190771    2548 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190773    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190776    2548 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190778    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190781    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190784    2548 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190788    2548 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190791    2548 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190794    2548 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190797    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190800    2548 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190803    2548 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 26 17:57:23.197373 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190806    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190809    2548 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190812    2548 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190815    2548 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190817    2548 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190820    2548 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190823    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190825    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190827    2548 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190830    2548 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190833    2548 feature_gate.go:328] unrecognized feature gate: Example2
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190835    2548 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190839    2548 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190842    2548 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190845    2548 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190847    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190850    2548 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190852    2548 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190855    2548 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 26 17:57:23.197836 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190857    2548 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190860    2548 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190863    2548 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190865    2548 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190868    2548 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190871    2548 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190874    2548 feature_gate.go:328] unrecognized feature gate: Example
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190877    2548 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190879    2548 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190882    2548 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190885    2548 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190887    2548 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190890    2548 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190892    2548 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190895    2548 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190897    2548 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190900    2548 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190903    2548 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190905    2548 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 26 17:57:23.198329 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190908    2548 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 26 17:57:23.198791 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:23.190910    2548 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 26 17:57:23.198791 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.190915    2548 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 26 17:57:23.198791 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.191016    2548 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 26 17:57:23.198791 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.192810    2548 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 26 17:57:23.198791 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.194047    2548 server.go:1019] "Starting client certificate rotation"
Jul 26 17:57:23.198791 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.194140    2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 17:57:23.198791 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.195187    2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 26 17:57:23.198791 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.196637    2548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 17:57:23.201362 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.201346    2548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 26 17:57:23.210557 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.210538    2548 log.go:25] "Validated CRI v1 runtime API"
Jul 26 17:57:23.212456 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.212442    2548 log.go:25] "Validated CRI v1 image API"
Jul 26 17:57:23.213336 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.213322    2548 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 26 17:57:23.215848 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.215832    2548 fs.go:135] Filesystem UUIDs: map[285fceeb-b504-4faa-bd15-b5d89791dc0e:/dev/nvme0n1p4 518dd0ed-b530-4271-9f27-a685159fc67b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 26 17:57:23.215898 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.215849    2548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 26 17:57:23.221678 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.221575    2548 manager.go:216] Machine: {Timestamp:2026-07-26 17:57:23.220442041 +0000 UTC m=+0.320694939 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101517 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2100ce294e75344efc0c2b66e610ec SystemUUID:ec2100ce-294e-7534-4efc-0c2b66e610ec BootID:0cf78f5d-7019-4fbe-8cc1-76d21c6df51b Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b2:97:1a:a9:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b2:97:1a:a9:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:64:1e:90:0b:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 26 17:57:23.221678 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.221674    2548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 26 17:57:23.221788 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.221763    2548 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 26 17:57:23.222724 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.222701    2548 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 26 17:57:23.222856 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.222725    2548 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-214.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 26 17:57:23.223907 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.223892    2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 17:57:23.224070 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.224058    2548 topology_manager.go:138] "Creating topology manager with none policy"
Jul 26 17:57:23.224099 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.224075    2548 container_manager_linux.go:309] "Creating device plugin manager"
Jul 26 17:57:23.224099 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.224082    2548 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 17:57:23.224751 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.224740    2548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 26 17:57:23.225509 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.225497    2548 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 26 17:57:23.227236 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.227225    2548 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 17:57:23.227351 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.227342    2548 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 26 17:57:23.227381 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.227372    2548 kubelet.go:486] "Attempting to sync node with API server"
Jul 26 17:57:23.227412 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.227386    2548 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 26 17:57:23.227412 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.227408    2548 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 26 17:57:23.227469 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.227421    2548 kubelet.go:398] "Adding apiserver pod source"
Jul 26 17:57:23.227469 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.227432    2548 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 26 17:57:23.227796 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.227785    2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 17:57:23.227844 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.227803    2548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 26 17:57:23.230690 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.230675    2548 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 26 17:57:23.232279 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.232266    2548 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 26 17:57:23.232330 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.232296    2548 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 26 17:57:23.233655 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233644    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 26 17:57:23.233703 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233661    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 26 17:57:23.233703 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233668    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 26 17:57:23.233703 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233674    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 26 17:57:23.233703 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233686    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 26 17:57:23.233703 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233694    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 26 17:57:23.233703 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233705    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 26 17:57:23.233859 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233710    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 26 17:57:23.233859 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233716    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 26 17:57:23.233859 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233723    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 26 17:57:23.233859 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233739    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 26 17:57:23.233859 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.233744    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 26 17:57:23.234513 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.234502    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 26 17:57:23.234513 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.234512    2548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 26 17:57:23.236622 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.236604    2548 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-214.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 26 17:57:23.237267 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.237249    2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-214.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 26 17:57:23.237326 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.237248    2548 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 26 17:57:23.237485 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.237473    2548 server.go:1268] "Started kubelet"
Jul 26 17:57:23.237613 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.237587    2548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 26 17:57:23.237613 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.237595    2548 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 26 17:57:23.237761 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.237628    2548 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 26 17:57:23.238162 ip-10-0-143-214 systemd[1]: Started Kubernetes Kubelet.
Jul 26 17:57:23.242322 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.242304    2548 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 26 17:57:23.243429 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.243403    2548 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 26 17:57:23.243867 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.243848    2548 server.go:310] "Adding debug handlers to kubelet server"
Jul 26 17:57:23.246846 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.245914    2548 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-214.ec2.internal.18c5e8a9c8c08c43  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-214.ec2.internal,UID:ip-10-0-143-214.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-214.ec2.internal,},FirstTimestamp:2026-07-26 17:57:23.237448771 +0000 UTC m=+0.337701649,LastTimestamp:2026-07-26 17:57:23.237448771 +0000 UTC m=+0.337701649,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-214.ec2.internal,}"
Jul 26 17:57:23.249953 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.249936    2548 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 26 17:57:23.250062 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.250044    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:23.250232 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.249942    2548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 26 17:57:23.250571 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.250496    2548 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 26 17:57:23.250571 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.250497    2548 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 26 17:57:23.250571 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.250526    2548 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 26 17:57:23.250740 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.250657    2548 reconstruct.go:97] "Volume reconstruction finished"
Jul 26 17:57:23.250740 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.250667    2548 reconciler.go:29] "Reconciler: start to sync state"
Jul 26 17:57:23.251046 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.251030    2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gp2xf"
Jul 26 17:57:23.251573 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.251452    2548 factory.go:153] Registering CRI-O factory
Jul 26 17:57:23.251573 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.251469    2548 factory.go:223] Registration of the crio container factory successfully
Jul 26 17:57:23.251573 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.251518    2548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 26 17:57:23.251573 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.251527    2548 factory.go:55] Registering systemd factory
Jul 26 17:57:23.251573 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.251535    2548 factory.go:223] Registration of the systemd container factory successfully
Jul 26 17:57:23.251573 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.251556    2548 factory.go:103] Registering Raw factory
Jul 26 17:57:23.251573 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.251568    2548 manager.go:1196] Started watching for new ooms in manager
Jul 26 17:57:23.252432 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.252417    2548 manager.go:349] Starting recovery of all containers
Jul 26 17:57:23.252707 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.252684    2548 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 26 17:57:23.252786 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.252699    2548 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-214.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 26 17:57:23.256449 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.256425    2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gp2xf"
Jul 26 17:57:23.262325 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.262312    2548 manager.go:354] Recovery completed
Jul 26 17:57:23.266173 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.266162    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 17:57:23.268019 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.268004    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 17:57:23.268072 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.268026    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 17:57:23.268072 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.268036    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientPID"
Jul 26 17:57:23.268605 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.268587    2548 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 26 17:57:23.268674 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.268609    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 17:57:23.268674 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.268611    2548 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 26 17:57:23.268674 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.268629    2548 state_mem.go:36] "Initialized new in-memory state store"
Jul 26 17:57:23.269299 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.269284    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 17:57:23.269351 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.269308    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 17:57:23.269351 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.269317    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientPID"
Jul 26 17:57:23.270092 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.270079    2548 policy_none.go:49] "None policy: Start"
Jul 26 17:57:23.270128 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.270096    2548 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 26 17:57:23.270128 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.270105    2548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 26 17:57:23.271182 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.271171    2548 policy_none.go:47] "Start"
Jul 26 17:57:23.310788 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.310688    2548 manager.go:337] "Starting Device Plugin manager"
Jul 26 17:57:23.310866 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.310820    2548 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 26 17:57:23.310866 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.310830    2548 server.go:87] "Starting device plugin registration server"
Jul 26 17:57:23.311067 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.311054    2548 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 26 17:57:23.311105 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.311071    2548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 26 17:57:23.311176 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.311156    2548 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 26 17:57:23.311284 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.311272    2548 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 26 17:57:23.311340 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.311285    2548 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 26 17:57:23.311672 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.311642    2548 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 26 17:57:23.311765 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.311683    2548 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:23.405978 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.405957    2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 26 17:57:23.407378 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.407030    2548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 26 17:57:23.407378 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.407061    2548 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 26 17:57:23.407378 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.407080    2548 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 26 17:57:23.407378 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.407109    2548 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 26 17:57:23.409143 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.409125    2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 17:57:23.411764 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.411750    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 17:57:23.412448 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.412435    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 17:57:23.412525 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.412462    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 17:57:23.412525 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.412476    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientPID"
Jul 26 17:57:23.412525 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.412496    2548 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.420531 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.420513    2548 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.420581 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.420532    2548 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-214.ec2.internal\": node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:23.433853 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.433799    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:23.507893 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.507868    2548 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal"]
Jul 26 17:57:23.507968 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.507936    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 17:57:23.509619 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.509603    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 17:57:23.509619 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.509628    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 17:57:23.509765 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.509642    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientPID"
Jul 26 17:57:23.511115 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.511102    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 17:57:23.511283 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.511268    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.511356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.511302    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 17:57:23.512621 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.512607    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 17:57:23.512713 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.512632    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 17:57:23.512713 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.512646    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientPID"
Jul 26 17:57:23.512713 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.512649    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 17:57:23.512713 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.512674    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 17:57:23.512713 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.512687    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientPID"
Jul 26 17:57:23.514538 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.514522    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.514620 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.514553    2548 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 26 17:57:23.515336 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.515318    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientMemory"
Jul 26 17:57:23.515429 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.515347    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasNoDiskPressure"
Jul 26 17:57:23.515429 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.515357    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeHasSufficientPID"
Jul 26 17:57:23.534469 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.534454    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:23.547762 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.547748    2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-214.ec2.internal\" not found" node="ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.552170 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.552152    2548 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-214.ec2.internal\" not found" node="ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.553292 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.553276    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34dccaad402f98366bfe218c10feb14e-config\") pod \"kube-apiserver-proxy-ip-10-0-143-214.ec2.internal\" (UID: \"34dccaad402f98366bfe218c10feb14e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.553344 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.553302    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/989c2c85ee48dc65dfa43ce317ec806c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal\" (UID: \"989c2c85ee48dc65dfa43ce317ec806c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.553344 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.553320    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/989c2c85ee48dc65dfa43ce317ec806c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal\" (UID: \"989c2c85ee48dc65dfa43ce317ec806c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.636424 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.636401    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:23.653842 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.653820    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34dccaad402f98366bfe218c10feb14e-config\") pod \"kube-apiserver-proxy-ip-10-0-143-214.ec2.internal\" (UID: \"34dccaad402f98366bfe218c10feb14e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.653892 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.653885    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/989c2c85ee48dc65dfa43ce317ec806c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal\" (UID: \"989c2c85ee48dc65dfa43ce317ec806c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.653927 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.653845    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/989c2c85ee48dc65dfa43ce317ec806c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal\" (UID: \"989c2c85ee48dc65dfa43ce317ec806c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.653961 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.653944    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/34dccaad402f98366bfe218c10feb14e-config\") pod \"kube-apiserver-proxy-ip-10-0-143-214.ec2.internal\" (UID: \"34dccaad402f98366bfe218c10feb14e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.653999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.653946    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/989c2c85ee48dc65dfa43ce317ec806c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal\" (UID: \"989c2c85ee48dc65dfa43ce317ec806c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.653999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.653983    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/989c2c85ee48dc65dfa43ce317ec806c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal\" (UID: \"989c2c85ee48dc65dfa43ce317ec806c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.737574 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.737519    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:23.841931 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.841901    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:23.850404 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.850384    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.855089 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:23.854980    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:23.944478 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:23.944456    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:24.045873 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:24.045816    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:24.146926 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:24.146893    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:24.193147 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.193116    2548 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 26 17:57:24.193538 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.193268    2548 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 26 17:57:24.247130 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:24.247101    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:24.253445 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.253424    2548 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 17:57:24.261114 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.261086    2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-25 17:52:23 +0000 UTC" deadline="2027-12-20 17:30:37.543464232 +0000 UTC"
Jul 26 17:57:24.261114 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.261111    2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12287h33m13.282356327s"
Jul 26 17:57:24.347761 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:24.347717    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:24.448707 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:24.448679    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:24.503229 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:24.503191    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34dccaad402f98366bfe218c10feb14e.slice/crio-b613de441a01463d8fef8d66ccd7d865fc0b0732a2ed0bd2fce312eea8ef5e0d WatchSource:0}: Error finding container b613de441a01463d8fef8d66ccd7d865fc0b0732a2ed0bd2fce312eea8ef5e0d: Status 404 returned error can't find the container with id b613de441a01463d8fef8d66ccd7d865fc0b0732a2ed0bd2fce312eea8ef5e0d
Jul 26 17:57:24.508893 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.508873    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 17:57:24.515105 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:24.515080    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989c2c85ee48dc65dfa43ce317ec806c.slice/crio-9737e0ab202f6a1ec533b06f8e376acb3e86fc413f0987c2f4c0fe2a5eb53fd2 WatchSource:0}: Error finding container 9737e0ab202f6a1ec533b06f8e376acb3e86fc413f0987c2f4c0fe2a5eb53fd2: Status 404 returned error can't find the container with id 9737e0ab202f6a1ec533b06f8e376acb3e86fc413f0987c2f4c0fe2a5eb53fd2
Jul 26 17:57:24.549664 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:24.549641    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:24.650643 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:24.650597    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:24.748751 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.748731    2548 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 17:57:24.750651 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:24.750635    2548 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-214.ec2.internal\" not found"
Jul 26 17:57:24.832985 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.832951    2548 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 17:57:24.851450 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.851425    2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:24.862826 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.862798    2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 17:57:24.864175 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.864159    2548 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal"
Jul 26 17:57:24.878453 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:24.878428    2548 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 26 17:57:25.229381 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.229352    2548 apiserver.go:52] "Watching apiserver"
Jul 26 17:57:25.240758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.240677    2548 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 26 17:57:25.242590 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.242560    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c","openshift-image-registry/node-ca-fxldw","openshift-multus/multus-g8vg9","openshift-network-operator/iptables-alerter-tdvxl","openshift-ovn-kubernetes/ovnkube-node-tb795","kube-system/global-pull-secret-syncer-2t9x2","kube-system/konnectivity-agent-d49rb","openshift-cluster-node-tuning-operator/tuned-8dfzh","openshift-dns/node-resolver-m2knk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal","openshift-multus/multus-additional-cni-plugins-hqsd6","openshift-multus/network-metrics-daemon-kc628","openshift-network-diagnostics/network-check-target-wh8hl"]
Jul 26 17:57:25.245565 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.245541    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.247765 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.247741    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.251018 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.250995    2548 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 26 17:57:25.252010 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.251685    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.252557 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.252498    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 26 17:57:25.253832 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.252758    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xb9tf\""
Jul 26 17:57:25.253832 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.252980    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 26 17:57:25.253832 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.253176    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 26 17:57:25.253832 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.253457    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 26 17:57:25.253832 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.253652    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zlp54\""
Jul 26 17:57:25.253832 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.253822    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 26 17:57:25.255566 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.255388    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n798h\""
Jul 26 17:57:25.256947 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.256246    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.257781 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.257305    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 26 17:57:25.257781 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.257396    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 26 17:57:25.257781 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.257511    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 26 17:57:25.260264 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.259871    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 26 17:57:25.260360 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.260328    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 26 17:57:25.260560 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.260533    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.260949 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.260917    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 26 17:57:25.261043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.260992    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 26 17:57:25.261228 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.261205    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kfj29\""
Jul 26 17:57:25.263030 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.262674    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.263030 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263012    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-host\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.263185 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263046    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-device-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.263185 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263075    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-sysconfig\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.263185 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263099    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-systemd\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.263185 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263121    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-run\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.263185 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263146    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-var-lib-kubelet\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.263185 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263169    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/497906fb-3bfd-4d93-95d5-2208cb59a48e-tmp\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263194    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-socket-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263279    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-etc-selinux\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263320    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-lib-modules\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263360    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-tuned\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263385    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpp55\" (UniqueName: \"kubernetes.io/projected/497906fb-3bfd-4d93-95d5-2208cb59a48e-kube-api-access-kpp55\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263411    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-sys-fs\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263435    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e53c488-9d7d-436a-b723-e574e127a89d-host\") pod \"node-ca-fxldw\" (UID: \"4e53c488-9d7d-436a-b723-e574e127a89d\") " pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263458    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e53c488-9d7d-436a-b723-e574e127a89d-serviceca\") pod \"node-ca-fxldw\" (UID: \"4e53c488-9d7d-436a-b723-e574e127a89d\") " pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263483    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrnk9\" (UniqueName: \"kubernetes.io/projected/4e53c488-9d7d-436a-b723-e574e127a89d-kube-api-access-nrnk9\") pod \"node-ca-fxldw\" (UID: \"4e53c488-9d7d-436a-b723-e574e127a89d\") " pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263509    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-sysctl-d\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.263537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263536    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.264090 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263560    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-registration-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.264090 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263596    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hn6\" (UniqueName: \"kubernetes.io/projected/24d44df5-89de-4da1-afbe-8d477bacff57-kube-api-access-42hn6\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.264090 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263628    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-modprobe-d\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.264090 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263654    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-kubernetes\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.264090 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263677    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-sysctl-conf\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.264090 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.263699    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-sys\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.264090 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.264088    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 26 17:57:25.264553 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.264100    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 26 17:57:25.264553 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.264236    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 26 17:57:25.264553 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.264389    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hsqm4\""
Jul 26 17:57:25.265919 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.265676    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:25.265919 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.265754    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:25.267931 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.267629    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 26 17:57:25.268214 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.268188    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 26 17:57:25.269078 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.269058    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:25.269337 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.269319    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 26 17:57:25.269855 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.269833    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 26 17:57:25.270050 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.270033    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 26 17:57:25.271694 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.271605    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:25.271797 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.271689    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:25.272474 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.272451    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 26 17:57:25.272693 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.272675    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xmhqn\""
Jul 26 17:57:25.273082 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.273064    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 26 17:57:25.273271 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.273251    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4krpb\""
Jul 26 17:57:25.273612 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.273498    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 26 17:57:25.274920 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.274898    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.278006 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.276765    2548 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 26 17:57:25.278006 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.277401    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.278568 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.278547    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rr5cc\""
Jul 26 17:57:25.278815 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.278798    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 26 17:57:25.279072 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.279054    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 26 17:57:25.279812 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.279794    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 26 17:57:25.280215 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.280195    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:25.280364 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.280294    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:25.282311 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.282287    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 26 17:57:25.282554 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.282484    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lrrps\""
Jul 26 17:57:25.311922 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.311898    2548 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pxmbb"
Jul 26 17:57:25.323563 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.323542    2548 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pxmbb"
Jul 26 17:57:25.352114 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.352094    2548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 26 17:57:25.364490 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364466    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgcwn\" (UniqueName: \"kubernetes.io/projected/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-kube-api-access-kgcwn\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.364582 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364509    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-lib-modules\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.364582 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364535    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-sys-fs\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.364582 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364560    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-run-netns\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.364749 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364585    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-node-log\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.364749 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364608    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-run-ovn-kubernetes\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.364749 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364633    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-lib-modules\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.364749 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364635    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-socket-dir-parent\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.364749 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364673    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2070228b-2e6c-4333-932a-a1e47454dcd1-kubelet-config\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:25.364749 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364680    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-sys-fs\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.364749 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364699    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:25.364749 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364742    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364768    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl4m4\" (UniqueName: \"kubernetes.io/projected/e507c91c-f4f8-4818-a74e-c55a9cf05c68-kube-api-access-dl4m4\") pod \"iptables-alerter-tdvxl\" (UID: \"e507c91c-f4f8-4818-a74e-c55a9cf05c68\") " pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364795    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364836    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp495\" (UniqueName: \"kubernetes.io/projected/ee4620ff-6563-4f5b-beb1-35330cd2d74b-kube-api-access-kp495\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364846    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364864    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-run-netns\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364890    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-hostroot\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364935    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364959    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41-tmp-dir\") pod \"node-resolver-m2knk\" (UID: \"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41\") " pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.364982    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-cnibin\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365006    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6pkj\" (UniqueName: \"kubernetes.io/projected/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-kube-api-access-h6pkj\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365030    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-systemd\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365055    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-run\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365103    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-socket-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365095    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-systemd\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.365137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365135    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-systemd-units\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365158    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-system-cni-dir\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365184    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-tuned\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365207    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-cni-bin\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365247    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74zt8\" (UniqueName: \"kubernetes.io/projected/f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41-kube-api-access-74zt8\") pod \"node-resolver-m2knk\" (UID: \"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41\") " pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365263    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-run\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365271    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-cni-dir\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365317    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-os-release\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365341    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-run-k8s-cni-cncf-io\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365371    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-socket-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365376    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hn6\" (UniqueName: \"kubernetes.io/projected/24d44df5-89de-4da1-afbe-8d477bacff57-kube-api-access-42hn6\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365402    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-run-systemd\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365428    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-var-lib-openvswitch\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365457    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-etc-openvswitch\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365492    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-conf-dir\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365545    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-cnibin\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365571    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vts2q\" (UniqueName: \"kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q\") pod \"network-check-target-wh8hl\" (UID: \"f5d13033-571c-4a39-b7dd-bba32f99bedf\") " pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:25.365914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365597    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-host\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365624    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-run-openvswitch\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365624    2548 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365649    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bb86453-c54c-4492-bc0c-4dbab9008b74-env-overrides\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365689    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-var-lib-kubelet\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365714    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365742    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365770    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrnk9\" (UniqueName: \"kubernetes.io/projected/4e53c488-9d7d-436a-b723-e574e127a89d-kube-api-access-nrnk9\") pod \"node-ca-fxldw\" (UID: \"4e53c488-9d7d-436a-b723-e574e127a89d\") " pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365796    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e507c91c-f4f8-4818-a74e-c55a9cf05c68-host-slash\") pod \"iptables-alerter-tdvxl\" (UID: \"e507c91c-f4f8-4818-a74e-c55a9cf05c68\") " pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365820    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-log-socket\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365846    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e507c91c-f4f8-4818-a74e-c55a9cf05c68-iptables-alerter-script\") pod \"iptables-alerter-tdvxl\" (UID: \"e507c91c-f4f8-4818-a74e-c55a9cf05c68\") " pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365871    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-var-lib-cni-bin\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.365975    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-etc-kubernetes\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366009    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-host\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366007    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2070228b-2e6c-4333-932a-a1e47454dcd1-dbus\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366208    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-system-cni-dir\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366284    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-sysctl-d\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.366874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366328    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d4e0e33-7a18-4435-9763-c64fa9f936b6-konnectivity-ca\") pod \"konnectivity-agent-d49rb\" (UID: \"7d4e0e33-7a18-4435-9763-c64fa9f936b6\") " pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366355    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-os-release\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366389    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-modprobe-d\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366413    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-kubernetes\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366444    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-sysctl-conf\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366472    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-sys\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366527    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-device-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366555    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-var-lib-cni-multus\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366566    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-sys\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366602    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-var-lib-kubelet\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366631    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/497906fb-3bfd-4d93-95d5-2208cb59a48e-tmp\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366702    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-etc-selinux\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366726    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-var-lib-kubelet\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366729    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e53c488-9d7d-436a-b723-e574e127a89d-serviceca\") pod \"node-ca-fxldw\" (UID: \"4e53c488-9d7d-436a-b723-e574e127a89d\") " pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366775    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d4e0e33-7a18-4435-9763-c64fa9f936b6-agent-certs\") pod \"konnectivity-agent-d49rb\" (UID: \"7d4e0e33-7a18-4435-9763-c64fa9f936b6\") " pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366802    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpp55\" (UniqueName: \"kubernetes.io/projected/497906fb-3bfd-4d93-95d5-2208cb59a48e-kube-api-access-kpp55\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366809    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-sysctl-conf\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.367758 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366850    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e53c488-9d7d-436a-b723-e574e127a89d-host\") pod \"node-ca-fxldw\" (UID: \"4e53c488-9d7d-436a-b723-e574e127a89d\") " pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366878    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bb86453-c54c-4492-bc0c-4dbab9008b74-ovn-node-metrics-cert\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366904    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41-hosts-file\") pod \"node-resolver-m2knk\" (UID: \"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41\") " pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366934    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366962    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-registration-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366987    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-slash\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367192    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e53c488-9d7d-436a-b723-e574e127a89d-serviceca\") pod \"node-ca-fxldw\" (UID: \"4e53c488-9d7d-436a-b723-e574e127a89d\") " pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367208    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-modprobe-d\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367298    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-device-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367313    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-registration-dir\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367350    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24d44df5-89de-4da1-afbe-8d477bacff57-etc-selinux\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.366702    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-sysctl-d\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367365    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-kubelet\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367372    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-kubernetes\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367407    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-run-ovn\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367415    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e53c488-9d7d-436a-b723-e574e127a89d-host\") pod \"node-ca-fxldw\" (UID: \"4e53c488-9d7d-436a-b723-e574e127a89d\") " pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367439    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-cni-netd\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.368773 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367480    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.369742 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367517    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-daemon-config\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.369742 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367545    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-run-multus-certs\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.369742 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367585    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-sysconfig\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.369742 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367644    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bb86453-c54c-4492-bc0c-4dbab9008b74-ovnkube-config\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.369742 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367652    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-sysconfig\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.369742 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367681    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bb86453-c54c-4492-bc0c-4dbab9008b74-ovnkube-script-lib\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.369742 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367713    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6w8c\" (UniqueName: \"kubernetes.io/projected/3bb86453-c54c-4492-bc0c-4dbab9008b74-kube-api-access-f6w8c\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.369742 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.367739    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-cni-binary-copy\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.370858 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.370806    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/497906fb-3bfd-4d93-95d5-2208cb59a48e-etc-tuned\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.373518 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.373476    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/497906fb-3bfd-4d93-95d5-2208cb59a48e-tmp\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.379005 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.378944    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpp55\" (UniqueName: \"kubernetes.io/projected/497906fb-3bfd-4d93-95d5-2208cb59a48e-kube-api-access-kpp55\") pod \"tuned-8dfzh\" (UID: \"497906fb-3bfd-4d93-95d5-2208cb59a48e\") " pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.383029 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.382994    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrnk9\" (UniqueName: \"kubernetes.io/projected/4e53c488-9d7d-436a-b723-e574e127a89d-kube-api-access-nrnk9\") pod \"node-ca-fxldw\" (UID: \"4e53c488-9d7d-436a-b723-e574e127a89d\") " pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.383699 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.383677    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hn6\" (UniqueName: \"kubernetes.io/projected/24d44df5-89de-4da1-afbe-8d477bacff57-kube-api-access-42hn6\") pod \"aws-ebs-csi-driver-node-vrx2c\" (UID: \"24d44df5-89de-4da1-afbe-8d477bacff57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.414530 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.414488    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal" event={"ID":"989c2c85ee48dc65dfa43ce317ec806c","Type":"ContainerStarted","Data":"9737e0ab202f6a1ec533b06f8e376acb3e86fc413f0987c2f4c0fe2a5eb53fd2"}
Jul 26 17:57:25.416871 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.416843    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal" event={"ID":"34dccaad402f98366bfe218c10feb14e","Type":"ContainerStarted","Data":"b613de441a01463d8fef8d66ccd7d865fc0b0732a2ed0bd2fce312eea8ef5e0d"}
Jul 26 17:57:25.468534 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468500    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-cni-dir\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.468534 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468542    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-os-release\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.468714 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468568    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-run-k8s-cni-cncf-io\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.468714 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468590    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-run-systemd\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.468714 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468614    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-var-lib-openvswitch\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.468714 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468643    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-etc-openvswitch\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.468714 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468667    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-conf-dir\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.468714 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468677    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-cni-dir\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.468714 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468689    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-cnibin\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.468714 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468713    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts2q\" (UniqueName: \"kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q\") pod \"network-check-target-wh8hl\" (UID: \"f5d13033-571c-4a39-b7dd-bba32f99bedf\") " pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468743    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-run-openvswitch\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468764    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bb86453-c54c-4492-bc0c-4dbab9008b74-env-overrides\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468788    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-var-lib-kubelet\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468795    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-os-release\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468802    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468838    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468889    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e507c91c-f4f8-4818-a74e-c55a9cf05c68-host-slash\") pod \"iptables-alerter-tdvxl\" (UID: \"e507c91c-f4f8-4818-a74e-c55a9cf05c68\") " pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468925    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-log-socket\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468933    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468951    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e507c91c-f4f8-4818-a74e-c55a9cf05c68-iptables-alerter-script\") pod \"iptables-alerter-tdvxl\" (UID: \"e507c91c-f4f8-4818-a74e-c55a9cf05c68\") " pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468978    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-var-lib-cni-bin\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468996    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-etc-openvswitch\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469004    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-etc-kubernetes\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469028    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2070228b-2e6c-4333-932a-a1e47454dcd1-dbus\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469037    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-conf-dir\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469064    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-system-cni-dir\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.469154 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469114    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d4e0e33-7a18-4435-9763-c64fa9f936b6-konnectivity-ca\") pod \"konnectivity-agent-d49rb\" (UID: \"7d4e0e33-7a18-4435-9763-c64fa9f936b6\") " pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469142    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-os-release\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469180    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-var-lib-cni-multus\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469209    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d4e0e33-7a18-4435-9763-c64fa9f936b6-agent-certs\") pod \"konnectivity-agent-d49rb\" (UID: \"7d4e0e33-7a18-4435-9763-c64fa9f936b6\") " pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469268    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bb86453-c54c-4492-bc0c-4dbab9008b74-ovn-node-metrics-cert\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469309    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-run-openvswitch\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.468741    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-var-lib-openvswitch\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469304    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-var-lib-cni-bin\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469338    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e507c91c-f4f8-4818-a74e-c55a9cf05c68-host-slash\") pod \"iptables-alerter-tdvxl\" (UID: \"e507c91c-f4f8-4818-a74e-c55a9cf05c68\") " pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469353    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-log-socket\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469374    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-var-lib-cni-multus\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469389    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-var-lib-kubelet\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469405    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-run-systemd\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469436    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41-hosts-file\") pod \"node-resolver-m2knk\" (UID: \"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41\") " pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469439    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2070228b-2e6c-4333-932a-a1e47454dcd1-dbus\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469465    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469488    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-cnibin\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.470943 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469510    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-slash\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469531    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-run-k8s-cni-cncf-io\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469538    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-kubelet\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469576    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-etc-kubernetes\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469618    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-run-ovn\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469626    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-system-cni-dir\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469658    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-cni-netd\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469711    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469740    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-daemon-config\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469793    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-run-multus-certs\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469846    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bb86453-c54c-4492-bc0c-4dbab9008b74-ovnkube-config\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469870    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bb86453-c54c-4492-bc0c-4dbab9008b74-ovnkube-script-lib\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469924    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6w8c\" (UniqueName: \"kubernetes.io/projected/3bb86453-c54c-4492-bc0c-4dbab9008b74-kube-api-access-f6w8c\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469977    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-cni-binary-copy\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.470003    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgcwn\" (UniqueName: \"kubernetes.io/projected/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-kube-api-access-kgcwn\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.470026    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.470005    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bb86453-c54c-4492-bc0c-4dbab9008b74-env-overrides\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.471734 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471593    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-run-netns\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471667    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-node-log\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471699    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-run-ovn-kubernetes\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471756    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-socket-dir-parent\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471792    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2070228b-2e6c-4333-932a-a1e47454dcd1-kubelet-config\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471826    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471866    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl4m4\" (UniqueName: \"kubernetes.io/projected/e507c91c-f4f8-4818-a74e-c55a9cf05c68-kube-api-access-dl4m4\") pod \"iptables-alerter-tdvxl\" (UID: \"e507c91c-f4f8-4818-a74e-c55a9cf05c68\") " pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471890    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471934    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp495\" (UniqueName: \"kubernetes.io/projected/ee4620ff-6563-4f5b-beb1-35330cd2d74b-kube-api-access-kp495\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471957    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-run-netns\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.471999    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-hostroot\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472026    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472071    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41-tmp-dir\") pod \"node-resolver-m2knk\" (UID: \"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41\") " pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472104    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-cnibin\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472150    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6pkj\" (UniqueName: \"kubernetes.io/projected/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-kube-api-access-h6pkj\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472203    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-systemd-units\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472252    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e507c91c-f4f8-4818-a74e-c55a9cf05c68-iptables-alerter-script\") pod \"iptables-alerter-tdvxl\" (UID: \"e507c91c-f4f8-4818-a74e-c55a9cf05c68\") " pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.472607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472284    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-system-cni-dir\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.473405 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472321    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-cni-bin\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.473405 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472354    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74zt8\" (UniqueName: \"kubernetes.io/projected/f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41-kube-api-access-74zt8\") pod \"node-resolver-m2knk\" (UID: \"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41\") " pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.473405 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472631    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-run-netns\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.473405 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472700    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-node-log\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.473405 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472747    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-run-ovn-kubernetes\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.473405 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472807    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-socket-dir-parent\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.473405 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472888    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-hostroot\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.473405 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.472935    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:25.473405 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472964    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2070228b-2e6c-4333-932a-a1e47454dcd1-kubelet-config\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:25.473405 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.473047    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret podName:2070228b-2e6c-4333-932a-a1e47454dcd1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:25.972987845 +0000 UTC m=+3.073240726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret") pod "global-pull-secret-syncer-2t9x2" (UID: "2070228b-2e6c-4333-932a-a1e47454dcd1") : object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:25.473870 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.473409    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:25.473870 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.473462    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs podName:ee4620ff-6563-4f5b-beb1-35330cd2d74b nodeName:}" failed. No retries permitted until 2026-07-26 17:57:25.973444482 +0000 UTC m=+3.073697362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs") pod "network-metrics-daemon-kc628" (UID: "ee4620ff-6563-4f5b-beb1-35330cd2d74b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:25.473870 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.473463    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.473870 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.473798    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41-tmp-dir\") pod \"node-resolver-m2knk\" (UID: \"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41\") " pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.473870 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.473838    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-systemd-units\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.474166 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.473914    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-cnibin\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.474166 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.472202    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41-hosts-file\") pod \"node-resolver-m2knk\" (UID: \"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41\") " pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.474262 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.474177    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-system-cni-dir\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.474262 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.474198    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-cni-bin\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.474380 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.474291    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-run-ovn\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.474380 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.469511    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-os-release\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.474380 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.474362    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-kubelet\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.474624    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-host-run-multus-certs\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.474744    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-multus-daemon-config\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.474831    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-slash\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.474941    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-cni-netd\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.475019    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.475313    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bb86453-c54c-4492-bc0c-4dbab9008b74-host-run-netns\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.475459    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.475548    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bb86453-c54c-4492-bc0c-4dbab9008b74-ovnkube-config\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.475654    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d4e0e33-7a18-4435-9763-c64fa9f936b6-konnectivity-ca\") pod \"konnectivity-agent-d49rb\" (UID: \"7d4e0e33-7a18-4435-9763-c64fa9f936b6\") " pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.475886    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-cni-binary-copy\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.477356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.476015    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bb86453-c54c-4492-bc0c-4dbab9008b74-ovnkube-script-lib\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.477965 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.477374    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d4e0e33-7a18-4435-9763-c64fa9f936b6-agent-certs\") pod \"konnectivity-agent-d49rb\" (UID: \"7d4e0e33-7a18-4435-9763-c64fa9f936b6\") " pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:25.480706 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.480638    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bb86453-c54c-4492-bc0c-4dbab9008b74-ovn-node-metrics-cert\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.486630 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.486598    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 17:57:25.486630 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.486626    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 17:57:25.486802 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.486641    2548 projected.go:196] Error preparing data for projected volume kube-api-access-vts2q for pod openshift-network-diagnostics/network-check-target-wh8hl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:25.486802 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.486702    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q podName:f5d13033-571c-4a39-b7dd-bba32f99bedf nodeName:}" failed. No retries permitted until 2026-07-26 17:57:25.986684947 +0000 UTC m=+3.086937818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vts2q" (UniqueName: "kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q") pod "network-check-target-wh8hl" (UID: "f5d13033-571c-4a39-b7dd-bba32f99bedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:25.490411 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.490367    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp495\" (UniqueName: \"kubernetes.io/projected/ee4620ff-6563-4f5b-beb1-35330cd2d74b-kube-api-access-kp495\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:25.491866 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.491841    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl4m4\" (UniqueName: \"kubernetes.io/projected/e507c91c-f4f8-4818-a74e-c55a9cf05c68-kube-api-access-dl4m4\") pod \"iptables-alerter-tdvxl\" (UID: \"e507c91c-f4f8-4818-a74e-c55a9cf05c68\") " pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.492410 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.492385    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6pkj\" (UniqueName: \"kubernetes.io/projected/0e59a67a-2bd0-45fa-9d21-d8d4372f50b6-kube-api-access-h6pkj\") pod \"multus-g8vg9\" (UID: \"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6\") " pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.493280 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.493230    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74zt8\" (UniqueName: \"kubernetes.io/projected/f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41-kube-api-access-74zt8\") pod \"node-resolver-m2knk\" (UID: \"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41\") " pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.493953 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.493927    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgcwn\" (UniqueName: \"kubernetes.io/projected/c48ecf55-4a22-4d68-8455-a9226dc2f3c4-kube-api-access-kgcwn\") pod \"multus-additional-cni-plugins-hqsd6\" (UID: \"c48ecf55-4a22-4d68-8455-a9226dc2f3c4\") " pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.494515 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.494491    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6w8c\" (UniqueName: \"kubernetes.io/projected/3bb86453-c54c-4492-bc0c-4dbab9008b74-kube-api-access-f6w8c\") pod \"ovnkube-node-tb795\" (UID: \"3bb86453-c54c-4492-bc0c-4dbab9008b74\") " pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.506373 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.506350    2548 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 26 17:57:25.562081 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.562058    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8dfzh"
Jul 26 17:57:25.575390 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.575369    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c"
Jul 26 17:57:25.589288 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.589262    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fxldw"
Jul 26 17:57:25.597249 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.597230    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m2knk"
Jul 26 17:57:25.606025 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.606007    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g8vg9"
Jul 26 17:57:25.615753 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.615733    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tdvxl"
Jul 26 17:57:25.623736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.623717    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:25.632519 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.632499    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:25.638251 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.638218    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hqsd6"
Jul 26 17:57:25.976541 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.976463    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:25.976541 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:25.976496    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:25.976731 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.976603    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:25.976731 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.976635    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:25.976731 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.976672    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs podName:ee4620ff-6563-4f5b-beb1-35330cd2d74b nodeName:}" failed. No retries permitted until 2026-07-26 17:57:26.97665217 +0000 UTC m=+4.076905037 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs") pod "network-metrics-daemon-kc628" (UID: "ee4620ff-6563-4f5b-beb1-35330cd2d74b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:25.976731 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:25.976702    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret podName:2070228b-2e6c-4333-932a-a1e47454dcd1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:26.976693333 +0000 UTC m=+4.076946198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret") pod "global-pull-secret-syncer-2t9x2" (UID: "2070228b-2e6c-4333-932a-a1e47454dcd1") : object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:26.077566 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:26.077526    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts2q\" (UniqueName: \"kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q\") pod \"network-check-target-wh8hl\" (UID: \"f5d13033-571c-4a39-b7dd-bba32f99bedf\") " pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:26.077747 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:26.077689    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 17:57:26.077747 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:26.077716    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 17:57:26.077747 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:26.077728    2548 projected.go:196] Error preparing data for projected volume kube-api-access-vts2q for pod openshift-network-diagnostics/network-check-target-wh8hl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:26.077916 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:26.077794    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q podName:f5d13033-571c-4a39-b7dd-bba32f99bedf nodeName:}" failed. No retries permitted until 2026-07-26 17:57:27.07777361 +0000 UTC m=+4.178026495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vts2q" (UniqueName: "kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q") pod "network-check-target-wh8hl" (UID: "f5d13033-571c-4a39-b7dd-bba32f99bedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:26.326937 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:26.326855    2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 17:52:25 +0000 UTC" deadline="2028-04-29 06:58:30.1240882 +0000 UTC"
Jul 26 17:57:26.326937 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:26.326885    2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15421h1m3.797206096s"
Jul 26 17:57:26.621792 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:26.621767    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497906fb_3bfd_4d93_95d5_2208cb59a48e.slice/crio-a0dfb015ae828c333f19dc189cb7dec834f125825a262c34063e8478727cecc3 WatchSource:0}: Error finding container a0dfb015ae828c333f19dc189cb7dec834f125825a262c34063e8478727cecc3: Status 404 returned error can't find the container with id a0dfb015ae828c333f19dc189cb7dec834f125825a262c34063e8478727cecc3
Jul 26 17:57:26.623697 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:26.623541    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48ecf55_4a22_4d68_8455_a9226dc2f3c4.slice/crio-f3e756979003b3b701ba2dccdd3f35e88b0bf039434a35875b0224c6fe88af1b WatchSource:0}: Error finding container f3e756979003b3b701ba2dccdd3f35e88b0bf039434a35875b0224c6fe88af1b: Status 404 returned error can't find the container with id f3e756979003b3b701ba2dccdd3f35e88b0bf039434a35875b0224c6fe88af1b
Jul 26 17:57:26.626562 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:26.626535    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4e0e33_7a18_4435_9763_c64fa9f936b6.slice/crio-ce626a1b09bc9a4fd62e00115d39813272aa4fb7739db1fbf15182849025ef11 WatchSource:0}: Error finding container ce626a1b09bc9a4fd62e00115d39813272aa4fb7739db1fbf15182849025ef11: Status 404 returned error can't find the container with id ce626a1b09bc9a4fd62e00115d39813272aa4fb7739db1fbf15182849025ef11
Jul 26 17:57:26.627775 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:26.627751    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode507c91c_f4f8_4818_a74e_c55a9cf05c68.slice/crio-4c4cd19e6dcf339b23737d0f8841b3e58ab8f4e73246871694995e9d28da5996 WatchSource:0}: Error finding container 4c4cd19e6dcf339b23737d0f8841b3e58ab8f4e73246871694995e9d28da5996: Status 404 returned error can't find the container with id 4c4cd19e6dcf339b23737d0f8841b3e58ab8f4e73246871694995e9d28da5996
Jul 26 17:57:26.628551 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:26.628530    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d44df5_89de_4da1_afbe_8d477bacff57.slice/crio-f7a3c3ba73ada82210838721f893accff783706e194e457ab8a462d072969056 WatchSource:0}: Error finding container f7a3c3ba73ada82210838721f893accff783706e194e457ab8a462d072969056: Status 404 returned error can't find the container with id f7a3c3ba73ada82210838721f893accff783706e194e457ab8a462d072969056
Jul 26 17:57:26.652098 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:26.652055    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e6ef63_c5e9_42c8_a565_d3ef9c5d5e41.slice/crio-828c63774ed9712602507290171a1e0a0d7c1a0e736f4362b50750430270c1c1 WatchSource:0}: Error finding container 828c63774ed9712602507290171a1e0a0d7c1a0e736f4362b50750430270c1c1: Status 404 returned error can't find the container with id 828c63774ed9712602507290171a1e0a0d7c1a0e736f4362b50750430270c1c1
Jul 26 17:57:26.653115 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:26.653094    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb86453_c54c_4492_bc0c_4dbab9008b74.slice/crio-bfa28c8840dbe1fcc03b3f8dfd949e16836caf7898e9c3a66bb5019771430b56 WatchSource:0}: Error finding container bfa28c8840dbe1fcc03b3f8dfd949e16836caf7898e9c3a66bb5019771430b56: Status 404 returned error can't find the container with id bfa28c8840dbe1fcc03b3f8dfd949e16836caf7898e9c3a66bb5019771430b56
Jul 26 17:57:26.654408 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:26.654260    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e59a67a_2bd0_45fa_9d21_d8d4372f50b6.slice/crio-48d947c091478a00a1be745d87fedfc7113f9582454782a472d613b63187a3f3 WatchSource:0}: Error finding container 48d947c091478a00a1be745d87fedfc7113f9582454782a472d613b63187a3f3: Status 404 returned error can't find the container with id 48d947c091478a00a1be745d87fedfc7113f9582454782a472d613b63187a3f3
Jul 26 17:57:26.656439 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:26.656417    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e53c488_9d7d_436a_b723_e574e127a89d.slice/crio-54727f3f2049fc6796f5090c02025de9a107bdd74f34df9bdf66a23ad3b17070 WatchSource:0}: Error finding container 54727f3f2049fc6796f5090c02025de9a107bdd74f34df9bdf66a23ad3b17070: Status 404 returned error can't find the container with id 54727f3f2049fc6796f5090c02025de9a107bdd74f34df9bdf66a23ad3b17070
Jul 26 17:57:26.983497 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:26.983343    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:26.983629 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:26.983494    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:26.983629 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:26.983515    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:26.983629 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:26.983565    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret podName:2070228b-2e6c-4333-932a-a1e47454dcd1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:28.983541705 +0000 UTC m=+6.083794588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret") pod "global-pull-secret-syncer-2t9x2" (UID: "2070228b-2e6c-4333-932a-a1e47454dcd1") : object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:26.983629 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:26.983623    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:26.983797 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:26.983683    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs podName:ee4620ff-6563-4f5b-beb1-35330cd2d74b nodeName:}" failed. No retries permitted until 2026-07-26 17:57:28.983662887 +0000 UTC m=+6.083915757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs") pod "network-metrics-daemon-kc628" (UID: "ee4620ff-6563-4f5b-beb1-35330cd2d74b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:27.084383 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.084347    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts2q\" (UniqueName: \"kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q\") pod \"network-check-target-wh8hl\" (UID: \"f5d13033-571c-4a39-b7dd-bba32f99bedf\") " pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:27.084569 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:27.084551    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 17:57:27.084641 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:27.084578    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 17:57:27.084641 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:27.084591    2548 projected.go:196] Error preparing data for projected volume kube-api-access-vts2q for pod openshift-network-diagnostics/network-check-target-wh8hl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:27.084749 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:27.084652    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q podName:f5d13033-571c-4a39-b7dd-bba32f99bedf nodeName:}" failed. No retries permitted until 2026-07-26 17:57:29.084630247 +0000 UTC m=+6.184883115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vts2q" (UniqueName: "kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q") pod "network-check-target-wh8hl" (UID: "f5d13033-571c-4a39-b7dd-bba32f99bedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:27.327772 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.327621    2548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-25 17:52:25 +0000 UTC" deadline="2028-01-02 01:22:32.006333629 +0000 UTC"
Jul 26 17:57:27.327772 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.327689    2548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12583h25m4.678649208s"
Jul 26 17:57:27.412253 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.412223    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:27.412436 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:27.412375    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:27.412836 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.412815    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:27.412946 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:27.412916    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:27.413015 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.412985    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:27.413089 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:27.413069    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:27.431490 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.431459    2548 generic.go:356] "Generic (PLEG): container finished" podID="989c2c85ee48dc65dfa43ce317ec806c" containerID="ce5c0daa017b52c336ac94f115b69a9c2cd204836d675d657eaee731cefb4b3d" exitCode=0
Jul 26 17:57:27.431622 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.431542    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal" event={"ID":"989c2c85ee48dc65dfa43ce317ec806c","Type":"ContainerDied","Data":"ce5c0daa017b52c336ac94f115b69a9c2cd204836d675d657eaee731cefb4b3d"}
Jul 26 17:57:27.452523 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.452492    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c" event={"ID":"24d44df5-89de-4da1-afbe-8d477bacff57","Type":"ContainerStarted","Data":"f7a3c3ba73ada82210838721f893accff783706e194e457ab8a462d072969056"}
Jul 26 17:57:27.469634 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.469579    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g8vg9" event={"ID":"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6","Type":"ContainerStarted","Data":"48d947c091478a00a1be745d87fedfc7113f9582454782a472d613b63187a3f3"}
Jul 26 17:57:27.476103 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.476077    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tdvxl" event={"ID":"e507c91c-f4f8-4818-a74e-c55a9cf05c68","Type":"ContainerStarted","Data":"4c4cd19e6dcf339b23737d0f8841b3e58ab8f4e73246871694995e9d28da5996"}
Jul 26 17:57:27.486356 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.486333    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d49rb" event={"ID":"7d4e0e33-7a18-4435-9763-c64fa9f936b6","Type":"ContainerStarted","Data":"ce626a1b09bc9a4fd62e00115d39813272aa4fb7739db1fbf15182849025ef11"}
Jul 26 17:57:27.488237 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.488211    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsd6" event={"ID":"c48ecf55-4a22-4d68-8455-a9226dc2f3c4","Type":"ContainerStarted","Data":"f3e756979003b3b701ba2dccdd3f35e88b0bf039434a35875b0224c6fe88af1b"}
Jul 26 17:57:27.511620 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.511592    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal" event={"ID":"34dccaad402f98366bfe218c10feb14e","Type":"ContainerStarted","Data":"24c5586936826a0624a1527db3345009676a834817e60cff33c82e1b56398ac2"}
Jul 26 17:57:27.531369 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.531319    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fxldw" event={"ID":"4e53c488-9d7d-436a-b723-e574e127a89d","Type":"ContainerStarted","Data":"54727f3f2049fc6796f5090c02025de9a107bdd74f34df9bdf66a23ad3b17070"}
Jul 26 17:57:27.542956 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.542930    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb795" event={"ID":"3bb86453-c54c-4492-bc0c-4dbab9008b74","Type":"ContainerStarted","Data":"bfa28c8840dbe1fcc03b3f8dfd949e16836caf7898e9c3a66bb5019771430b56"}
Jul 26 17:57:27.552031 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.552006    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m2knk" event={"ID":"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41","Type":"ContainerStarted","Data":"828c63774ed9712602507290171a1e0a0d7c1a0e736f4362b50750430270c1c1"}
Jul 26 17:57:27.561104 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:27.561077    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8dfzh" event={"ID":"497906fb-3bfd-4d93-95d5-2208cb59a48e","Type":"ContainerStarted","Data":"a0dfb015ae828c333f19dc189cb7dec834f125825a262c34063e8478727cecc3"}
Jul 26 17:57:28.613311 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:28.611123    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal" event={"ID":"989c2c85ee48dc65dfa43ce317ec806c","Type":"ContainerStarted","Data":"6dd5a324fef522edf04b5f6d906a33d3eb9f793e580210564c6ebe98e66cabd4"}
Jul 26 17:57:28.626152 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:28.626088    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-214.ec2.internal" podStartSLOduration=3.626068278 podStartE2EDuration="3.626068278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:27.527634316 +0000 UTC m=+4.627887224" watchObservedRunningTime="2026-07-26 17:57:28.626068278 +0000 UTC m=+5.726321171"
Jul 26 17:57:29.003411 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:29.003331    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:29.003411 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:29.003388    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:29.003643 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.003541    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:29.003704 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.003676    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs podName:ee4620ff-6563-4f5b-beb1-35330cd2d74b nodeName:}" failed. No retries permitted until 2026-07-26 17:57:33.003583482 +0000 UTC m=+10.103836367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs") pod "network-metrics-daemon-kc628" (UID: "ee4620ff-6563-4f5b-beb1-35330cd2d74b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:29.004145 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.004110    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:29.004255 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.004171    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret podName:2070228b-2e6c-4333-932a-a1e47454dcd1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:33.004153699 +0000 UTC m=+10.104406570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret") pod "global-pull-secret-syncer-2t9x2" (UID: "2070228b-2e6c-4333-932a-a1e47454dcd1") : object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:29.104979 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:29.104346    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts2q\" (UniqueName: \"kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q\") pod \"network-check-target-wh8hl\" (UID: \"f5d13033-571c-4a39-b7dd-bba32f99bedf\") " pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:29.104979 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.104554    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 17:57:29.104979 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.104578    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 17:57:29.104979 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.104591    2548 projected.go:196] Error preparing data for projected volume kube-api-access-vts2q for pod openshift-network-diagnostics/network-check-target-wh8hl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:29.104979 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.104645    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q podName:f5d13033-571c-4a39-b7dd-bba32f99bedf nodeName:}" failed. No retries permitted until 2026-07-26 17:57:33.104628548 +0000 UTC m=+10.204881414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vts2q" (UniqueName: "kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q") pod "network-check-target-wh8hl" (UID: "f5d13033-571c-4a39-b7dd-bba32f99bedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:29.408200 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:29.408120    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:29.408389 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.408280    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:29.408693 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:29.408670    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:29.408839 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.408791    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:29.408902 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:29.408865    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:29.408997 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:29.408957    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:31.410731 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:31.410659    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:31.410731 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:31.410681    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:31.411225 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:31.410788    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:31.411225 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:31.410818    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:31.411225 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:31.410877    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:31.411225 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:31.410968    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:33.035938 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:33.035908    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:33.035938 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:33.035944    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:33.036545 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.036054    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:33.036545 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.036123    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret podName:2070228b-2e6c-4333-932a-a1e47454dcd1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:41.03610469 +0000 UTC m=+18.136357576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret") pod "global-pull-secret-syncer-2t9x2" (UID: "2070228b-2e6c-4333-932a-a1e47454dcd1") : object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:33.036545 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.036054    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:33.036545 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.036213    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs podName:ee4620ff-6563-4f5b-beb1-35330cd2d74b nodeName:}" failed. No retries permitted until 2026-07-26 17:57:41.036184869 +0000 UTC m=+18.136437735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs") pod "network-metrics-daemon-kc628" (UID: "ee4620ff-6563-4f5b-beb1-35330cd2d74b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:33.137416 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:33.136837    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts2q\" (UniqueName: \"kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q\") pod \"network-check-target-wh8hl\" (UID: \"f5d13033-571c-4a39-b7dd-bba32f99bedf\") " pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:33.137416 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.137011    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 17:57:33.137416 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.137030    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 17:57:33.137416 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.137042    2548 projected.go:196] Error preparing data for projected volume kube-api-access-vts2q for pod openshift-network-diagnostics/network-check-target-wh8hl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:33.137416 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.137097    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q podName:f5d13033-571c-4a39-b7dd-bba32f99bedf nodeName:}" failed. No retries permitted until 2026-07-26 17:57:41.137079281 +0000 UTC m=+18.237332163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vts2q" (UniqueName: "kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q") pod "network-check-target-wh8hl" (UID: "f5d13033-571c-4a39-b7dd-bba32f99bedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:33.409755 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:33.409001    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:33.409755 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.409105    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:33.409755 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:33.409464    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:33.409755 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.409567    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:33.409755 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:33.409608    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:33.409755 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:33.409675    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:35.407332 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:35.407300    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:35.407784 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:35.407300    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:35.407784 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:35.407496    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:35.407898 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:35.407828    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:35.407947 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:35.407925    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:35.408046 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:35.408023    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:37.407408 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:37.407326    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:37.407841 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:37.407335    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:37.407841 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:37.407447    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:37.407841 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:37.407335    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:37.407841 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:37.407519    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:37.407841 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:37.407607    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:39.408202 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:39.408158    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:39.408202 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:39.408186    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:39.408736 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:39.408158    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:39.408736 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:39.408300    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:39.408736 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:39.408380    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:39.408736 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:39.408467    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:41.104461 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:41.104423    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:41.105003 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:41.104476    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:41.105003 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.104536    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:41.105003 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.104600    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret podName:2070228b-2e6c-4333-932a-a1e47454dcd1 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:57.104584582 +0000 UTC m=+34.204837448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret") pod "global-pull-secret-syncer-2t9x2" (UID: "2070228b-2e6c-4333-932a-a1e47454dcd1") : object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:41.105003 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.104636    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:41.105003 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.104702    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs podName:ee4620ff-6563-4f5b-beb1-35330cd2d74b nodeName:}" failed. No retries permitted until 2026-07-26 17:57:57.104683962 +0000 UTC m=+34.204936844 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs") pod "network-metrics-daemon-kc628" (UID: "ee4620ff-6563-4f5b-beb1-35330cd2d74b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:41.204907 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:41.204879    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts2q\" (UniqueName: \"kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q\") pod \"network-check-target-wh8hl\" (UID: \"f5d13033-571c-4a39-b7dd-bba32f99bedf\") " pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:41.205088 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.204994    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 17:57:41.205088 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.205016    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 17:57:41.205088 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.205031    2548 projected.go:196] Error preparing data for projected volume kube-api-access-vts2q for pod openshift-network-diagnostics/network-check-target-wh8hl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:41.205088 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.205080    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q podName:f5d13033-571c-4a39-b7dd-bba32f99bedf nodeName:}" failed. No retries permitted until 2026-07-26 17:57:57.205066307 +0000 UTC m=+34.305319185 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vts2q" (UniqueName: "kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q") pod "network-check-target-wh8hl" (UID: "f5d13033-571c-4a39-b7dd-bba32f99bedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:41.407532 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:41.407450    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:41.407532 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:41.407495    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:41.407732 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:41.407450    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:41.407732 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.407572    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:41.407732 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.407654    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:41.407732 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:41.407722    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:43.408533 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:43.408490    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:43.409020 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:43.408615    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:43.409020 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:43.408711    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:43.409020 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:43.408798    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:43.409020 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:43.408825    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:43.409020 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:43.408881    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:45.408547 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.408266    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:45.409135 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.408275    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:45.409135 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:45.408623    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:45.409135 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:45.408707    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:45.409135 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.408281    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:45.409135 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:45.408820    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:45.656333 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.656303    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c" event={"ID":"24d44df5-89de-4da1-afbe-8d477bacff57","Type":"ContainerStarted","Data":"25d2d53ba4d0aef3465b7a33c9ed979965163201b0fa62bceb7a6bf3930a6a4d"}
Jul 26 17:57:45.657914 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.657882    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g8vg9" event={"ID":"0e59a67a-2bd0-45fa-9d21-d8d4372f50b6","Type":"ContainerStarted","Data":"3e134d54462f9336773b7363f24daab1c99fffaa6c3d01953d1e89c19ff0c95b"}
Jul 26 17:57:45.659411 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.659387    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d49rb" event={"ID":"7d4e0e33-7a18-4435-9763-c64fa9f936b6","Type":"ContainerStarted","Data":"e5aa84c9e7234da57cc04ebce8913f9562e03085e15d8e16c8146334116e127d"}
Jul 26 17:57:45.661164 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.661045    2548 generic.go:356] "Generic (PLEG): container finished" podID="c48ecf55-4a22-4d68-8455-a9226dc2f3c4" containerID="9fdfab61074798ecd20c46e248c7a715d8f197a8fb1b950941351be9c7a60a8d" exitCode=0
Jul 26 17:57:45.661164 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.661135    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsd6" event={"ID":"c48ecf55-4a22-4d68-8455-a9226dc2f3c4","Type":"ContainerDied","Data":"9fdfab61074798ecd20c46e248c7a715d8f197a8fb1b950941351be9c7a60a8d"}
Jul 26 17:57:45.662996 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.662949    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fxldw" event={"ID":"4e53c488-9d7d-436a-b723-e574e127a89d","Type":"ContainerStarted","Data":"c275c4918844b178e606d850dcfe36e8aae7e2b91c5c1aee833796812a84b998"}
Jul 26 17:57:45.671412 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.671383    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb795" event={"ID":"3bb86453-c54c-4492-bc0c-4dbab9008b74","Type":"ContainerStarted","Data":"52dc046756a4288756a85f924136802c14b978b6dff289c8b9f4ddd7dfa871f9"}
Jul 26 17:57:45.671545 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.671490    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb795" event={"ID":"3bb86453-c54c-4492-bc0c-4dbab9008b74","Type":"ContainerStarted","Data":"bb9f466f457a95408f2675d145454154f164de41af4a344cb705500b72cd1851"}
Jul 26 17:57:45.671545 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.671539    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb795" event={"ID":"3bb86453-c54c-4492-bc0c-4dbab9008b74","Type":"ContainerStarted","Data":"090c2e8efe0dca6bb643c3f8a93968bf47367d6f171e6be4abe5669a339a2ce1"}
Jul 26 17:57:45.671666 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.671585    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb795" event={"ID":"3bb86453-c54c-4492-bc0c-4dbab9008b74","Type":"ContainerStarted","Data":"cd30a7ee880db0396a8eb6101c933bdeeb3d800239c84be4e9cc70de2b84462f"}
Jul 26 17:57:45.671666 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.671632    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb795" event={"ID":"3bb86453-c54c-4492-bc0c-4dbab9008b74","Type":"ContainerStarted","Data":"969f1912b0d2f8cf40e8c5e574d101aec2a59d32d7f19279914ba31d8a827730"}
Jul 26 17:57:45.671787 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.671676    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb795" event={"ID":"3bb86453-c54c-4492-bc0c-4dbab9008b74","Type":"ContainerStarted","Data":"7cbce41d1ba300a46fafd55f8c6e5a25d6c7f66ebb5a6c975112c31d08f7a8c6"}
Jul 26 17:57:45.672902 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.672882    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m2knk" event={"ID":"f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41","Type":"ContainerStarted","Data":"15fac921bb2ed0a3d48de576439aa84fa18d4a1ce8ba60671b027882584ed721"}
Jul 26 17:57:45.674244 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.674222    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8dfzh" event={"ID":"497906fb-3bfd-4d93-95d5-2208cb59a48e","Type":"ContainerStarted","Data":"f3efdd39684fa2349ce9b6743f4b4520134e0f935ce3f629f16e0b285ba2ae62"}
Jul 26 17:57:45.689025 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.688953    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-214.ec2.internal" podStartSLOduration=20.688941051 podStartE2EDuration="20.688941051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:28.625746756 +0000 UTC m=+5.725999643" watchObservedRunningTime="2026-07-26 17:57:45.688941051 +0000 UTC m=+22.789193936"
Jul 26 17:57:45.689314 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.689289    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g8vg9" podStartSLOduration=4.407162742 podStartE2EDuration="22.689282164s" totalImagesPullingTime="18.282119422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:45.68884071 +0000 UTC m=+22.789093617" watchObservedRunningTime="2026-07-26 17:57:45.689282164 +0000 UTC m=+22.789535052"
Jul 26 17:57:45.758137 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.758097    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d49rb" podStartSLOduration=12.301386636 podStartE2EDuration="22.758084548s" totalImagesPullingTime="10.456697912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:45.711648717 +0000 UTC m=+22.811901602" watchObservedRunningTime="2026-07-26 17:57:45.758084548 +0000 UTC m=+22.858337482"
Jul 26 17:57:45.790677 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.790633    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fxldw" podStartSLOduration=4.577521072 podStartE2EDuration="22.790618318s" totalImagesPullingTime="18.213097246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:45.790308286 +0000 UTC m=+22.890561207" watchObservedRunningTime="2026-07-26 17:57:45.790618318 +0000 UTC m=+22.890871204"
Jul 26 17:57:45.805026 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.804988    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m2knk" podStartSLOduration=3.586756804 podStartE2EDuration="21.804977584s" totalImagesPullingTime="18.21822078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:45.804607117 +0000 UTC m=+22.904860028" watchObservedRunningTime="2026-07-26 17:57:45.804977584 +0000 UTC m=+22.905230469"
Jul 26 17:57:45.821788 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:45.821750    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8dfzh" podStartSLOduration=4.571529601 podStartE2EDuration="22.821740627s" totalImagesPullingTime="18.250211026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:45.821381904 +0000 UTC m=+22.921634800" watchObservedRunningTime="2026-07-26 17:57:45.821740627 +0000 UTC m=+22.921993512"
Jul 26 17:57:46.207208 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:46.207169    2548 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 26 17:57:46.323909 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:46.323764    2548 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-26T17:57:46.207204329Z","UUID":"821cc4ce-4c42-48c9-9023-42277bad26eb","Handler":null,"Name":"","Endpoint":""}
Jul 26 17:57:46.325126 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:46.325104    2548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 26 17:57:46.325259 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:46.325145    2548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 26 17:57:46.679077 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:46.678979    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c" event={"ID":"24d44df5-89de-4da1-afbe-8d477bacff57","Type":"ContainerStarted","Data":"b839b61bdaa86b35b69416890e08549ae367a62bb0ce020e1a58136a40ae46d1"}
Jul 26 17:57:46.680631 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:46.680598    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tdvxl" event={"ID":"e507c91c-f4f8-4818-a74e-c55a9cf05c68","Type":"ContainerStarted","Data":"7ebf0726865049a24d4236f2f72f49ba84f71b88ab4cc37f91a11710f0dbebaa"}
Jul 26 17:57:46.694607 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:46.694563    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tdvxl" podStartSLOduration=5.472417609 podStartE2EDuration="23.694548641s" totalImagesPullingTime="18.222131032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:46.694410113 +0000 UTC m=+23.794663019" watchObservedRunningTime="2026-07-26 17:57:46.694548641 +0000 UTC m=+23.794801528"
Jul 26 17:57:47.123803 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:47.123710    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:47.124312 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:47.124293    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:47.407310 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:47.407286    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:47.407423 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:47.407330    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:47.407490 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:47.407286    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:47.407490 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:47.407427    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:47.407588 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:47.407557    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:47.407658 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:47.407636    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:47.686365 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:47.686307    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c" event={"ID":"24d44df5-89de-4da1-afbe-8d477bacff57","Type":"ContainerStarted","Data":"84751cb5f3c03878ccf46380c3fbc6c6add0775f4ef2738ba26a4ab241e70080"}
Jul 26 17:57:47.703438 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:47.703385    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vrx2c" podStartSLOduration=4.30642544 podStartE2EDuration="24.703363555s" totalImagesPullingTime="20.396938115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:47.70208722 +0000 UTC m=+24.802340128" watchObservedRunningTime="2026-07-26 17:57:47.703363555 +0000 UTC m=+24.803616443"
Jul 26 17:57:48.691818 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:48.691781    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb795" event={"ID":"3bb86453-c54c-4492-bc0c-4dbab9008b74","Type":"ContainerStarted","Data":"bf51bd5e9cf16f74751fb4e9d59be01aeab9c08f19f37f15ab61b0c8960e50eb"}
Jul 26 17:57:48.691818 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:48.691817    2548 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 26 17:57:49.407299 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:49.407269    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:49.407481 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:49.407314    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:49.407481 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:49.407401    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:49.407481 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:49.407461    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:49.407645 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:49.407514    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:49.407645 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:49.407591    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:50.700044 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:50.699818    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tb795" event={"ID":"3bb86453-c54c-4492-bc0c-4dbab9008b74","Type":"ContainerStarted","Data":"bdda4dfc4e53f7faa38ffe79870c0a217948494ccdb856f5051b2b9223d7fabe"}
Jul 26 17:57:50.700690 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:50.700141    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:50.701814 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:50.701788    2548 generic.go:356] "Generic (PLEG): container finished" podID="c48ecf55-4a22-4d68-8455-a9226dc2f3c4" containerID="623930a41cb74003778c8daa039a2ad21a624f7af1432feef7466f7ef30614a6" exitCode=0
Jul 26 17:57:50.701899 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:50.701833    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsd6" event={"ID":"c48ecf55-4a22-4d68-8455-a9226dc2f3c4","Type":"ContainerDied","Data":"623930a41cb74003778c8daa039a2ad21a624f7af1432feef7466f7ef30614a6"}
Jul 26 17:57:50.714985 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:50.714966    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:50.724433 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:50.724387    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tb795" podStartSLOduration=9.442730822 podStartE2EDuration="27.724374401s" totalImagesPullingTime="18.281643579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:57:50.723987641 +0000 UTC m=+27.824240526" watchObservedRunningTime="2026-07-26 17:57:50.724374401 +0000 UTC m=+27.824627286"
Jul 26 17:57:51.407830 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:51.407730    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:51.408008 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:51.407730    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:51.408008 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:51.407854    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:51.408008 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:51.407887    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:51.408008 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:51.407978    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:51.408233 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:51.408045    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:51.724248 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:51.724225    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:51.724669 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:51.724307    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:51.739839 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:51.739815    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:57:52.207478 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:52.207449    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wh8hl"]
Jul 26 17:57:52.207631 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:52.207576    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:52.207714 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:52.207687    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:52.210252 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:52.210226    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2t9x2"]
Jul 26 17:57:52.210375 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:52.210323    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:52.210442 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:52.210416    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:52.210874 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:52.210852    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kc628"]
Jul 26 17:57:52.210966 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:52.210954    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:52.211082 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:52.211056    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:52.708244 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:52.708208    2548 generic.go:356] "Generic (PLEG): container finished" podID="c48ecf55-4a22-4d68-8455-a9226dc2f3c4" containerID="fc1ed2a1172ba32bb5c2ac9105470775f8ecfdf6ebb5083dfd928d283d012202" exitCode=0
Jul 26 17:57:52.708399 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:52.708220    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsd6" event={"ID":"c48ecf55-4a22-4d68-8455-a9226dc2f3c4","Type":"ContainerDied","Data":"fc1ed2a1172ba32bb5c2ac9105470775f8ecfdf6ebb5083dfd928d283d012202"}
Jul 26 17:57:53.409066 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:53.409033    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:53.409590 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:53.409118    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:53.409590 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:53.409124    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:53.409590 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:53.409263    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:53.409590 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:53.409298    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:53.409590 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:53.409375    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:54.713991 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:54.713913    2548 generic.go:356] "Generic (PLEG): container finished" podID="c48ecf55-4a22-4d68-8455-a9226dc2f3c4" containerID="8610f541addeb00ba07e734a2893fc01036363c5c8dff5883b631d651953b322" exitCode=0
Jul 26 17:57:54.713991 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:54.713959    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsd6" event={"ID":"c48ecf55-4a22-4d68-8455-a9226dc2f3c4","Type":"ContainerDied","Data":"8610f541addeb00ba07e734a2893fc01036363c5c8dff5883b631d651953b322"}
Jul 26 17:57:55.183994 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:55.183933    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:55.184130 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:55.184050    2548 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 26 17:57:55.184621 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:55.184595    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d49rb"
Jul 26 17:57:55.408424 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:55.408239    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:55.408588 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:55.408239    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:55.408588 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:55.408523    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:55.408588 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:55.408256    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:55.408760 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:55.408615    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:55.408881 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:55.408708    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:57.131834 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.131747    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:57.131834 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.131794    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:57.132383 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.131910    2548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:57.132383 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.131969    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs podName:ee4620ff-6563-4f5b-beb1-35330cd2d74b nodeName:}" failed. No retries permitted until 2026-07-26 17:58:29.131949398 +0000 UTC m=+66.232202295 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs") pod "network-metrics-daemon-kc628" (UID: "ee4620ff-6563-4f5b-beb1-35330cd2d74b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 26 17:57:57.132383 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.131910    2548 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:57.132383 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.132030    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret podName:2070228b-2e6c-4333-932a-a1e47454dcd1 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:29.132018568 +0000 UTC m=+66.232271432 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret") pod "global-pull-secret-syncer-2t9x2" (UID: "2070228b-2e6c-4333-932a-a1e47454dcd1") : object "kube-system"/"original-pull-secret" not registered
Jul 26 17:57:57.233011 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.232976    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts2q\" (UniqueName: \"kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q\") pod \"network-check-target-wh8hl\" (UID: \"f5d13033-571c-4a39-b7dd-bba32f99bedf\") " pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:57.233150 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.233132    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 26 17:57:57.233226 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.233153    2548 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 26 17:57:57.233226 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.233164    2548 projected.go:196] Error preparing data for projected volume kube-api-access-vts2q for pod openshift-network-diagnostics/network-check-target-wh8hl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:57.233226 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.233225    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q podName:f5d13033-571c-4a39-b7dd-bba32f99bedf nodeName:}" failed. No retries permitted until 2026-07-26 17:58:29.233209081 +0000 UTC m=+66.333461947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vts2q" (UniqueName: "kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q") pod "network-check-target-wh8hl" (UID: "f5d13033-571c-4a39-b7dd-bba32f99bedf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 26 17:57:57.407581 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.407546    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:57.407715 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.407583    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:57.407715 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.407553    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:57.407715 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.407672    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wh8hl" podUID="f5d13033-571c-4a39-b7dd-bba32f99bedf"
Jul 26 17:57:57.407865 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.407748    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kc628" podUID="ee4620ff-6563-4f5b-beb1-35330cd2d74b"
Jul 26 17:57:57.407865 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:57.407832    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2t9x2" podUID="2070228b-2e6c-4333-932a-a1e47454dcd1"
Jul 26 17:57:57.719919 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.719841    2548 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-214.ec2.internal" event="NodeReady"
Jul 26 17:57:57.720069 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.719988    2548 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 26 17:57:57.751655 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.751624    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76b6965cfb-czp7r"]
Jul 26 17:57:57.756436 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.756414    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:57.759016 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.758996    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 26 17:57:57.759582 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.759560    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rvncq\""
Jul 26 17:57:57.759675 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.759565    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 26 17:57:57.760517 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.760496    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 26 17:57:57.764491 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.764473    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 26 17:57:57.767883 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.767849    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jnt8g"]
Jul 26 17:57:57.771413 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.771393    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l2phc"]
Jul 26 17:57:57.771539 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.771520    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jnt8g"
Jul 26 17:57:57.774473 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.774455    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 26 17:57:57.774854 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.774802    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 26 17:57:57.774945 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.774872    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76b6965cfb-czp7r"]
Jul 26 17:57:57.775012 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.774948    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k6gz2\""
Jul 26 17:57:57.775012 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.774956    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:57.775012 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.774956    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 26 17:57:57.781804 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.778233    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 26 17:57:57.781804 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.778316    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-566xh\""
Jul 26 17:57:57.781804 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.778670    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 26 17:57:57.783615 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.783591    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jnt8g"]
Jul 26 17:57:57.788934 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.788872    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l2phc"]
Jul 26 17:57:57.938862 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.938814    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2607b65c-acd1-4091-a34e-d40a67ff9ede-cert\") pod \"ingress-canary-jnt8g\" (UID: \"2607b65c-acd1-4091-a34e-d40a67ff9ede\") " pod="openshift-ingress-canary/ingress-canary-jnt8g"
Jul 26 17:57:57.938862 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.938860    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0af0461-790b-47df-94e5-ed7e22b990c7-ca-trust-extracted\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:57.939125 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.938946    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-installation-pull-secrets\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:57.939125 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.938975    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7dl5\" (UniqueName: \"kubernetes.io/projected/2607b65c-acd1-4091-a34e-d40a67ff9ede-kube-api-access-q7dl5\") pod \"ingress-canary-jnt8g\" (UID: \"2607b65c-acd1-4091-a34e-d40a67ff9ede\") " pod="openshift-ingress-canary/ingress-canary-jnt8g"
Jul 26 17:57:57.939125 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.939000    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f22461aa-0b4f-4acd-988c-2740a8917fe2-config-volume\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:57.939125 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.939056    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dx8b\" (UniqueName: \"kubernetes.io/projected/f22461aa-0b4f-4acd-988c-2740a8917fe2-kube-api-access-5dx8b\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:57.939125 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.939112    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:57.939380 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.939141    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-image-registry-private-configuration\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:57.939380 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.939242    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f22461aa-0b4f-4acd-988c-2740a8917fe2-tmp-dir\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:57.939380 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.939267    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-certificates\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:57.939380 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.939299    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-bound-sa-token\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:57.939380 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.939358    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:57.939551 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.939382    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-trusted-ca\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:57.939551 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:57.939456    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnk9h\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-kube-api-access-xnk9h\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.040785 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040713    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnk9h\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-kube-api-access-xnk9h\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.040785 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040753    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2607b65c-acd1-4091-a34e-d40a67ff9ede-cert\") pod \"ingress-canary-jnt8g\" (UID: \"2607b65c-acd1-4091-a34e-d40a67ff9ede\") " pod="openshift-ingress-canary/ingress-canary-jnt8g"
Jul 26 17:57:58.040785 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040779    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0af0461-790b-47df-94e5-ed7e22b990c7-ca-trust-extracted\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040807    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-installation-pull-secrets\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040838    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7dl5\" (UniqueName: \"kubernetes.io/projected/2607b65c-acd1-4091-a34e-d40a67ff9ede-kube-api-access-q7dl5\") pod \"ingress-canary-jnt8g\" (UID: \"2607b65c-acd1-4091-a34e-d40a67ff9ede\") " pod="openshift-ingress-canary/ingress-canary-jnt8g"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040867    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f22461aa-0b4f-4acd-988c-2740a8917fe2-config-volume\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040899    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dx8b\" (UniqueName: \"kubernetes.io/projected/f22461aa-0b4f-4acd-988c-2740a8917fe2-kube-api-access-5dx8b\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040918    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040936    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-image-registry-private-configuration\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040972    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f22461aa-0b4f-4acd-988c-2740a8917fe2-tmp-dir\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.040995    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-certificates\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.041015    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-bound-sa-token\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.041033    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.041043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.041047    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-trusted-ca\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.041598 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.041231    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0af0461-790b-47df-94e5-ed7e22b990c7-ca-trust-extracted\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.041598 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.041488    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f22461aa-0b4f-4acd-988c-2740a8917fe2-tmp-dir\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:58.041598 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:58.041587    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 17:57:58.041745 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:58.041603    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76b6965cfb-czp7r: secret "image-registry-tls" not found
Jul 26 17:57:58.041745 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:58.041654    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls podName:a0af0461-790b-47df-94e5-ed7e22b990c7 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:58.541638248 +0000 UTC m=+35.641891112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls") pod "image-registry-76b6965cfb-czp7r" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7") : secret "image-registry-tls" not found
Jul 26 17:57:58.041857 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.041768    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-certificates\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.041913 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:58.041864    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 17:57:58.041966 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:58.041949    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls podName:f22461aa-0b4f-4acd-988c-2740a8917fe2 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:58.541928231 +0000 UTC m=+35.642181101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls") pod "dns-default-l2phc" (UID: "f22461aa-0b4f-4acd-988c-2740a8917fe2") : secret "dns-default-metrics-tls" not found
Jul 26 17:57:58.042028 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.042011    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f22461aa-0b4f-4acd-988c-2740a8917fe2-config-volume\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:58.042080 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.042030    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-trusted-ca\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.045574 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.045547    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-installation-pull-secrets\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.045674 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.045584    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-image-registry-private-configuration\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.045674 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.045593    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2607b65c-acd1-4091-a34e-d40a67ff9ede-cert\") pod \"ingress-canary-jnt8g\" (UID: \"2607b65c-acd1-4091-a34e-d40a67ff9ede\") " pod="openshift-ingress-canary/ingress-canary-jnt8g"
Jul 26 17:57:58.050297 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.050270    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dx8b\" (UniqueName: \"kubernetes.io/projected/f22461aa-0b4f-4acd-988c-2740a8917fe2-kube-api-access-5dx8b\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:58.050484 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.050441    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-bound-sa-token\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.050632 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.050610    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7dl5\" (UniqueName: \"kubernetes.io/projected/2607b65c-acd1-4091-a34e-d40a67ff9ede-kube-api-access-q7dl5\") pod \"ingress-canary-jnt8g\" (UID: \"2607b65c-acd1-4091-a34e-d40a67ff9ede\") " pod="openshift-ingress-canary/ingress-canary-jnt8g"
Jul 26 17:57:58.050797 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.050781    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnk9h\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-kube-api-access-xnk9h\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.083723 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.083702    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jnt8g"
Jul 26 17:57:58.545826 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.545794    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:58.546297 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.545856    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:58.546297 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:58.545961    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 17:57:58.546297 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:58.545999    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 17:57:58.546297 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:58.546012    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76b6965cfb-czp7r: secret "image-registry-tls" not found
Jul 26 17:57:58.546297 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:58.546054    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls podName:f22461aa-0b4f-4acd-988c-2740a8917fe2 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:59.546033916 +0000 UTC m=+36.646286780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls") pod "dns-default-l2phc" (UID: "f22461aa-0b4f-4acd-988c-2740a8917fe2") : secret "dns-default-metrics-tls" not found
Jul 26 17:57:58.546297 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:58.546074    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls podName:a0af0461-790b-47df-94e5-ed7e22b990c7 nodeName:}" failed. No retries permitted until 2026-07-26 17:57:59.546064616 +0000 UTC m=+36.646317484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls") pod "image-registry-76b6965cfb-czp7r" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7") : secret "image-registry-tls" not found
Jul 26 17:57:58.828599 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:58.828481    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jnt8g"]
Jul 26 17:57:58.832159 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:57:58.832133    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2607b65c_acd1_4091_a34e_d40a67ff9ede.slice/crio-6c155be00ca2e544f1685cb57bfe3191d6af3ca1d705c2a6c0d9c1db64b146ef WatchSource:0}: Error finding container 6c155be00ca2e544f1685cb57bfe3191d6af3ca1d705c2a6c0d9c1db64b146ef: Status 404 returned error can't find the container with id 6c155be00ca2e544f1685cb57bfe3191d6af3ca1d705c2a6c0d9c1db64b146ef
Jul 26 17:57:59.408252 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.408222    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:57:59.408425 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.408253    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:57:59.408425 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.408289    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:57:59.411207 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.411141    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 26 17:57:59.412458 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.411966    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 17:57:59.412458 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.412018    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7vmj\""
Jul 26 17:57:59.412458 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.412022    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 26 17:57:59.412458 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.412274    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 17:57:59.412458 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.412304    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9fbzz\""
Jul 26 17:57:59.552302 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.552275    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:57:59.552879 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.552347    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:57:59.552879 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:59.552412    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 17:57:59.552879 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:59.552442    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 17:57:59.552879 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:59.552455    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76b6965cfb-czp7r: secret "image-registry-tls" not found
Jul 26 17:57:59.552879 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:59.552489    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls podName:f22461aa-0b4f-4acd-988c-2740a8917fe2 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:01.552475059 +0000 UTC m=+38.652727923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls") pod "dns-default-l2phc" (UID: "f22461aa-0b4f-4acd-988c-2740a8917fe2") : secret "dns-default-metrics-tls" not found
Jul 26 17:57:59.552879 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:57:59.552507    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls podName:a0af0461-790b-47df-94e5-ed7e22b990c7 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:01.552499375 +0000 UTC m=+38.652752244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls") pod "image-registry-76b6965cfb-czp7r" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7") : secret "image-registry-tls" not found
Jul 26 17:57:59.728316 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.728246    2548 generic.go:356] "Generic (PLEG): container finished" podID="c48ecf55-4a22-4d68-8455-a9226dc2f3c4" containerID="747cf7ec4940726e8d6b3e352316ca94bc8fa3e05d6da8bae9b48883e99dd619" exitCode=0
Jul 26 17:57:59.728444 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.728316    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsd6" event={"ID":"c48ecf55-4a22-4d68-8455-a9226dc2f3c4","Type":"ContainerDied","Data":"747cf7ec4940726e8d6b3e352316ca94bc8fa3e05d6da8bae9b48883e99dd619"}
Jul 26 17:57:59.729671 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:57:59.729638    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jnt8g" event={"ID":"2607b65c-acd1-4091-a34e-d40a67ff9ede","Type":"ContainerStarted","Data":"6c155be00ca2e544f1685cb57bfe3191d6af3ca1d705c2a6c0d9c1db64b146ef"}
Jul 26 17:58:00.736399 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:00.736361    2548 generic.go:356] "Generic (PLEG): container finished" podID="c48ecf55-4a22-4d68-8455-a9226dc2f3c4" containerID="74d546c54dbcc9d3748dca2c38c39f1a333dc28b11403bfea24cceddd3c0e7d2" exitCode=0
Jul 26 17:58:00.736864 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:00.736431    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsd6" event={"ID":"c48ecf55-4a22-4d68-8455-a9226dc2f3c4","Type":"ContainerDied","Data":"74d546c54dbcc9d3748dca2c38c39f1a333dc28b11403bfea24cceddd3c0e7d2"}
Jul 26 17:58:01.565626 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:01.565588    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:58:01.565844 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:01.565657    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:58:01.565844 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:01.565747    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 17:58:01.565844 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:01.565754    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 17:58:01.565844 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:01.565772    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76b6965cfb-czp7r: secret "image-registry-tls" not found
Jul 26 17:58:01.565844 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:01.565802    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls podName:f22461aa-0b4f-4acd-988c-2740a8917fe2 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:05.565786825 +0000 UTC m=+42.666039709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls") pod "dns-default-l2phc" (UID: "f22461aa-0b4f-4acd-988c-2740a8917fe2") : secret "dns-default-metrics-tls" not found
Jul 26 17:58:01.565844 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:01.565816    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls podName:a0af0461-790b-47df-94e5-ed7e22b990c7 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:05.565810214 +0000 UTC m=+42.666063078 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls") pod "image-registry-76b6965cfb-czp7r" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7") : secret "image-registry-tls" not found
Jul 26 17:58:01.742160 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:01.742132    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hqsd6" event={"ID":"c48ecf55-4a22-4d68-8455-a9226dc2f3c4","Type":"ContainerStarted","Data":"f360f2bef22c3111841961309884545fad06577465040fa15b879bd961b5eb10"}
Jul 26 17:58:01.743617 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:01.743591    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jnt8g" event={"ID":"2607b65c-acd1-4091-a34e-d40a67ff9ede","Type":"ContainerStarted","Data":"57c818b9adf0f5a211fecbe4a232a5803003c3933cd5dfa8b6b37d040ca573ee"}
Jul 26 17:58:01.765016 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:01.764971    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hqsd6" podStartSLOduration=9.012729319 podStartE2EDuration="37.764955334s" totalImagesPullingTime="28.752226015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:01.764731237 +0000 UTC m=+38.864984154" watchObservedRunningTime="2026-07-26 17:58:01.764955334 +0000 UTC m=+38.865208219"
Jul 26 17:58:01.778986 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:01.778833    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jnt8g" podStartSLOduration=2.6203188109999997 podStartE2EDuration="4.77882046s" totalImagesPullingTime="2.158501649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:01.778369658 +0000 UTC m=+38.878622562" watchObservedRunningTime="2026-07-26 17:58:01.77882046 +0000 UTC m=+38.879073347"
Jul 26 17:58:04.294049 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.294018    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nb7c5"]
Jul 26 17:58:04.325884 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.325859    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nb7c5"]
Jul 26 17:58:04.326005 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.325949    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.328022 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.328001    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 26 17:58:04.328022 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.328010    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 26 17:58:04.328314 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.328296    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 26 17:58:04.328597 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.328582    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2d24l\""
Jul 26 17:58:04.328653 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.328602    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 26 17:58:04.384021 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.383995    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c9n4\" (UniqueName: \"kubernetes.io/projected/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-api-access-7c9n4\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.384105 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.384025    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42c4fc8d-2501-47c6-aa2b-86938094f9d0-data-volume\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.384142 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.384108    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.384142 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.384133    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42c4fc8d-2501-47c6-aa2b-86938094f9d0-crio-socket\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.384228 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.384176    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.484799 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.484776    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.484877 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.484803    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42c4fc8d-2501-47c6-aa2b-86938094f9d0-crio-socket\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.484877 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.484835    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.484877 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.484852    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c9n4\" (UniqueName: \"kubernetes.io/projected/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-api-access-7c9n4\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.484877 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.484868    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42c4fc8d-2501-47c6-aa2b-86938094f9d0-data-volume\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.485073 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:04.484927    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:04.485073 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:04.484941    2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 17:58:04.485073 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:04.484986    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:04.984966721 +0000 UTC m=+42.085219588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:04.485073 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.484988    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/42c4fc8d-2501-47c6-aa2b-86938094f9d0-crio-socket\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.485073 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:04.485018    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:04.985007461 +0000 UTC m=+42.085260332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : configmap "kube-rbac-proxy" not found
Jul 26 17:58:04.485256 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.485124    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/42c4fc8d-2501-47c6-aa2b-86938094f9d0-data-volume\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.502693 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.502666    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c9n4\" (UniqueName: \"kubernetes.io/projected/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-api-access-7c9n4\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.988798 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.988765    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.988939 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:04.988839    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:04.989013 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:04.988950    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:04.989013 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:04.988976    2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 17:58:04.989111 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:04.989023    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:05.989005261 +0000 UTC m=+43.089258138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:04.989111 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:04.989039    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:05.989032721 +0000 UTC m=+43.089285584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : configmap "kube-rbac-proxy" not found
Jul 26 17:58:05.593785 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:05.593744    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:58:05.594120 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:05.593824    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:58:05.594120 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:05.593898    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 17:58:05.594120 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:05.593958    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls podName:f22461aa-0b4f-4acd-988c-2740a8917fe2 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:13.593942991 +0000 UTC m=+50.694195869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls") pod "dns-default-l2phc" (UID: "f22461aa-0b4f-4acd-988c-2740a8917fe2") : secret "dns-default-metrics-tls" not found
Jul 26 17:58:05.594120 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:05.593966    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 17:58:05.594120 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:05.593985    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76b6965cfb-czp7r: secret "image-registry-tls" not found
Jul 26 17:58:05.594120 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:05.594030    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls podName:a0af0461-790b-47df-94e5-ed7e22b990c7 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:13.594015613 +0000 UTC m=+50.694268478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls") pod "image-registry-76b6965cfb-czp7r" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7") : secret "image-registry-tls" not found
Jul 26 17:58:05.996932 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:05.996903    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:05.997111 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:05.996951    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:05.997111 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:05.997018    2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 17:58:05.997111 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:05.997059    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:07.997048196 +0000 UTC m=+45.097301060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : configmap "kube-rbac-proxy" not found
Jul 26 17:58:05.997111 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:05.997066    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:05.997327 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:05.997154    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:07.997137239 +0000 UTC m=+45.097390104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:06.532258 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.532227    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qhkgs"]
Jul 26 17:58:06.546691 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.546670    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.547411 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.547390    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qhkgs"]
Jul 26 17:58:06.549140 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.549121    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 26 17:58:06.549599 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.549581    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-m9n4j\""
Jul 26 17:58:06.550177 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.550155    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 26 17:58:06.550177 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.550174    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 26 17:58:06.550377 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.550361    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 26 17:58:06.602367 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.602342    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf42p\" (UniqueName: \"kubernetes.io/projected/0c058c0b-14ca-465d-8ece-ff64e3d0c6a4-kube-api-access-hf42p\") pod \"service-ca-658d7b7c78-qhkgs\" (UID: \"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4\") " pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.602613 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.602370    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c058c0b-14ca-465d-8ece-ff64e3d0c6a4-signing-cabundle\") pod \"service-ca-658d7b7c78-qhkgs\" (UID: \"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4\") " pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.602613 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.602401    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c058c0b-14ca-465d-8ece-ff64e3d0c6a4-signing-key\") pod \"service-ca-658d7b7c78-qhkgs\" (UID: \"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4\") " pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.703140 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.703120    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf42p\" (UniqueName: \"kubernetes.io/projected/0c058c0b-14ca-465d-8ece-ff64e3d0c6a4-kube-api-access-hf42p\") pod \"service-ca-658d7b7c78-qhkgs\" (UID: \"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4\") " pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.703227 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.703148    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c058c0b-14ca-465d-8ece-ff64e3d0c6a4-signing-cabundle\") pod \"service-ca-658d7b7c78-qhkgs\" (UID: \"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4\") " pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.703227 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.703177    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c058c0b-14ca-465d-8ece-ff64e3d0c6a4-signing-key\") pod \"service-ca-658d7b7c78-qhkgs\" (UID: \"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4\") " pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.703861 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.703843    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c058c0b-14ca-465d-8ece-ff64e3d0c6a4-signing-cabundle\") pod \"service-ca-658d7b7c78-qhkgs\" (UID: \"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4\") " pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.705429 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.705411    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c058c0b-14ca-465d-8ece-ff64e3d0c6a4-signing-key\") pod \"service-ca-658d7b7c78-qhkgs\" (UID: \"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4\") " pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.711509 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.711484    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf42p\" (UniqueName: \"kubernetes.io/projected/0c058c0b-14ca-465d-8ece-ff64e3d0c6a4-kube-api-access-hf42p\") pod \"service-ca-658d7b7c78-qhkgs\" (UID: \"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4\") " pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.856792 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.856742    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs"
Jul 26 17:58:06.994789 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:06.994763    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-qhkgs"]
Jul 26 17:58:06.997767 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:06.997742    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c058c0b_14ca_465d_8ece_ff64e3d0c6a4.slice/crio-a0fe203c3edc9272b6727a448e2deabe1b7efd43c3bcd75d581fdc5487a9d15f WatchSource:0}: Error finding container a0fe203c3edc9272b6727a448e2deabe1b7efd43c3bcd75d581fdc5487a9d15f: Status 404 returned error can't find the container with id a0fe203c3edc9272b6727a448e2deabe1b7efd43c3bcd75d581fdc5487a9d15f
Jul 26 17:58:07.297350 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:07.297330    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m2knk_f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41/dns-node-resolver/0.log"
Jul 26 17:58:07.758957 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:07.758925    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs" event={"ID":"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4","Type":"ContainerStarted","Data":"a0fe203c3edc9272b6727a448e2deabe1b7efd43c3bcd75d581fdc5487a9d15f"}
Jul 26 17:58:08.013043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:08.012975    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:08.013043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:08.013024    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:08.013239 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:08.013096    2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 17:58:08.013239 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:08.013128    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:08.013239 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:08.013147    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:12.013134468 +0000 UTC m=+49.113387332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : configmap "kube-rbac-proxy" not found
Jul 26 17:58:08.013239 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:08.013184    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:12.013170846 +0000 UTC m=+49.113423713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:08.097958 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:08.097926    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fxldw_4e53c488-9d7d-436a-b723-e574e127a89d/node-ca/0.log"
Jul 26 17:58:08.897848 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:08.897812    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jnt8g_2607b65c-acd1-4091-a34e-d40a67ff9ede/serve-healthcheck-canary/0.log"
Jul 26 17:58:09.766255 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:09.766226    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs" event={"ID":"0c058c0b-14ca-465d-8ece-ff64e3d0c6a4","Type":"ContainerStarted","Data":"03ddc5e2ba96d4fe2220d4961b89b3274e06ccdbc698c307f57ef523e84f1c01"}
Jul 26 17:58:09.782430 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:09.782380    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-qhkgs" podStartSLOduration=1.5919933240000002 podStartE2EDuration="3.782361525s" totalImagesPullingTime="2.190368201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:09.781438827 +0000 UTC m=+46.881691713" watchObservedRunningTime="2026-07-26 17:58:09.782361525 +0000 UTC m=+46.882614411"
Jul 26 17:58:12.043975 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:12.043940    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:12.044412 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:12.044002    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:12.044412 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:12.044089    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:12.044412 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:12.044154    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:20.044137986 +0000 UTC m=+57.144390851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:12.044412 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:12.044093    2548 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 26 17:58:12.044412 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:12.044261    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:20.044242758 +0000 UTC m=+57.144495623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : configmap "kube-rbac-proxy" not found
Jul 26 17:58:13.657323 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:13.657287    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:58:13.657706 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:13.657340    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls\") pod \"image-registry-76b6965cfb-czp7r\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") " pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:58:13.657706 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:13.657414    2548 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 26 17:58:13.657706 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:13.657424    2548 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76b6965cfb-czp7r: secret "image-registry-tls" not found
Jul 26 17:58:13.657706 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:13.657424    2548 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 26 17:58:13.657706 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:13.657465    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls podName:a0af0461-790b-47df-94e5-ed7e22b990c7 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:29.657452848 +0000 UTC m=+66.757705712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls") pod "image-registry-76b6965cfb-czp7r" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7") : secret "image-registry-tls" not found
Jul 26 17:58:13.657706 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:13.657540    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls podName:f22461aa-0b4f-4acd-988c-2740a8917fe2 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:29.657521232 +0000 UTC m=+66.757774100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls") pod "dns-default-l2phc" (UID: "f22461aa-0b4f-4acd-988c-2740a8917fe2") : secret "dns-default-metrics-tls" not found
Jul 26 17:58:20.103414 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:20.103377    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:20.103864 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:20.103430    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:20.103864 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:20.103542    2548 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:20.103864 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:20.103612    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls podName:42c4fc8d-2501-47c6-aa2b-86938094f9d0 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:36.103594258 +0000 UTC m=+73.203847123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nb7c5" (UID: "42c4fc8d-2501-47c6-aa2b-86938094f9d0") : secret "insights-runtime-extractor-tls" not found
Jul 26 17:58:20.103864 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:20.103852    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/42c4fc8d-2501-47c6-aa2b-86938094f9d0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:23.728786 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:23.728755    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tb795"
Jul 26 17:58:25.760614 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.760582    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"]
Jul 26 17:58:25.763531 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.763514    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:25.782555 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.782537    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 26 17:58:25.782703 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.782687    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 26 17:58:25.782822 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.782809    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 26 17:58:25.782923 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.782910    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 26 17:58:25.792325 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.792303    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"]
Jul 26 17:58:25.845307 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.845280    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5k6g\" (UniqueName: \"kubernetes.io/projected/8d2aeab4-e82e-4e58-bc86-82dfc031eefb-kube-api-access-r5k6g\") pod \"klusterlet-addon-workmgr-59c765bd47-tj68j\" (UID: \"8d2aeab4-e82e-4e58-bc86-82dfc031eefb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:25.845407 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.845344    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8d2aeab4-e82e-4e58-bc86-82dfc031eefb-klusterlet-config\") pod \"klusterlet-addon-workmgr-59c765bd47-tj68j\" (UID: \"8d2aeab4-e82e-4e58-bc86-82dfc031eefb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:25.845407 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.845396    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d2aeab4-e82e-4e58-bc86-82dfc031eefb-tmp\") pod \"klusterlet-addon-workmgr-59c765bd47-tj68j\" (UID: \"8d2aeab4-e82e-4e58-bc86-82dfc031eefb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:25.945842 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.945818    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d2aeab4-e82e-4e58-bc86-82dfc031eefb-tmp\") pod \"klusterlet-addon-workmgr-59c765bd47-tj68j\" (UID: \"8d2aeab4-e82e-4e58-bc86-82dfc031eefb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:25.945927 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.945882    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5k6g\" (UniqueName: \"kubernetes.io/projected/8d2aeab4-e82e-4e58-bc86-82dfc031eefb-kube-api-access-r5k6g\") pod \"klusterlet-addon-workmgr-59c765bd47-tj68j\" (UID: \"8d2aeab4-e82e-4e58-bc86-82dfc031eefb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:25.945927 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.945919    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8d2aeab4-e82e-4e58-bc86-82dfc031eefb-klusterlet-config\") pod \"klusterlet-addon-workmgr-59c765bd47-tj68j\" (UID: \"8d2aeab4-e82e-4e58-bc86-82dfc031eefb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:25.946164 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.946145    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d2aeab4-e82e-4e58-bc86-82dfc031eefb-tmp\") pod \"klusterlet-addon-workmgr-59c765bd47-tj68j\" (UID: \"8d2aeab4-e82e-4e58-bc86-82dfc031eefb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:25.948202 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.948167    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8d2aeab4-e82e-4e58-bc86-82dfc031eefb-klusterlet-config\") pod \"klusterlet-addon-workmgr-59c765bd47-tj68j\" (UID: \"8d2aeab4-e82e-4e58-bc86-82dfc031eefb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:25.950638 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.950619    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76b6965cfb-czp7r"]
Jul 26 17:58:25.950762 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:25.950746    2548 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-76b6965cfb-czp7r" podUID="a0af0461-790b-47df-94e5-ed7e22b990c7"
Jul 26 17:58:25.987573 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:25.987555    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5k6g\" (UniqueName: \"kubernetes.io/projected/8d2aeab4-e82e-4e58-bc86-82dfc031eefb-kube-api-access-r5k6g\") pod \"klusterlet-addon-workmgr-59c765bd47-tj68j\" (UID: \"8d2aeab4-e82e-4e58-bc86-82dfc031eefb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:26.047145 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.047095    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-745cdf97bc-55rsk"]
Jul 26 17:58:26.049122 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.049105    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.071690 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.071673    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:26.073955 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.073935    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-745cdf97bc-55rsk"]
Jul 26 17:58:26.146790 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.146517    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445d0bba-b974-4b80-9272-1f09724a2e9f-registry-tls\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.146790 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.146559    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/445d0bba-b974-4b80-9272-1f09724a2e9f-registry-certificates\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.146790 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.146588    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vsmh\" (UniqueName: \"kubernetes.io/projected/445d0bba-b974-4b80-9272-1f09724a2e9f-kube-api-access-9vsmh\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.146790 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.146620    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/445d0bba-b974-4b80-9272-1f09724a2e9f-bound-sa-token\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.146790 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.146755    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/445d0bba-b974-4b80-9272-1f09724a2e9f-installation-pull-secrets\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.147061 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.146801    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/445d0bba-b974-4b80-9272-1f09724a2e9f-trusted-ca\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.147061 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.146821    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/445d0bba-b974-4b80-9272-1f09724a2e9f-image-registry-private-configuration\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.147061 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.146838    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/445d0bba-b974-4b80-9272-1f09724a2e9f-ca-trust-extracted\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.212416 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.212391    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"]
Jul 26 17:58:26.215264 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:26.215236    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2aeab4_e82e_4e58_bc86_82dfc031eefb.slice/crio-dfd93d4a4403f37bbd0b95a4b14fc2cd628e1e3b32c2eb462be43edeff679568 WatchSource:0}: Error finding container dfd93d4a4403f37bbd0b95a4b14fc2cd628e1e3b32c2eb462be43edeff679568: Status 404 returned error can't find the container with id dfd93d4a4403f37bbd0b95a4b14fc2cd628e1e3b32c2eb462be43edeff679568
Jul 26 17:58:26.247944 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.247919    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445d0bba-b974-4b80-9272-1f09724a2e9f-registry-tls\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.248038 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.247948    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/445d0bba-b974-4b80-9272-1f09724a2e9f-registry-certificates\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.248038 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.247965    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vsmh\" (UniqueName: \"kubernetes.io/projected/445d0bba-b974-4b80-9272-1f09724a2e9f-kube-api-access-9vsmh\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.248038 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.247983    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/445d0bba-b974-4b80-9272-1f09724a2e9f-bound-sa-token\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.248229 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.248112    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/445d0bba-b974-4b80-9272-1f09724a2e9f-installation-pull-secrets\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.248229 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.248147    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/445d0bba-b974-4b80-9272-1f09724a2e9f-trusted-ca\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.248461 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.248310    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/445d0bba-b974-4b80-9272-1f09724a2e9f-image-registry-private-configuration\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.248461 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.248342    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/445d0bba-b974-4b80-9272-1f09724a2e9f-ca-trust-extracted\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.249278 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.249150    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/445d0bba-b974-4b80-9272-1f09724a2e9f-ca-trust-extracted\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.249278 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.249244    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/445d0bba-b974-4b80-9272-1f09724a2e9f-trusted-ca\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.249446 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.249297    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/445d0bba-b974-4b80-9272-1f09724a2e9f-registry-certificates\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.253236 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.253214    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/445d0bba-b974-4b80-9272-1f09724a2e9f-installation-pull-secrets\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.253324 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.253299    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/445d0bba-b974-4b80-9272-1f09724a2e9f-registry-tls\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.253391 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.253371    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/445d0bba-b974-4b80-9272-1f09724a2e9f-image-registry-private-configuration\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.258180 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.258162    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/445d0bba-b974-4b80-9272-1f09724a2e9f-bound-sa-token\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.259424 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.259401    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vsmh\" (UniqueName: \"kubernetes.io/projected/445d0bba-b974-4b80-9272-1f09724a2e9f-kube-api-access-9vsmh\") pod \"image-registry-745cdf97bc-55rsk\" (UID: \"445d0bba-b974-4b80-9272-1f09724a2e9f\") " pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.360546 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.360496    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rvncq\""
Jul 26 17:58:26.367319 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.367304    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.498264 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.498236    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-745cdf97bc-55rsk"]
Jul 26 17:58:26.502162 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:26.502140    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445d0bba_b974_4b80_9272_1f09724a2e9f.slice/crio-72abc9a8e28be8595dbf54deb9670a05d17f33efd7bf8c2339b1e74e17f324e2 WatchSource:0}: Error finding container 72abc9a8e28be8595dbf54deb9670a05d17f33efd7bf8c2339b1e74e17f324e2: Status 404 returned error can't find the container with id 72abc9a8e28be8595dbf54deb9670a05d17f33efd7bf8c2339b1e74e17f324e2
Jul 26 17:58:26.806410 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.806382    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-745cdf97bc-55rsk" event={"ID":"445d0bba-b974-4b80-9272-1f09724a2e9f","Type":"ContainerStarted","Data":"0465e067b39d2e892c7c76d44ee48afb3cd8203f4022f690125ffd166747a8b1"}
Jul 26 17:58:26.806911 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.806434    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-745cdf97bc-55rsk" event={"ID":"445d0bba-b974-4b80-9272-1f09724a2e9f","Type":"ContainerStarted","Data":"72abc9a8e28be8595dbf54deb9670a05d17f33efd7bf8c2339b1e74e17f324e2"}
Jul 26 17:58:26.806911 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.806462    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:26.807641 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.807626    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:58:26.807697 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.807660    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j" event={"ID":"8d2aeab4-e82e-4e58-bc86-82dfc031eefb","Type":"ContainerStarted","Data":"dfd93d4a4403f37bbd0b95a4b14fc2cd628e1e3b32c2eb462be43edeff679568"}
Jul 26 17:58:26.812932 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.812908    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:58:26.846203 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.846144    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-745cdf97bc-55rsk" podStartSLOduration=0.846132244 podStartE2EDuration="846.132244ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:26.845770081 +0000 UTC m=+63.946022968" watchObservedRunningTime="2026-07-26 17:58:26.846132244 +0000 UTC m=+63.946385129"
Jul 26 17:58:26.853205 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.853164    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-image-registry-private-configuration\") pod \"a0af0461-790b-47df-94e5-ed7e22b990c7\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") "
Jul 26 17:58:26.853317 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.853210    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-certificates\") pod \"a0af0461-790b-47df-94e5-ed7e22b990c7\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") "
Jul 26 17:58:26.853317 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.853234    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-installation-pull-secrets\") pod \"a0af0461-790b-47df-94e5-ed7e22b990c7\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") "
Jul 26 17:58:26.853317 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.853263    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnk9h\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-kube-api-access-xnk9h\") pod \"a0af0461-790b-47df-94e5-ed7e22b990c7\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") "
Jul 26 17:58:26.853317 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.853305    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0af0461-790b-47df-94e5-ed7e22b990c7-ca-trust-extracted\") pod \"a0af0461-790b-47df-94e5-ed7e22b990c7\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") "
Jul 26 17:58:26.853536 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.853348    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-trusted-ca\") pod \"a0af0461-790b-47df-94e5-ed7e22b990c7\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") "
Jul 26 17:58:26.853536 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.853385    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-bound-sa-token\") pod \"a0af0461-790b-47df-94e5-ed7e22b990c7\" (UID: \"a0af0461-790b-47df-94e5-ed7e22b990c7\") "
Jul 26 17:58:26.853642 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.853589    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a0af0461-790b-47df-94e5-ed7e22b990c7" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 17:58:26.853728 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.853709    2548 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-certificates\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 17:58:26.853954 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.853928    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a0af0461-790b-47df-94e5-ed7e22b990c7" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 17:58:26.854671 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.854648    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0af0461-790b-47df-94e5-ed7e22b990c7-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a0af0461-790b-47df-94e5-ed7e22b990c7" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 17:58:26.855602 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.855579    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-kube-api-access-xnk9h" (OuterVolumeSpecName: "kube-api-access-xnk9h") pod "a0af0461-790b-47df-94e5-ed7e22b990c7" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7"). InnerVolumeSpecName "kube-api-access-xnk9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:58:26.855810 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.855795    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a0af0461-790b-47df-94e5-ed7e22b990c7" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 17:58:26.855893 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.855882    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a0af0461-790b-47df-94e5-ed7e22b990c7" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 17:58:26.856258 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.856238    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a0af0461-790b-47df-94e5-ed7e22b990c7" (UID: "a0af0461-790b-47df-94e5-ed7e22b990c7"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 17:58:26.954999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.954973    2548 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a0af0461-790b-47df-94e5-ed7e22b990c7-ca-trust-extracted\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 17:58:26.954999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.954998    2548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a0af0461-790b-47df-94e5-ed7e22b990c7-trusted-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 17:58:26.955166 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.955012    2548 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-bound-sa-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 17:58:26.955166 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.955022    2548 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-image-registry-private-configuration\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 17:58:26.955166 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.955030    2548 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a0af0461-790b-47df-94e5-ed7e22b990c7-installation-pull-secrets\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 17:58:26.955166 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:26.955039    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnk9h\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-kube-api-access-xnk9h\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 17:58:27.810430 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:27.810358    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76b6965cfb-czp7r"
Jul 26 17:58:27.842926 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:27.842889    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76b6965cfb-czp7r"]
Jul 26 17:58:27.847086 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:27.847034    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76b6965cfb-czp7r"]
Jul 26 17:58:27.964579 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:27.964535    2548 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a0af0461-790b-47df-94e5-ed7e22b990c7-registry-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 17:58:29.172151 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.172113    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:58:29.172630 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.172157    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:58:29.174793 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.174771    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 26 17:58:29.175380 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.175352    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 26 17:58:29.185680 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.185658    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee4620ff-6563-4f5b-beb1-35330cd2d74b-metrics-certs\") pod \"network-metrics-daemon-kc628\" (UID: \"ee4620ff-6563-4f5b-beb1-35330cd2d74b\") " pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:58:29.185811 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.185793    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2070228b-2e6c-4333-932a-a1e47454dcd1-original-pull-secret\") pod \"global-pull-secret-syncer-2t9x2\" (UID: \"2070228b-2e6c-4333-932a-a1e47454dcd1\") " pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:58:29.272597 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.272555    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vts2q\" (UniqueName: \"kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q\") pod \"network-check-target-wh8hl\" (UID: \"f5d13033-571c-4a39-b7dd-bba32f99bedf\") " pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:58:29.275431 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.275408    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 26 17:58:29.285178 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.285160    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 26 17:58:29.296528 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.296509    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vts2q\" (UniqueName: \"kubernetes.io/projected/f5d13033-571c-4a39-b7dd-bba32f99bedf-kube-api-access-vts2q\") pod \"network-check-target-wh8hl\" (UID: \"f5d13033-571c-4a39-b7dd-bba32f99bedf\") " pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:58:29.411777 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.411746    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0af0461-790b-47df-94e5-ed7e22b990c7" path="/var/lib/kubelet/pods/a0af0461-790b-47df-94e5-ed7e22b990c7/volumes"
Jul 26 17:58:29.420335 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.420310    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2t9x2"
Jul 26 17:58:29.428676 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.428620    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9fbzz\""
Jul 26 17:58:29.433560 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.433540    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l7vmj\""
Jul 26 17:58:29.437266 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.437245    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kc628"
Jul 26 17:58:29.442483 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.442463    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:58:29.675892 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.675855    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:58:29.678233 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.678207    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f22461aa-0b4f-4acd-988c-2740a8917fe2-metrics-tls\") pod \"dns-default-l2phc\" (UID: \"f22461aa-0b4f-4acd-988c-2740a8917fe2\") " pod="openshift-dns/dns-default-l2phc"
Jul 26 17:58:29.893829 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.893799    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-566xh\""
Jul 26 17:58:29.903008 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.902700    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l2phc"
Jul 26 17:58:29.988530 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:29.987834    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wh8hl"]
Jul 26 17:58:29.994745 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:29.993329    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d13033_571c_4a39_b7dd_bba32f99bedf.slice/crio-26a2ff5cd45ceba462e2cb760b8a78acaa6d6a312960903b7776d88f36aba24d WatchSource:0}: Error finding container 26a2ff5cd45ceba462e2cb760b8a78acaa6d6a312960903b7776d88f36aba24d: Status 404 returned error can't find the container with id 26a2ff5cd45ceba462e2cb760b8a78acaa6d6a312960903b7776d88f36aba24d
Jul 26 17:58:30.061649 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.061627    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l2phc"]
Jul 26 17:58:30.214675 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.214651    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2t9x2"]
Jul 26 17:58:30.215752 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.215731    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kc628"]
Jul 26 17:58:30.254503 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:30.254481    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22461aa_0b4f_4acd_988c_2740a8917fe2.slice/crio-6cb346f56ac0869b17e9b5ce0eb932a5dd7cc68e575ffe94258ed40c76f760de WatchSource:0}: Error finding container 6cb346f56ac0869b17e9b5ce0eb932a5dd7cc68e575ffe94258ed40c76f760de: Status 404 returned error can't find the container with id 6cb346f56ac0869b17e9b5ce0eb932a5dd7cc68e575ffe94258ed40c76f760de
Jul 26 17:58:30.255518 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:30.255487    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4620ff_6563_4f5b_beb1_35330cd2d74b.slice/crio-56792d5fe64cd4a53f6db151d9030ff59781e9fff637c1eb6ec60a70d314af8b WatchSource:0}: Error finding container 56792d5fe64cd4a53f6db151d9030ff59781e9fff637c1eb6ec60a70d314af8b: Status 404 returned error can't find the container with id 56792d5fe64cd4a53f6db151d9030ff59781e9fff637c1eb6ec60a70d314af8b
Jul 26 17:58:30.255900 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:30.255877    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2070228b_2e6c_4333_932a_a1e47454dcd1.slice/crio-6f796dbda79f68df3ebaa89ac054aa67c1d9ede67d7b08c4a943fc2692ab0274 WatchSource:0}: Error finding container 6f796dbda79f68df3ebaa89ac054aa67c1d9ede67d7b08c4a943fc2692ab0274: Status 404 returned error can't find the container with id 6f796dbda79f68df3ebaa89ac054aa67c1d9ede67d7b08c4a943fc2692ab0274
Jul 26 17:58:30.821962 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.821859    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l2phc" event={"ID":"f22461aa-0b4f-4acd-988c-2740a8917fe2","Type":"ContainerStarted","Data":"6cb346f56ac0869b17e9b5ce0eb932a5dd7cc68e575ffe94258ed40c76f760de"}
Jul 26 17:58:30.824451 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.824417    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wh8hl" event={"ID":"f5d13033-571c-4a39-b7dd-bba32f99bedf","Type":"ContainerStarted","Data":"26a2ff5cd45ceba462e2cb760b8a78acaa6d6a312960903b7776d88f36aba24d"}
Jul 26 17:58:30.827595 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.827504    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2t9x2" event={"ID":"2070228b-2e6c-4333-932a-a1e47454dcd1","Type":"ContainerStarted","Data":"6f796dbda79f68df3ebaa89ac054aa67c1d9ede67d7b08c4a943fc2692ab0274"}
Jul 26 17:58:30.830310 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.830279    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j" event={"ID":"8d2aeab4-e82e-4e58-bc86-82dfc031eefb","Type":"ContainerStarted","Data":"a5305d73fa4a1269e65fa1a08ecaf64615fe6cb28bc090b4d233e96eb9fbb52d"}
Jul 26 17:58:30.830696 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.830539    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:30.832301 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.832254    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j"
Jul 26 17:58:30.832985 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.832959    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kc628" event={"ID":"ee4620ff-6563-4f5b-beb1-35330cd2d74b","Type":"ContainerStarted","Data":"56792d5fe64cd4a53f6db151d9030ff59781e9fff637c1eb6ec60a70d314af8b"}
Jul 26 17:58:30.847703 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:30.847650    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59c765bd47-tj68j" podStartSLOduration=1.764995023 podStartE2EDuration="5.847632767s" totalImagesPullingTime="4.082637744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:30.845768796 +0000 UTC m=+67.946021693" watchObservedRunningTime="2026-07-26 17:58:30.847632767 +0000 UTC m=+67.947885654"
Jul 26 17:58:31.363528 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:31.362461    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw"]
Jul 26 17:58:31.380314 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:31.379591    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw"
Jul 26 17:58:31.381604 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:31.381570    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw"]
Jul 26 17:58:31.382640 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:31.382448    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 26 17:58:31.384326 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:31.383291    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cm8k4\""
Jul 26 17:58:31.491059 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:31.491020    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad30a594-131c-4f24-8fff-86c10061ebd2-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ck9qw\" (UID: \"ad30a594-131c-4f24-8fff-86c10061ebd2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw"
Jul 26 17:58:31.591980 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:31.591942    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad30a594-131c-4f24-8fff-86c10061ebd2-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ck9qw\" (UID: \"ad30a594-131c-4f24-8fff-86c10061ebd2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw"
Jul 26 17:58:31.599972 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:31.595275    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad30a594-131c-4f24-8fff-86c10061ebd2-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-ck9qw\" (UID: \"ad30a594-131c-4f24-8fff-86c10061ebd2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw"
Jul 26 17:58:31.694820 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:31.694750    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw"
Jul 26 17:58:34.968661 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:34.968608    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw"]
Jul 26 17:58:34.974216 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:34.974169    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad30a594_131c_4f24_8fff_86c10061ebd2.slice/crio-a1c0bde47d019dc16f19281666fe8f5dedc8d1b25cf5a96da2ed511afd4dcc49 WatchSource:0}: Error finding container a1c0bde47d019dc16f19281666fe8f5dedc8d1b25cf5a96da2ed511afd4dcc49: Status 404 returned error can't find the container with id a1c0bde47d019dc16f19281666fe8f5dedc8d1b25cf5a96da2ed511afd4dcc49
Jul 26 17:58:35.852569 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.852535    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kc628" event={"ID":"ee4620ff-6563-4f5b-beb1-35330cd2d74b","Type":"ContainerStarted","Data":"b45d27e83b7ad21bdb182f15e1050b7d23291f8fc0ba17953b969c429830fa70"}
Jul 26 17:58:35.852743 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.852612    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kc628" event={"ID":"ee4620ff-6563-4f5b-beb1-35330cd2d74b","Type":"ContainerStarted","Data":"bca4c598559d595bc30868e2d9e91abcede754ab7ef5e818cad6d695c8d3b9fc"}
Jul 26 17:58:35.854568 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.854537    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l2phc" event={"ID":"f22461aa-0b4f-4acd-988c-2740a8917fe2","Type":"ContainerStarted","Data":"1186c9aa2a5641297e3e0bd31f46516b140a42e5ff1b19ee440edcbf5c8bae5c"}
Jul 26 17:58:35.854711 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.854584    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l2phc" event={"ID":"f22461aa-0b4f-4acd-988c-2740a8917fe2","Type":"ContainerStarted","Data":"bba610463f6c5e9c56c82f0505e2553f3df7341909d79a3df337bd8f6c9af6ef"}
Jul 26 17:58:35.854711 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.854615    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l2phc"
Jul 26 17:58:35.856281 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.856251    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wh8hl" event={"ID":"f5d13033-571c-4a39-b7dd-bba32f99bedf","Type":"ContainerStarted","Data":"c9bd0e7d18126c083ab00ad807551436bfd3163f6116fe38a8308e4fc08da7fc"}
Jul 26 17:58:35.856403 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.856311    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:58:35.857537 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.857512    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw" event={"ID":"ad30a594-131c-4f24-8fff-86c10061ebd2","Type":"ContainerStarted","Data":"a1c0bde47d019dc16f19281666fe8f5dedc8d1b25cf5a96da2ed511afd4dcc49"}
Jul 26 17:58:35.859039 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.859021    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2t9x2" event={"ID":"2070228b-2e6c-4333-932a-a1e47454dcd1","Type":"ContainerStarted","Data":"d7b9356818a656d11d8938470927c8250aa5dd9e88674b0c630fc31386b45b44"}
Jul 26 17:58:35.869269 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.869228    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kc628" podStartSLOduration=67.34111204 podStartE2EDuration="1m11.869216675s" totalImagesPullingTime="4.528104635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:35.868994077 +0000 UTC m=+72.969246990" watchObservedRunningTime="2026-07-26 17:58:35.869216675 +0000 UTC m=+72.969469559"
Jul 26 17:58:35.886420 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.886384    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2t9x2" podStartSLOduration=67.335372413 podStartE2EDuration="1m11.886369823s" totalImagesPullingTime="4.55099741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:35.885710146 +0000 UTC m=+72.985963058" watchObservedRunningTime="2026-07-26 17:58:35.886369823 +0000 UTC m=+72.986622711"
Jul 26 17:58:35.903580 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.903539    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l2phc" podStartSLOduration=34.3705429 podStartE2EDuration="38.903523991s" totalImagesPullingTime="4.532981091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:35.902385712 +0000 UTC m=+73.002638643" watchObservedRunningTime="2026-07-26 17:58:35.903523991 +0000 UTC m=+73.003776889"
Jul 26 17:58:35.917070 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:35.917030    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wh8hl" podStartSLOduration=68.080675838 podStartE2EDuration="1m12.917018755s" totalImagesPullingTime="4.836342917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:35.916326467 +0000 UTC m=+73.016579354" watchObservedRunningTime="2026-07-26 17:58:35.917018755 +0000 UTC m=+73.017271641"
Jul 26 17:58:36.126013 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:36.125984    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:36.127957 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:36.127934    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/42c4fc8d-2501-47c6-aa2b-86938094f9d0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nb7c5\" (UID: \"42c4fc8d-2501-47c6-aa2b-86938094f9d0\") " pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:36.137313 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:36.137293    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2d24l\""
Jul 26 17:58:36.145304 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:36.145290    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nb7c5"
Jul 26 17:58:36.270964 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:36.268857    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nb7c5"]
Jul 26 17:58:36.274626 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:36.274602    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c4fc8d_2501_47c6_aa2b_86938094f9d0.slice/crio-53ddffd68ca15f7da5ad88cc1a4bdd2b9ef1cb6c901274cda17ccf7407f33bf8 WatchSource:0}: Error finding container 53ddffd68ca15f7da5ad88cc1a4bdd2b9ef1cb6c901274cda17ccf7407f33bf8: Status 404 returned error can't find the container with id 53ddffd68ca15f7da5ad88cc1a4bdd2b9ef1cb6c901274cda17ccf7407f33bf8
Jul 26 17:58:36.865823 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:36.865731    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nb7c5" event={"ID":"42c4fc8d-2501-47c6-aa2b-86938094f9d0","Type":"ContainerStarted","Data":"53ddffd68ca15f7da5ad88cc1a4bdd2b9ef1cb6c901274cda17ccf7407f33bf8"}
Jul 26 17:58:36.868913 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:36.868549    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw" event={"ID":"ad30a594-131c-4f24-8fff-86c10061ebd2","Type":"ContainerStarted","Data":"84d03fd499e8831e266dd50c3ac2c89656af32dcfbd4cb847e13555777091ae6"}
Jul 26 17:58:36.870111 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:36.870067    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw"
Jul 26 17:58:36.876148 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:36.876099    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw"
Jul 26 17:58:36.885770 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:36.885620    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-ck9qw" podStartSLOduration=4.873568706 podStartE2EDuration="5.885604795s" totalImagesPullingTime="1.012036089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:36.885499424 +0000 UTC m=+73.985752310" watchObservedRunningTime="2026-07-26 17:58:36.885604795 +0000 UTC m=+73.985857682"
Jul 26 17:58:37.432702 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.432669    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"]
Jul 26 17:58:37.435801 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.435775    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.439043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.438988    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 26 17:58:37.439043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.439002    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 26 17:58:37.439043 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.439015    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-x2t5s\""
Jul 26 17:58:37.439339 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.439159    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 26 17:58:37.439339 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.439176    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 26 17:58:37.439564 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.439504    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 26 17:58:37.445074 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.444965    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"]
Jul 26 17:58:37.538886 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.538851    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.539033 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.538905    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.539033 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.538996    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpjxg\" (UniqueName: \"kubernetes.io/projected/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-kube-api-access-lpjxg\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.539150 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.539030    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.639834 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.639809    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjxg\" (UniqueName: \"kubernetes.io/projected/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-kube-api-access-lpjxg\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.639982 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.639841    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.639982 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.639874    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.639982 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.639911    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.640700 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.640673    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.642969 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.642942    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.643040 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.642987    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.651771 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.651750    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpjxg\" (UniqueName: \"kubernetes.io/projected/c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8-kube-api-access-lpjxg\") pod \"prometheus-operator-84d69f794d-pxp9l\" (UID: \"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.747760 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.747685    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"
Jul 26 17:58:37.898156 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:37.898082    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-pxp9l"]
Jul 26 17:58:37.902790 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:37.902762    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc88758b1_3fa8_4b1e_8c4a_74e3f5e01bc8.slice/crio-2fcd1ff9d9a00ceeda6bdb4ea34f113542fe772924e20295529e136b8d424b84 WatchSource:0}: Error finding container 2fcd1ff9d9a00ceeda6bdb4ea34f113542fe772924e20295529e136b8d424b84: Status 404 returned error can't find the container with id 2fcd1ff9d9a00ceeda6bdb4ea34f113542fe772924e20295529e136b8d424b84
Jul 26 17:58:38.877829 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:38.877791    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l" event={"ID":"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8","Type":"ContainerStarted","Data":"2fcd1ff9d9a00ceeda6bdb4ea34f113542fe772924e20295529e136b8d424b84"}
Jul 26 17:58:41.889912 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:41.889875    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nb7c5" event={"ID":"42c4fc8d-2501-47c6-aa2b-86938094f9d0","Type":"ContainerStarted","Data":"96f8473615c6f73825224771904d932ea7675c9ec1ad1e26dc0fe297dd49f8d2"}
Jul 26 17:58:41.891606 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:41.891580    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l" event={"ID":"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8","Type":"ContainerStarted","Data":"a3ff3aa55e6fc556c73d69420fdad851e3036285345a9cca8e3c21fe3a1167e9"}
Jul 26 17:58:41.891722 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:41.891628    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l" event={"ID":"c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8","Type":"ContainerStarted","Data":"e9b644e92acf1894310dc572e278b4445b9b5cb35786c192b801bf414d4ee93f"}
Jul 26 17:58:41.909903 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:41.909862    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-pxp9l" podStartSLOduration=1.363194655 podStartE2EDuration="4.909846932s" totalImagesPullingTime="3.546652277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:41.908474326 +0000 UTC m=+79.008727212" watchObservedRunningTime="2026-07-26 17:58:41.909846932 +0000 UTC m=+79.010099807"
Jul 26 17:58:43.817474 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.817427    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"]
Jul 26 17:58:43.833234 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.831535    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:43.835253 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.834020    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6t67t"]
Jul 26 17:58:43.835253 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.834920    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 26 17:58:43.835253 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.835131    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jpqbk\""
Jul 26 17:58:43.835509 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.835299    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 26 17:58:43.835509 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.835388    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 26 17:58:43.839913 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.839894    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"]
Jul 26 17:58:43.840153 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.840139    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:43.846680 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.846660    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 26 17:58:43.846903 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.846885    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 26 17:58:43.847157 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.847125    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-47kbs\""
Jul 26 17:58:43.847373 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.847355    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 26 17:58:43.997560 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997524    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-sys\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:43.997735 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997586    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-accelerators-collector-config\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:43.997735 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997622    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r4mj\" (UniqueName: \"kubernetes.io/projected/d15941df-e0a6-4a4b-891f-6b363d496661-kube-api-access-2r4mj\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:43.997735 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997656    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:43.997735 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997685    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d15941df-e0a6-4a4b-891f-6b363d496661-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:43.997735 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997717    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-metrics-client-ca\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:43.997999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997742    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-wtmp\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:43.997999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997820    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:43.997999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997854    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-textfile\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:43.997999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997879    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-tls\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:43.997999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997920    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wmz8\" (UniqueName: \"kubernetes.io/projected/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-kube-api-access-6wmz8\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:43.997999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997945    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-root\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:43.997999 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.997978    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:43.998335 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.998038    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d15941df-e0a6-4a4b-891f-6b363d496661-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:43.998335 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:43.998099    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.099335 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099265    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r4mj\" (UniqueName: \"kubernetes.io/projected/d15941df-e0a6-4a4b-891f-6b363d496661-kube-api-access-2r4mj\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.099335 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099300    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.099335 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099322    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d15941df-e0a6-4a4b-891f-6b363d496661-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099353    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-metrics-client-ca\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099370    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-wtmp\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099392    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099407    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-textfile\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099427    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-tls\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099455    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wmz8\" (UniqueName: \"kubernetes.io/projected/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-kube-api-access-6wmz8\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099471    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-root\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099490    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099516    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d15941df-e0a6-4a4b-891f-6b363d496661-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099534    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099556    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-sys\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.099596 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.099586    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-accelerators-collector-config\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.100254 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.100067    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-accelerators-collector-config\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.100774 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:44.100707    2548 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 26 17:58:44.100774 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:44.100775    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-tls podName:8b6d90cf-e881-4866-9f6d-90337c0d7b0a nodeName:}" failed. No retries permitted until 2026-07-26 17:58:44.600754892 +0000 UTC m=+81.701007772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-tls") pod "node-exporter-6t67t" (UID: "8b6d90cf-e881-4866-9f6d-90337c0d7b0a") : secret "node-exporter-tls" not found
Jul 26 17:58:44.102245 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.101363    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.102245 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.101521    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d15941df-e0a6-4a4b-891f-6b363d496661-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.102245 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.101633    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d15941df-e0a6-4a4b-891f-6b363d496661-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.102245 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.101699    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-sys\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.102245 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:44.101775    2548 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 26 17:58:44.102245 ip-10-0-143-214 kubenswrapper[2548]: E0726 17:58:44.101820    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-tls podName:d15941df-e0a6-4a4b-891f-6b363d496661 nodeName:}" failed. No retries permitted until 2026-07-26 17:58:44.601804202 +0000 UTC m=+81.702057078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-b8lj2" (UID: "d15941df-e0a6-4a4b-891f-6b363d496661") : secret "kube-state-metrics-tls" not found
Jul 26 17:58:44.102245 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.101920    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-metrics-client-ca\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.102245 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.101935    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-wtmp\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.102245 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.101989    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-root\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.102245 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.102132    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-textfile\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.109101 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.109059    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r4mj\" (UniqueName: \"kubernetes.io/projected/d15941df-e0a6-4a4b-891f-6b363d496661-kube-api-access-2r4mj\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.110381 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.110340    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wmz8\" (UniqueName: \"kubernetes.io/projected/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-kube-api-access-6wmz8\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.110778 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.110754    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.114693 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.114605    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.605556 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.605519    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.605556 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.605559    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-tls\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.608070 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.608046    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8b6d90cf-e881-4866-9f6d-90337c0d7b0a-node-exporter-tls\") pod \"node-exporter-6t67t\" (UID: \"8b6d90cf-e881-4866-9f6d-90337c0d7b0a\") " pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.608209 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.608145    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d15941df-e0a6-4a4b-891f-6b363d496661-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-b8lj2\" (UID: \"d15941df-e0a6-4a4b-891f-6b363d496661\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.749778 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.749743    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"
Jul 26 17:58:44.757754 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.757689    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6t67t"
Jul 26 17:58:44.895934 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.895903    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 26 17:58:44.901504 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.901482    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:44.904752 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.904728    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 26 17:58:44.905575 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.905550    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 26 17:58:44.905575 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.905566    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 26 17:58:44.905741 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.905594    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 26 17:58:44.905741 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.905672    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 26 17:58:44.905877 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.905858    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 26 17:58:44.906003 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.905986    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 26 17:58:44.906144 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.906126    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-577xj\""
Jul 26 17:58:44.906484 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.906467    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 26 17:58:44.911143 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.911123    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 26 17:58:44.921259 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:44.921233    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 26 17:58:45.008272 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008244    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-tls-assets\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008417 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008283    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008417 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008328    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z598c\" (UniqueName: \"kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-kube-api-access-z598c\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008417 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008361    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008584 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008435    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-web-config\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008584 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008472    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-out\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008584 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008496    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008682 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008586    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008682 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008627    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008682 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008659    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-volume\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008785 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008714    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008785 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008757    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.008863 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.008799    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.037702 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:45.037667    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6d90cf_e881_4866_9f6d_90337c0d7b0a.slice/crio-b7841c70a7354f6b6cd02582f2abb5046b41c0448b5c6155c10067aeb5fd1782 WatchSource:0}: Error finding container b7841c70a7354f6b6cd02582f2abb5046b41c0448b5c6155c10067aeb5fd1782: Status 404 returned error can't find the container with id b7841c70a7354f6b6cd02582f2abb5046b41c0448b5c6155c10067aeb5fd1782
Jul 26 17:58:45.109723 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.109697    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.109839 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.109751    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-tls-assets\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.109839 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.109777    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.109839 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.109802    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z598c\" (UniqueName: \"kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-kube-api-access-z598c\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.109839 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.109833    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.110048 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.109864    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-web-config\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.110048 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.109891    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-out\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.110048 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.109914    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.110048 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.109946    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.110048 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.109977    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.110048 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.110009    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-volume\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.110350 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.110051    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.110350 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.110084    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.111299 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.110885    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.111299 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.111068    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.111956 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.111639    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.113096 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.113059    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.113447 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.113421    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-out\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.114745 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.114707    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.117297 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.117253    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-web-config\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.119250 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.119182    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-tls-assets\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.119802 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.119510    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.119802 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.119649    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.119802 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.119769    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.119802 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.119768    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-volume\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.122080 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.122058    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z598c\" (UniqueName: \"kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-kube-api-access-z598c\") pod \"alertmanager-main-0\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.158331 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.158174    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2"]
Jul 26 17:58:45.160735 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:45.160706    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd15941df_e0a6_4a4b_891f_6b363d496661.slice/crio-8e9b42c998d0e86421322fbe102aafbd7460eba180c858e5597bdacc7cdaa56f WatchSource:0}: Error finding container 8e9b42c998d0e86421322fbe102aafbd7460eba180c858e5597bdacc7cdaa56f: Status 404 returned error can't find the container with id 8e9b42c998d0e86421322fbe102aafbd7460eba180c858e5597bdacc7cdaa56f
Jul 26 17:58:45.212330 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.212308    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 26 17:58:45.339381 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.339355    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 26 17:58:45.341642 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:45.341618    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75d9d0d6_0b80_4f8d_97b5_f4ca84a0b323.slice/crio-82eccc66b1546f9979b28e51be6763f326a6c2e6a24ced0675bbbaab3bbc80b0 WatchSource:0}: Error finding container 82eccc66b1546f9979b28e51be6763f326a6c2e6a24ced0675bbbaab3bbc80b0: Status 404 returned error can't find the container with id 82eccc66b1546f9979b28e51be6763f326a6c2e6a24ced0675bbbaab3bbc80b0
Jul 26 17:58:45.872377 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.871467    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l2phc"
Jul 26 17:58:45.915868 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.915831    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerStarted","Data":"82eccc66b1546f9979b28e51be6763f326a6c2e6a24ced0675bbbaab3bbc80b0"}
Jul 26 17:58:45.918253 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.918222    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6t67t" event={"ID":"8b6d90cf-e881-4866-9f6d-90337c0d7b0a","Type":"ContainerStarted","Data":"b7841c70a7354f6b6cd02582f2abb5046b41c0448b5c6155c10067aeb5fd1782"}
Jul 26 17:58:45.922171 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.922144    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2" event={"ID":"d15941df-e0a6-4a4b-891f-6b363d496661","Type":"ContainerStarted","Data":"8e9b42c998d0e86421322fbe102aafbd7460eba180c858e5597bdacc7cdaa56f"}
Jul 26 17:58:45.932854 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:45.928053    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nb7c5" event={"ID":"42c4fc8d-2501-47c6-aa2b-86938094f9d0","Type":"ContainerStarted","Data":"8cbb1a27b5d4d6eba78c15c17ef0e0c22a664eb0ea202a999a5f4a6c1d0ddca4"}
Jul 26 17:58:46.933735 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:46.933701    2548 generic.go:356] "Generic (PLEG): container finished" podID="8b6d90cf-e881-4866-9f6d-90337c0d7b0a" containerID="d8e46da719ed25d226becc31865f8d18762bfd2d2bb5964f77ac0205b5d41b82" exitCode=0
Jul 26 17:58:46.934078 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:46.933785    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6t67t" event={"ID":"8b6d90cf-e881-4866-9f6d-90337c0d7b0a","Type":"ContainerDied","Data":"d8e46da719ed25d226becc31865f8d18762bfd2d2bb5964f77ac0205b5d41b82"}
Jul 26 17:58:47.816107 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:47.816081    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-745cdf97bc-55rsk"
Jul 26 17:58:47.940037 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:47.940004    2548 generic.go:356] "Generic (PLEG): container finished" podID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerID="95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037" exitCode=0
Jul 26 17:58:47.940494 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:47.940081    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerDied","Data":"95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037"}
Jul 26 17:58:47.942939 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:47.942893    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6t67t" event={"ID":"8b6d90cf-e881-4866-9f6d-90337c0d7b0a","Type":"ContainerStarted","Data":"79eb17adf37bff4eb6e925bb9c1aa991c36411030b14b985236ff0cc9f84de0d"}
Jul 26 17:58:47.943039 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:47.942968    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6t67t" event={"ID":"8b6d90cf-e881-4866-9f6d-90337c0d7b0a","Type":"ContainerStarted","Data":"c7d4a6348470e1f52604be478258f5cd073794e9fe4ffa36fc105b0cbbf072f2"}
Jul 26 17:58:47.945666 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:47.945637    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2" event={"ID":"d15941df-e0a6-4a4b-891f-6b363d496661","Type":"ContainerStarted","Data":"03aa25f756bbd4284feaa8f7233a19e0321f2d85d3c5057848315ffc4810ed69"}
Jul 26 17:58:47.945795 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:47.945690    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2" event={"ID":"d15941df-e0a6-4a4b-891f-6b363d496661","Type":"ContainerStarted","Data":"a37c2f468a9d7af0b2c3a0ff98cb925e40102c3dd11ee9211bf647f071ab9bdb"}
Jul 26 17:58:47.945795 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:47.945715    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2" event={"ID":"d15941df-e0a6-4a4b-891f-6b363d496661","Type":"ContainerStarted","Data":"4ed7f725eacab3512b74b87bee6a1e6cbcf5f2be1c7be61e8acd276544c17848"}
Jul 26 17:58:47.986592 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:47.986536    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-b8lj2" podStartSLOduration=3.243663335 podStartE2EDuration="4.986516935s" totalImagesPullingTime="1.7428536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:47.9864349 +0000 UTC m=+85.086687788" watchObservedRunningTime="2026-07-26 17:58:47.986516935 +0000 UTC m=+85.086769811"
Jul 26 17:58:48.016570 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:48.016514    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6t67t" podStartSLOduration=3.870830666 podStartE2EDuration="5.016494007s" totalImagesPullingTime="1.0707297s" totalInitContainerRuntime="74.933641ms" isStatefulPod=true podCreationTimestamp="2026-07-26 17:58:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:48.016363968 +0000 UTC m=+85.116616847" watchObservedRunningTime="2026-07-26 17:58:48.016494007 +0000 UTC m=+85.116746893"
Jul 26 17:58:49.956588 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:49.956548    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nb7c5" event={"ID":"42c4fc8d-2501-47c6-aa2b-86938094f9d0","Type":"ContainerStarted","Data":"88135200b19a84fd85c4f4e5964bef43973d7f9eff45bc70c48eae8fd2c20ed8"}
Jul 26 17:58:49.974642 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:49.974591    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nb7c5" podStartSLOduration=33.274166057 podStartE2EDuration="45.974575152s" totalImagesPullingTime="12.700409095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 17:58:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:49.973127458 +0000 UTC m=+87.073380377" watchObservedRunningTime="2026-07-26 17:58:49.974575152 +0000 UTC m=+87.074828039"
Jul 26 17:58:50.408883 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.408858    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 26 17:58:50.414771 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.414749    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.417572 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.417545    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 26 17:58:50.417808 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.417787    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 26 17:58:50.418227 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.418206    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 26 17:58:50.418897 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.418876    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 26 17:58:50.418993 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.418927    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 26 17:58:50.419082 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.419063    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 26 17:58:50.419247 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.419103    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 26 17:58:50.419322 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.419117    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 26 17:58:50.419420 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.419127    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 26 17:58:50.419586 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.419568    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 26 17:58:50.419959 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.419941    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 26 17:58:50.420035 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.419971    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 26 17:58:50.420169 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.420150    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b3otgl206cgmq\""
Jul 26 17:58:50.420580 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.420541    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qcnhp\""
Jul 26 17:58:50.420983 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.420958    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 26 17:58:50.422034 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.422014    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 26 17:58:50.425011 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.424990    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 26 17:58:50.442755 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.442728    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 26 17:58:50.561405 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561377    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561486 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561426    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561486 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561454    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561593 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561506    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561593 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561530    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561593 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561559    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561593 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561582    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561769 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561677    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561769 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561704    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561769 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561733    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561769 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561748    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561969 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561772    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561969 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561810    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4cq8\" (UniqueName: \"kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-kube-api-access-p4cq8\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561969 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561840    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561969 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561864    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561969 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561901    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561969 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561918    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561969 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561935    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.561969 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561951    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.562381 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.561974    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.662919    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.662964    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.662990    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663015    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663039    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663062    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663101    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663131    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663158    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663207    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663229    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663257    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663282    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663329    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663352    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663386    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.663587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663408    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.664553 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663441    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.664553 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663469    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4cq8\" (UniqueName: \"kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-kube-api-access-p4cq8\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.664553 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.663498    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.664553 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.664267    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.664553 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.664352    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.665378 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.665319    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.666902 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.666719    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.667867 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.667286    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.667867 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.667431    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.667867 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.667821    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.668076 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.667870    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.668433 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.668409    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.669746 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.669024    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.669746 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.669064    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.669746 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.669164    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.669746 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.669547    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.669746 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.669684    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.670426 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.670394    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.670794 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.670762    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.670859 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.670790    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.671069 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.671053    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.671463 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.671434    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.676576 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.676557    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4cq8\" (UniqueName: \"kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-kube-api-access-p4cq8\") pod \"prometheus-k8s-0\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.733427 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.733401    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:58:50.885365 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.885331    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 26 17:58:50.888939 ip-10-0-143-214 kubenswrapper[2548]: W0726 17:58:50.888912    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bbc990e_6ef5_49cf_9c1b_076700c0a7dc.slice/crio-d56865c76ef43adcaeffb8a3c717339158205a6aca912edbb0939e3a78661cf0 WatchSource:0}: Error finding container d56865c76ef43adcaeffb8a3c717339158205a6aca912edbb0939e3a78661cf0: Status 404 returned error can't find the container with id d56865c76ef43adcaeffb8a3c717339158205a6aca912edbb0939e3a78661cf0
Jul 26 17:58:50.962233 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.962185    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerStarted","Data":"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"}
Jul 26 17:58:50.962557 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.962270    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerStarted","Data":"d56865c76ef43adcaeffb8a3c717339158205a6aca912edbb0939e3a78661cf0"}
Jul 26 17:58:50.965361 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.965328    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerStarted","Data":"f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97"}
Jul 26 17:58:50.965457 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.965390    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerStarted","Data":"c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2"}
Jul 26 17:58:50.965457 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.965421    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerStarted","Data":"8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7"}
Jul 26 17:58:50.965457 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.965452    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerStarted","Data":"3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643"}
Jul 26 17:58:50.965556 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:50.965478    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerStarted","Data":"fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f"}
Jul 26 17:58:51.972436 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:51.972402    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerStarted","Data":"41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d"}
Jul 26 17:58:51.974068 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:51.974040    2548 generic.go:356] "Generic (PLEG): container finished" podID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerID="7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787" exitCode=0
Jul 26 17:58:51.974222 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:51.974094    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerDied","Data":"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"}
Jul 26 17:58:51.998870 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:51.998824    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.177807323 podStartE2EDuration="7.998806287s" totalImagesPullingTime="4.798118693s" totalInitContainerRuntime="22.880271ms" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:51.996150948 +0000 UTC m=+89.096403835" watchObservedRunningTime="2026-07-26 17:58:51.998806287 +0000 UTC m=+89.099059174"
Jul 26 17:58:55.992890 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:55.992850    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerStarted","Data":"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"}
Jul 26 17:58:55.993299 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:55.992965    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerStarted","Data":"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"}
Jul 26 17:58:56.999978 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:56.999954    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerStarted","Data":"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"}
Jul 26 17:58:57.000269 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:57.000020    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerStarted","Data":"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"}
Jul 26 17:58:57.000269 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:57.000046    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerStarted","Data":"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"}
Jul 26 17:58:58.007544 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:58.007504    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerStarted","Data":"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"}
Jul 26 17:58:58.049536 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:58:58.049466    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.376529908 podStartE2EDuration="8.049443258s" totalImagesPullingTime="4.649056503s" totalInitContainerRuntime="23.856847ms" isStatefulPod=false podCreationTimestamp="2026-07-26 17:58:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 17:58:58.047811883 +0000 UTC m=+95.148064819" watchObservedRunningTime="2026-07-26 17:58:58.049443258 +0000 UTC m=+95.149696145"
Jul 26 17:59:00.734502 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:00.734470    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:59:06.870495 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:06.870470    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wh8hl"
Jul 26 17:59:20.312350 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:20.312313    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323/init-config-reloader/0.log"
Jul 26 17:59:20.511837 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:20.511807    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323/alertmanager/0.log"
Jul 26 17:59:20.711534 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:20.711511    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323/config-reloader/0.log"
Jul 26 17:59:20.912567 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:20.912543    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323/kube-rbac-proxy-web/0.log"
Jul 26 17:59:21.111774 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:21.111745    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323/kube-rbac-proxy/0.log"
Jul 26 17:59:21.311587 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:21.311558    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323/kube-rbac-proxy-metric/0.log"
Jul 26 17:59:21.511939 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:21.511876    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323/prom-label-proxy/0.log"
Jul 26 17:59:21.912044 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:21.912014    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b8lj2_d15941df-e0a6-4a4b-891f-6b363d496661/kube-state-metrics/0.log"
Jul 26 17:59:22.111566 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:22.111538    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b8lj2_d15941df-e0a6-4a4b-891f-6b363d496661/kube-rbac-proxy-main/0.log"
Jul 26 17:59:22.311944 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:22.311881    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b8lj2_d15941df-e0a6-4a4b-891f-6b363d496661/kube-rbac-proxy-self/0.log"
Jul 26 17:59:22.911669 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:22.911644    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6t67t_8b6d90cf-e881-4866-9f6d-90337c0d7b0a/init-textfile/0.log"
Jul 26 17:59:23.112322 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:23.112294    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6t67t_8b6d90cf-e881-4866-9f6d-90337c0d7b0a/node-exporter/0.log"
Jul 26 17:59:23.311635 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:23.311569    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6t67t_8b6d90cf-e881-4866-9f6d-90337c0d7b0a/kube-rbac-proxy/0.log"
Jul 26 17:59:25.312513 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:25.312478    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbc990e-6ef5-49cf-9c1b-076700c0a7dc/init-config-reloader/0.log"
Jul 26 17:59:25.513224 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:25.513180    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbc990e-6ef5-49cf-9c1b-076700c0a7dc/prometheus/0.log"
Jul 26 17:59:25.712107 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:25.712077    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbc990e-6ef5-49cf-9c1b-076700c0a7dc/config-reloader/0.log"
Jul 26 17:59:25.913355 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:25.913328    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbc990e-6ef5-49cf-9c1b-076700c0a7dc/thanos-sidecar/0.log"
Jul 26 17:59:26.111665 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:26.111643    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbc990e-6ef5-49cf-9c1b-076700c0a7dc/kube-rbac-proxy-web/0.log"
Jul 26 17:59:26.311864 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:26.311845    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbc990e-6ef5-49cf-9c1b-076700c0a7dc/kube-rbac-proxy/0.log"
Jul 26 17:59:26.512463 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:26.512398    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8bbc990e-6ef5-49cf-9c1b-076700c0a7dc/kube-rbac-proxy-thanos/0.log"
Jul 26 17:59:26.713512 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:26.713485    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-pxp9l_c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8/prometheus-operator/0.log"
Jul 26 17:59:26.911962 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:26.911934    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-pxp9l_c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8/kube-rbac-proxy/0.log"
Jul 26 17:59:27.112066 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:27.112041    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-ck9qw_ad30a594-131c-4f24-8fff-86c10061ebd2/prometheus-operator-admission-webhook/0.log"
Jul 26 17:59:30.112322 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:30.112293    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jnt8g_2607b65c-acd1-4091-a34e-d40a67ff9ede/serve-healthcheck-canary/0.log"
Jul 26 17:59:50.733857 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:50.733819    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:59:50.752975 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:50.752947    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 17:59:51.219968 ip-10-0-143-214 kubenswrapper[2548]: I0726 17:59:51.219939    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:04.459468 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:04.459431    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 26 18:00:04.459871 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:04.459708    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="alertmanager" containerID="cri-o://fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f" gracePeriod=120
Jul 26 18:00:04.459871 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:04.459770    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy-metric" containerID="cri-o://f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97" gracePeriod=120
Jul 26 18:00:04.459871 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:04.459791    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy-web" containerID="cri-o://8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7" gracePeriod=120
Jul 26 18:00:04.459871 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:04.459822    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy" containerID="cri-o://c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2" gracePeriod=120
Jul 26 18:00:04.460074 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:04.459850    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="config-reloader" containerID="cri-o://3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643" gracePeriod=120
Jul 26 18:00:04.460074 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:04.459854    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="prom-label-proxy" containerID="cri-o://41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d" gracePeriod=120
Jul 26 18:00:05.261884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.261849    2548 generic.go:356] "Generic (PLEG): container finished" podID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerID="41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d" exitCode=0
Jul 26 18:00:05.261884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.261875    2548 generic.go:356] "Generic (PLEG): container finished" podID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerID="c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2" exitCode=0
Jul 26 18:00:05.261884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.261881    2548 generic.go:356] "Generic (PLEG): container finished" podID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerID="3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643" exitCode=0
Jul 26 18:00:05.261884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.261887    2548 generic.go:356] "Generic (PLEG): container finished" podID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerID="fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f" exitCode=0
Jul 26 18:00:05.262151 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.261909    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerDied","Data":"41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d"}
Jul 26 18:00:05.262151 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.261960    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerDied","Data":"c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2"}
Jul 26 18:00:05.262151 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.261986    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerDied","Data":"3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643"}
Jul 26 18:00:05.262151 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.262009    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerDied","Data":"fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f"}
Jul 26 18:00:05.802377 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.802355    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 26 18:00:05.937298 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937261    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z598c\" (UniqueName: \"kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-kube-api-access-z598c\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937307    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-web-config\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937329    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-main-tls\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937380    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-trusted-ca-bundle\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937397    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-main-db\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937420    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-cluster-tls-config\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937446    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937766 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937473    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-tls-assets\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937766 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937520    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-web\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937766 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937550    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-metric\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937766 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937589    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-out\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937766 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937636    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-metrics-client-ca\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937766 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937661    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-volume\") pod \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\" (UID: \"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323\") "
Jul 26 18:00:05.937766 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937743    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:00:05.938123 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937823    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:00:05.938123 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937951    2548 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:05.938123 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.937970    2548 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-alertmanager-main-db\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:05.938666 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.938474    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:00:05.941657 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.941624    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-kube-api-access-z598c" (OuterVolumeSpecName: "kube-api-access-z598c") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "kube-api-access-z598c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:00:05.941752 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.941683    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:05.941752 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.941698    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-out" (OuterVolumeSpecName: "config-out") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:00:05.941752 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.941722    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:00:05.941752 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.941730    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:05.941752 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.941744    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:05.941989 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.941756    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-volume" (OuterVolumeSpecName: "config-volume") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:05.942067 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.942049    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:05.945173 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.945059    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:05.951023 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:05.951004    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-web-config" (OuterVolumeSpecName: "web-config") pod "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" (UID: "75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:06.039000 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.038950    2548 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-cluster-tls-config\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.039000 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.038969    2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.039000 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.038979    2548 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-tls-assets\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.039000 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.038989    2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.039000 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.038997    2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.039212 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.039008    2548 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-out\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.039212 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.039017    2548 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-metrics-client-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.039212 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.039025    2548 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-config-volume\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.039212 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.039033    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z598c\" (UniqueName: \"kubernetes.io/projected/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-kube-api-access-z598c\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.039212 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.039041    2548 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-web-config\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.039212 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.039049    2548 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323-secret-alertmanager-main-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:06.268653 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.268618    2548 generic.go:356] "Generic (PLEG): container finished" podID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerID="f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97" exitCode=0
Jul 26 18:00:06.268653 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.268647    2548 generic.go:356] "Generic (PLEG): container finished" podID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerID="8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7" exitCode=0
Jul 26 18:00:06.268858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.268709    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 26 18:00:06.268858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.268708    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerDied","Data":"f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97"}
Jul 26 18:00:06.268858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.268823    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerDied","Data":"8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7"}
Jul 26 18:00:06.268998 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.268867    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323","Type":"ContainerDied","Data":"82eccc66b1546f9979b28e51be6763f326a6c2e6a24ced0675bbbaab3bbc80b0"}
Jul 26 18:00:06.268998 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.268894    2548 scope.go:117] "RemoveContainer" containerID="41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d"
Jul 26 18:00:06.276696 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.276628    2548 scope.go:117] "RemoveContainer" containerID="f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97"
Jul 26 18:00:06.283264 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.283233    2548 scope.go:117] "RemoveContainer" containerID="c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2"
Jul 26 18:00:06.289519 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.289503    2548 scope.go:117] "RemoveContainer" containerID="8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7"
Jul 26 18:00:06.295611 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.295585    2548 scope.go:117] "RemoveContainer" containerID="3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643"
Jul 26 18:00:06.301967 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.301952    2548 scope.go:117] "RemoveContainer" containerID="fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f"
Jul 26 18:00:06.311119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.311099    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 26 18:00:06.311932 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.311915    2548 scope.go:117] "RemoveContainer" containerID="95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037"
Jul 26 18:00:06.318212 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.318179    2548 scope.go:117] "RemoveContainer" containerID="41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d"
Jul 26 18:00:06.318513 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:06.318486    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d\": container with ID starting with 41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d not found: ID does not exist" containerID="41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d"
Jul 26 18:00:06.318686 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.318522    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d"} err="failed to get container status \"41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d\": rpc error: code = NotFound desc = could not find container \"41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d\": container with ID starting with 41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d not found: ID does not exist"
Jul 26 18:00:06.318686 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.318562    2548 scope.go:117] "RemoveContainer" containerID="f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97"
Jul 26 18:00:06.318920 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:06.318851    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97\": container with ID starting with f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97 not found: ID does not exist" containerID="f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97"
Jul 26 18:00:06.319016 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.318912    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97"} err="failed to get container status \"f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97\": rpc error: code = NotFound desc = could not find container \"f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97\": container with ID starting with f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97 not found: ID does not exist"
Jul 26 18:00:06.319016 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.318968    2548 scope.go:117] "RemoveContainer" containerID="c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2"
Jul 26 18:00:06.319467 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:06.319328    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2\": container with ID starting with c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2 not found: ID does not exist" containerID="c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2"
Jul 26 18:00:06.319467 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.319359    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2"} err="failed to get container status \"c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2\": rpc error: code = NotFound desc = could not find container \"c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2\": container with ID starting with c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2 not found: ID does not exist"
Jul 26 18:00:06.319467 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.319378    2548 scope.go:117] "RemoveContainer" containerID="8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7"
Jul 26 18:00:06.319820 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:06.319697    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7\": container with ID starting with 8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7 not found: ID does not exist" containerID="8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7"
Jul 26 18:00:06.319820 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.319719    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7"} err="failed to get container status \"8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7\": rpc error: code = NotFound desc = could not find container \"8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7\": container with ID starting with 8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7 not found: ID does not exist"
Jul 26 18:00:06.319820 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.319737    2548 scope.go:117] "RemoveContainer" containerID="3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643"
Jul 26 18:00:06.320123 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:06.320048    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643\": container with ID starting with 3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643 not found: ID does not exist" containerID="3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643"
Jul 26 18:00:06.320123 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.320084    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643"} err="failed to get container status \"3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643\": rpc error: code = NotFound desc = could not find container \"3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643\": container with ID starting with 3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643 not found: ID does not exist"
Jul 26 18:00:06.320123 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.320104    2548 scope.go:117] "RemoveContainer" containerID="fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f"
Jul 26 18:00:06.320412 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:06.320393    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f\": container with ID starting with fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f not found: ID does not exist" containerID="fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f"
Jul 26 18:00:06.320461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.320416    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f"} err="failed to get container status \"fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f\": rpc error: code = NotFound desc = could not find container \"fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f\": container with ID starting with fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f not found: ID does not exist"
Jul 26 18:00:06.320461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.320432    2548 scope.go:117] "RemoveContainer" containerID="95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037"
Jul 26 18:00:06.320664 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:06.320649    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037\": container with ID starting with 95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037 not found: ID does not exist" containerID="95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037"
Jul 26 18:00:06.320705 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.320669    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037"} err="failed to get container status \"95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037\": rpc error: code = NotFound desc = could not find container \"95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037\": container with ID starting with 95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037 not found: ID does not exist"
Jul 26 18:00:06.320705 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.320682    2548 scope.go:117] "RemoveContainer" containerID="41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d"
Jul 26 18:00:06.320939 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.320922    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d"} err="failed to get container status \"41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d\": rpc error: code = NotFound desc = could not find container \"41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d\": container with ID starting with 41955d3016632051cfab40c6dc9bc62219900f1b87a4b70fcdf3519770dd847d not found: ID does not exist"
Jul 26 18:00:06.321009 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.320938    2548 scope.go:117] "RemoveContainer" containerID="f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97"
Jul 26 18:00:06.321143 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321127    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97"} err="failed to get container status \"f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97\": rpc error: code = NotFound desc = could not find container \"f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97\": container with ID starting with f1fe9fe8401fae3b35014086b50c49f396188a7fa33971c9895361ec2fdc7b97 not found: ID does not exist"
Jul 26 18:00:06.321208 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321144    2548 scope.go:117] "RemoveContainer" containerID="c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2"
Jul 26 18:00:06.321304 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321282    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 26 18:00:06.321396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321353    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2"} err="failed to get container status \"c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2\": rpc error: code = NotFound desc = could not find container \"c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2\": container with ID starting with c66fbadb636c126ca57fd6da78374c2d46c660b127322ca8f65db9509925a0a2 not found: ID does not exist"
Jul 26 18:00:06.321396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321366    2548 scope.go:117] "RemoveContainer" containerID="8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7"
Jul 26 18:00:06.321589 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321568    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7"} err="failed to get container status \"8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7\": rpc error: code = NotFound desc = could not find container \"8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7\": container with ID starting with 8a98aa78bdddbccc40acdbe15140c1de5c9681dab547d2dae8f6a4aa09e9fab7 not found: ID does not exist"
Jul 26 18:00:06.321629 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321599    2548 scope.go:117] "RemoveContainer" containerID="3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643"
Jul 26 18:00:06.321786 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321769    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643"} err="failed to get container status \"3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643\": rpc error: code = NotFound desc = could not find container \"3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643\": container with ID starting with 3b8bc7e35b0e575545879ec508e7b67ee46a28f25c3c85087fca5a8f0a31d643 not found: ID does not exist"
Jul 26 18:00:06.321834 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321786    2548 scope.go:117] "RemoveContainer" containerID="fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f"
Jul 26 18:00:06.321995 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321979    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f"} err="failed to get container status \"fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f\": rpc error: code = NotFound desc = could not find container \"fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f\": container with ID starting with fc89148d8f406f361213e6bce18e8a6342bb8ab08d9d947a116336acb02bde2f not found: ID does not exist"
Jul 26 18:00:06.322048 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.321995    2548 scope.go:117] "RemoveContainer" containerID="95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037"
Jul 26 18:00:06.322186 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:06.322171    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037"} err="failed to get container status \"95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037\": rpc error: code = NotFound desc = could not find container \"95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037\": container with ID starting with 95cab027e05389fa80b1d1b787c7689b900f00d3d581c3972400a547038f4037 not found: ID does not exist"
Jul 26 18:00:07.412515 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:07.412484    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" path="/var/lib/kubelet/pods/75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323/volumes"
Jul 26 18:00:08.771309 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:08.771276    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 26 18:00:08.771730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:08.771580    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="prometheus" containerID="cri-o://63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5" gracePeriod=600
Jul 26 18:00:08.771730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:08.771617    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy" containerID="cri-o://5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2" gracePeriod=600
Jul 26 18:00:08.771730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:08.771677    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b" gracePeriod=600
Jul 26 18:00:08.771898 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:08.771658    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="config-reloader" containerID="cri-o://ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc" gracePeriod=600
Jul 26 18:00:08.771898 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:08.771608    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="thanos-sidecar" containerID="cri-o://e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e" gracePeriod=600
Jul 26 18:00:08.771898 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:08.771829    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy-web" containerID="cri-o://76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25" gracePeriod=600
Jul 26 18:00:09.017330 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.017299    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.164408 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164377    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-serving-certs-ca-bundle\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.164408 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164410    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-thanos-prometheus-http-client-file\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.164649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164431    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-0\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.164649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164453    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-1\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.164649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164480    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-web-config\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.164649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164499    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-db\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.164649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164514    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-metrics-client-ca\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.164649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164542    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.164649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164565    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config-out\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.164649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164593    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-kubelet-serving-ca-bundle\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.164649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164643    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.165089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164686    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4cq8\" (UniqueName: \"kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-kube-api-access-p4cq8\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.165089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164712    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-kube-rbac-proxy\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.165089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164740    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-tls-assets\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.165089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164765    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-metrics-client-certs\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.165089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164769    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:00:09.165089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164828    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.165089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164856    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-2\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.165089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164886    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-tls\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.165089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164921    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-grpc-tls\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.165089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.164987    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-trusted-ca-bundle\") pod \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\" (UID: \"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc\") "
Jul 26 18:00:09.165607 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.165238    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:00:09.165607 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.165247    2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.165607 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.165568    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:00:09.165764 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.165612    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:00:09.165863 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.165841    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:00:09.165990 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.165962    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:00:09.167239 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.166605    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:00:09.167239 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.166923    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:09.167239 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.166945    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:00:09.167239 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.167080    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-kube-api-access-p4cq8" (OuterVolumeSpecName: "kube-api-access-p4cq8") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "kube-api-access-p4cq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:00:09.167709 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.167683    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config" (OuterVolumeSpecName: "config") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:09.168234 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.168185    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:09.168518 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.168491    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config-out" (OuterVolumeSpecName: "config-out") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:00:09.168804 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.168777    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:09.168902 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.168878    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:09.169478 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.169438    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:00:09.169868 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.169836    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:09.169868 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.169860    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:09.170416 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.170395    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:09.176927 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.176908    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-web-config" (OuterVolumeSpecName: "web-config") pod "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" (UID: "8bbc990e-6ef5-49cf-9c1b-076700c0a7dc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:00:09.266208 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266172    2548 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-metrics-client-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266222    2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266234    2548 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config-out\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266245    2548 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266255    2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266263    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4cq8\" (UniqueName: \"kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-kube-api-access-p4cq8\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266271    2548 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-kube-rbac-proxy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266279    2548 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-tls-assets\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266287    2548 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-metrics-client-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266296    2548 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-config\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266304    2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266312    2548 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266321    2548 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-secret-grpc-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266329    2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266337    2548 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266345    2548 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266354    2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266805 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266362    2548 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-web-config\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.266805 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.266370    2548 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc-prometheus-k8s-db\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:00:09.284552 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284518    2548 generic.go:356] "Generic (PLEG): container finished" podID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerID="6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b" exitCode=0
Jul 26 18:00:09.284552 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284550    2548 generic.go:356] "Generic (PLEG): container finished" podID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerID="5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2" exitCode=0
Jul 26 18:00:09.284552 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284556    2548 generic.go:356] "Generic (PLEG): container finished" podID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerID="76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25" exitCode=0
Jul 26 18:00:09.284731 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284562    2548 generic.go:356] "Generic (PLEG): container finished" podID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerID="e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e" exitCode=0
Jul 26 18:00:09.284731 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284567    2548 generic.go:356] "Generic (PLEG): container finished" podID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerID="ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc" exitCode=0
Jul 26 18:00:09.284731 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284572    2548 generic.go:356] "Generic (PLEG): container finished" podID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerID="63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5" exitCode=0
Jul 26 18:00:09.284731 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284591    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerDied","Data":"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"}
Jul 26 18:00:09.284731 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284607    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.284731 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284646    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerDied","Data":"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"}
Jul 26 18:00:09.284731 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284672    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerDied","Data":"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"}
Jul 26 18:00:09.284731 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284699    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerDied","Data":"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"}
Jul 26 18:00:09.284731 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284718    2548 scope.go:117] "RemoveContainer" containerID="6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"
Jul 26 18:00:09.285085 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284723    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerDied","Data":"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"}
Jul 26 18:00:09.285085 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284818    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerDied","Data":"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"}
Jul 26 18:00:09.285085 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.284856    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8bbc990e-6ef5-49cf-9c1b-076700c0a7dc","Type":"ContainerDied","Data":"d56865c76ef43adcaeffb8a3c717339158205a6aca912edbb0939e3a78661cf0"}
Jul 26 18:00:09.295534 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.293226    2548 scope.go:117] "RemoveContainer" containerID="5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"
Jul 26 18:00:09.301539 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.301520    2548 scope.go:117] "RemoveContainer" containerID="76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"
Jul 26 18:00:09.307564 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.307548    2548 scope.go:117] "RemoveContainer" containerID="e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"
Jul 26 18:00:09.311439 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.311416    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 26 18:00:09.314326 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.314307    2548 scope.go:117] "RemoveContainer" containerID="ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"
Jul 26 18:00:09.317736 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.317714    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 26 18:00:09.320573 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.320557    2548 scope.go:117] "RemoveContainer" containerID="63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"
Jul 26 18:00:09.326940 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.326924    2548 scope.go:117] "RemoveContainer" containerID="7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"
Jul 26 18:00:09.333027 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.333014    2548 scope.go:117] "RemoveContainer" containerID="6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"
Jul 26 18:00:09.333312 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:09.333291    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": container with ID starting with 6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b not found: ID does not exist" containerID="6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"
Jul 26 18:00:09.333372 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.333317    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"} err="failed to get container status \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": rpc error: code = NotFound desc = could not find container \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": container with ID starting with 6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b not found: ID does not exist"
Jul 26 18:00:09.333372 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.333334    2548 scope.go:117] "RemoveContainer" containerID="5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"
Jul 26 18:00:09.333586 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:09.333571    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": container with ID starting with 5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2 not found: ID does not exist" containerID="5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"
Jul 26 18:00:09.333635 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.333591    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"} err="failed to get container status \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": rpc error: code = NotFound desc = could not find container \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": container with ID starting with 5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2 not found: ID does not exist"
Jul 26 18:00:09.333635 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.333605    2548 scope.go:117] "RemoveContainer" containerID="76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"
Jul 26 18:00:09.333828 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:09.333813    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": container with ID starting with 76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25 not found: ID does not exist" containerID="76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"
Jul 26 18:00:09.333868 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.333831    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"} err="failed to get container status \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": rpc error: code = NotFound desc = could not find container \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": container with ID starting with 76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25 not found: ID does not exist"
Jul 26 18:00:09.333868 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.333843    2548 scope.go:117] "RemoveContainer" containerID="e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"
Jul 26 18:00:09.334103 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:09.334086    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": container with ID starting with e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e not found: ID does not exist" containerID="e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"
Jul 26 18:00:09.334144 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.334109    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"} err="failed to get container status \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": rpc error: code = NotFound desc = could not find container \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": container with ID starting with e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e not found: ID does not exist"
Jul 26 18:00:09.334144 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.334124    2548 scope.go:117] "RemoveContainer" containerID="ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"
Jul 26 18:00:09.334363 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:09.334349    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": container with ID starting with ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc not found: ID does not exist" containerID="ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"
Jul 26 18:00:09.334413 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.334366    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"} err="failed to get container status \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": rpc error: code = NotFound desc = could not find container \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": container with ID starting with ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc not found: ID does not exist"
Jul 26 18:00:09.334413 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.334378    2548 scope.go:117] "RemoveContainer" containerID="63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"
Jul 26 18:00:09.334596 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:09.334578    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": container with ID starting with 63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5 not found: ID does not exist" containerID="63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"
Jul 26 18:00:09.334685 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.334596    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"} err="failed to get container status \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": rpc error: code = NotFound desc = could not find container \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": container with ID starting with 63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5 not found: ID does not exist"
Jul 26 18:00:09.334685 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.334606    2548 scope.go:117] "RemoveContainer" containerID="7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"
Jul 26 18:00:09.334784 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:00:09.334760    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": container with ID starting with 7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787 not found: ID does not exist" containerID="7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"
Jul 26 18:00:09.334831 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.334789    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"} err="failed to get container status \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": rpc error: code = NotFound desc = could not find container \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": container with ID starting with 7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787 not found: ID does not exist"
Jul 26 18:00:09.334831 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.334801    2548 scope.go:117] "RemoveContainer" containerID="6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"
Jul 26 18:00:09.335126 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.335106    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"} err="failed to get container status \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": rpc error: code = NotFound desc = could not find container \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": container with ID starting with 6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b not found: ID does not exist"
Jul 26 18:00:09.335215 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.335128    2548 scope.go:117] "RemoveContainer" containerID="5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"
Jul 26 18:00:09.335567 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.335544    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"} err="failed to get container status \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": rpc error: code = NotFound desc = could not find container \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": container with ID starting with 5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2 not found: ID does not exist"
Jul 26 18:00:09.335567 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.335566    2548 scope.go:117] "RemoveContainer" containerID="76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"
Jul 26 18:00:09.335811 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.335789    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"} err="failed to get container status \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": rpc error: code = NotFound desc = could not find container \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": container with ID starting with 76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25 not found: ID does not exist"
Jul 26 18:00:09.335851 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.335813    2548 scope.go:117] "RemoveContainer" containerID="e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"
Jul 26 18:00:09.336038 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.336021    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"} err="failed to get container status \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": rpc error: code = NotFound desc = could not find container \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": container with ID starting with e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e not found: ID does not exist"
Jul 26 18:00:09.336088 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.336047    2548 scope.go:117] "RemoveContainer" containerID="ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"
Jul 26 18:00:09.336318 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.336299    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"} err="failed to get container status \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": rpc error: code = NotFound desc = could not find container \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": container with ID starting with ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc not found: ID does not exist"
Jul 26 18:00:09.336362 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.336318    2548 scope.go:117] "RemoveContainer" containerID="63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"
Jul 26 18:00:09.336502 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.336485    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"} err="failed to get container status \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": rpc error: code = NotFound desc = could not find container \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": container with ID starting with 63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5 not found: ID does not exist"
Jul 26 18:00:09.336556 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.336502    2548 scope.go:117] "RemoveContainer" containerID="7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"
Jul 26 18:00:09.336741 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.336724    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"} err="failed to get container status \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": rpc error: code = NotFound desc = could not find container \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": container with ID starting with 7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787 not found: ID does not exist"
Jul 26 18:00:09.336791 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.336741    2548 scope.go:117] "RemoveContainer" containerID="6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"
Jul 26 18:00:09.336976 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.336957    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"} err="failed to get container status \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": rpc error: code = NotFound desc = could not find container \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": container with ID starting with 6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b not found: ID does not exist"
Jul 26 18:00:09.337032 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.336977    2548 scope.go:117] "RemoveContainer" containerID="5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"
Jul 26 18:00:09.337181 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.337165    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"} err="failed to get container status \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": rpc error: code = NotFound desc = could not find container \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": container with ID starting with 5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2 not found: ID does not exist"
Jul 26 18:00:09.337313 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.337182    2548 scope.go:117] "RemoveContainer" containerID="76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"
Jul 26 18:00:09.337398 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.337379    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"} err="failed to get container status \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": rpc error: code = NotFound desc = could not find container \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": container with ID starting with 76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25 not found: ID does not exist"
Jul 26 18:00:09.337440 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.337400    2548 scope.go:117] "RemoveContainer" containerID="e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"
Jul 26 18:00:09.337639 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.337620    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"} err="failed to get container status \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": rpc error: code = NotFound desc = could not find container \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": container with ID starting with e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e not found: ID does not exist"
Jul 26 18:00:09.337695 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.337639    2548 scope.go:117] "RemoveContainer" containerID="ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"
Jul 26 18:00:09.337857 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.337837    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"} err="failed to get container status \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": rpc error: code = NotFound desc = could not find container \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": container with ID starting with ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc not found: ID does not exist"
Jul 26 18:00:09.337918 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.337859    2548 scope.go:117] "RemoveContainer" containerID="63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"
Jul 26 18:00:09.338067 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.338049    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"} err="failed to get container status \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": rpc error: code = NotFound desc = could not find container \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": container with ID starting with 63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5 not found: ID does not exist"
Jul 26 18:00:09.338116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.338068    2548 scope.go:117] "RemoveContainer" containerID="7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"
Jul 26 18:00:09.338263 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.338247    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"} err="failed to get container status \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": rpc error: code = NotFound desc = could not find container \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": container with ID starting with 7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787 not found: ID does not exist"
Jul 26 18:00:09.338316 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.338264    2548 scope.go:117] "RemoveContainer" containerID="6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"
Jul 26 18:00:09.338485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.338469    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"} err="failed to get container status \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": rpc error: code = NotFound desc = could not find container \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": container with ID starting with 6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b not found: ID does not exist"
Jul 26 18:00:09.338528 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.338486    2548 scope.go:117] "RemoveContainer" containerID="5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"
Jul 26 18:00:09.338687 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.338670    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"} err="failed to get container status \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": rpc error: code = NotFound desc = could not find container \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": container with ID starting with 5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2 not found: ID does not exist"
Jul 26 18:00:09.338736 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.338687    2548 scope.go:117] "RemoveContainer" containerID="76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"
Jul 26 18:00:09.338887 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.338868    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"} err="failed to get container status \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": rpc error: code = NotFound desc = could not find container \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": container with ID starting with 76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25 not found: ID does not exist"
Jul 26 18:00:09.338942 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.338888    2548 scope.go:117] "RemoveContainer" containerID="e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"
Jul 26 18:00:09.339118 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.339103    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"} err="failed to get container status \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": rpc error: code = NotFound desc = could not find container \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": container with ID starting with e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e not found: ID does not exist"
Jul 26 18:00:09.339118 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.339118    2548 scope.go:117] "RemoveContainer" containerID="ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"
Jul 26 18:00:09.339365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.339344    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"} err="failed to get container status \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": rpc error: code = NotFound desc = could not find container \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": container with ID starting with ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc not found: ID does not exist"
Jul 26 18:00:09.339365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.339365    2548 scope.go:117] "RemoveContainer" containerID="63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"
Jul 26 18:00:09.339582 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.339566    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"} err="failed to get container status \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": rpc error: code = NotFound desc = could not find container \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": container with ID starting with 63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5 not found: ID does not exist"
Jul 26 18:00:09.339636 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.339582    2548 scope.go:117] "RemoveContainer" containerID="7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"
Jul 26 18:00:09.339796 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.339779    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"} err="failed to get container status \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": rpc error: code = NotFound desc = could not find container \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": container with ID starting with 7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787 not found: ID does not exist"
Jul 26 18:00:09.339839 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.339797    2548 scope.go:117] "RemoveContainer" containerID="6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"
Jul 26 18:00:09.340014 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.339997    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"} err="failed to get container status \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": rpc error: code = NotFound desc = could not find container \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": container with ID starting with 6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b not found: ID does not exist"
Jul 26 18:00:09.340057 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.340016    2548 scope.go:117] "RemoveContainer" containerID="5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"
Jul 26 18:00:09.340241 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.340226    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"} err="failed to get container status \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": rpc error: code = NotFound desc = could not find container \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": container with ID starting with 5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2 not found: ID does not exist"
Jul 26 18:00:09.340241 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.340239    2548 scope.go:117] "RemoveContainer" containerID="76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"
Jul 26 18:00:09.340450 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.340431    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"} err="failed to get container status \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": rpc error: code = NotFound desc = could not find container \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": container with ID starting with 76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25 not found: ID does not exist"
Jul 26 18:00:09.340505 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.340450    2548 scope.go:117] "RemoveContainer" containerID="e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"
Jul 26 18:00:09.340644 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.340628    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"} err="failed to get container status \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": rpc error: code = NotFound desc = could not find container \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": container with ID starting with e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e not found: ID does not exist"
Jul 26 18:00:09.340682 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.340645    2548 scope.go:117] "RemoveContainer" containerID="ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"
Jul 26 18:00:09.340858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.340838    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"} err="failed to get container status \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": rpc error: code = NotFound desc = could not find container \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": container with ID starting with ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc not found: ID does not exist"
Jul 26 18:00:09.340920 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.340860    2548 scope.go:117] "RemoveContainer" containerID="63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"
Jul 26 18:00:09.341054 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.341038    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"} err="failed to get container status \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": rpc error: code = NotFound desc = could not find container \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": container with ID starting with 63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5 not found: ID does not exist"
Jul 26 18:00:09.341100 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.341055    2548 scope.go:117] "RemoveContainer" containerID="7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"
Jul 26 18:00:09.341272 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.341254    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"} err="failed to get container status \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": rpc error: code = NotFound desc = could not find container \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": container with ID starting with 7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787 not found: ID does not exist"
Jul 26 18:00:09.341337 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.341273    2548 scope.go:117] "RemoveContainer" containerID="6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"
Jul 26 18:00:09.341487 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.341470    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b"} err="failed to get container status \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": rpc error: code = NotFound desc = could not find container \"6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b\": container with ID starting with 6d494b9f02e0d3305dc9924f9ebd6a5f2cfe54a62090622b836dc174938efc8b not found: ID does not exist"
Jul 26 18:00:09.341530 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.341495    2548 scope.go:117] "RemoveContainer" containerID="5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"
Jul 26 18:00:09.341683 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.341665    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2"} err="failed to get container status \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": rpc error: code = NotFound desc = could not find container \"5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2\": container with ID starting with 5ac6a2d59857c2619ebe2578e52f2f5f270113dd3005ad68cd8f6945414363c2 not found: ID does not exist"
Jul 26 18:00:09.341742 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.341683    2548 scope.go:117] "RemoveContainer" containerID="76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"
Jul 26 18:00:09.341874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.341855    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25"} err="failed to get container status \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": rpc error: code = NotFound desc = could not find container \"76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25\": container with ID starting with 76f8792971f1fedec67b8eb0c6a74047e3c36f617c65d2c9613967c20f0b0a25 not found: ID does not exist"
Jul 26 18:00:09.341927 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.341874    2548 scope.go:117] "RemoveContainer" containerID="e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"
Jul 26 18:00:09.342047 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.342033    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e"} err="failed to get container status \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": rpc error: code = NotFound desc = could not find container \"e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e\": container with ID starting with e7e2e8fa61a5232d6364f7b36ea50670172eead5a7923d30a53643f2bc1ca29e not found: ID does not exist"
Jul 26 18:00:09.342091 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.342047    2548 scope.go:117] "RemoveContainer" containerID="ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"
Jul 26 18:00:09.342275 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.342253    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc"} err="failed to get container status \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": rpc error: code = NotFound desc = could not find container \"ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc\": container with ID starting with ad969a40cdca243c16c74a5c63f42a8265954008fa94d8dae35648896ffe30cc not found: ID does not exist"
Jul 26 18:00:09.342353 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.342274    2548 scope.go:117] "RemoveContainer" containerID="63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"
Jul 26 18:00:09.342670 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.342633    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5"} err="failed to get container status \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": rpc error: code = NotFound desc = could not find container \"63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5\": container with ID starting with 63f6cc01c6f61cf9f5bdbcd89958ac9b2e4c25ac98e0c248a9480b8d42fab7a5 not found: ID does not exist"
Jul 26 18:00:09.342770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.342671    2548 scope.go:117] "RemoveContainer" containerID="7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"
Jul 26 18:00:09.343912 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.343886    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787"} err="failed to get container status \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": rpc error: code = NotFound desc = could not find container \"7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787\": container with ID starting with 7388945d8aa35d0b98df6bec8e33e7b4900db942d0122b98ecbd6236705d5787 not found: ID does not exist"
Jul 26 18:00:09.344330 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344314    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 26 18:00:09.344572 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344560    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="init-config-reloader"
Jul 26 18:00:09.344618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344573    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="init-config-reloader"
Jul 26 18:00:09.344618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344581    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy-web"
Jul 26 18:00:09.344618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344586    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy-web"
Jul 26 18:00:09.344618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344595    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy-web"
Jul 26 18:00:09.344618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344600    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy-web"
Jul 26 18:00:09.344618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344607    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="prometheus"
Jul 26 18:00:09.344618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344612    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="prometheus"
Jul 26 18:00:09.344618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344618    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="config-reloader"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344624    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="config-reloader"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344629    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy-thanos"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344634    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy-thanos"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344640    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy-metric"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344645    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy-metric"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344651    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344655    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344661    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="init-config-reloader"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344665    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="init-config-reloader"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344675    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="prom-label-proxy"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344680    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="prom-label-proxy"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344685    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344690    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344697    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="thanos-sidecar"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344702    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="thanos-sidecar"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344707    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="alertmanager"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344711    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="alertmanager"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344719    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="config-reloader"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344724    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="config-reloader"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344760    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="alertmanager"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344767    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="config-reloader"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344773    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy-web"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344778    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344784    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy-web"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344789    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="prom-label-proxy"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344794    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344799    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="thanos-sidecar"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344804    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="kube-rbac-proxy-thanos"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344809    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="kube-rbac-proxy-metric"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344814    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d9d0d6-0b80-4f8d-97b5-f4ca84a0b323" containerName="config-reloader"
Jul 26 18:00:09.344836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.344819    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" containerName="prometheus"
Jul 26 18:00:09.349966 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.349947    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.353476 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353182    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 26 18:00:09.353476 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353224    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qcnhp\""
Jul 26 18:00:09.353476 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353240    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 26 18:00:09.353476 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353356    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b3otgl206cgmq\""
Jul 26 18:00:09.353476 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353429    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 26 18:00:09.353790 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353563    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 26 18:00:09.353790 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353573    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 26 18:00:09.353790 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353616    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 26 18:00:09.353790 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353633    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 26 18:00:09.353790 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353662    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 26 18:00:09.353790 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353690    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 26 18:00:09.353790 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353723    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 26 18:00:09.354119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353828    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 26 18:00:09.354119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353918    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 26 18:00:09.354119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.353918    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 26 18:00:09.355965 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.355948    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 26 18:00:09.358207 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.358068    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 26 18:00:09.368733 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.368712    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 26 18:00:09.411859 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.411830    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bbc990e-6ef5-49cf-9c1b-076700c0a7dc" path="/var/lib/kubelet/pods/8bbc990e-6ef5-49cf-9c1b-076700c0a7dc/volumes"
Jul 26 18:00:09.468052 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.467989    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468052 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468017    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468052 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468036    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468052 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468053    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djgkj\" (UniqueName: \"kubernetes.io/projected/c387b6cd-dcb5-468d-8e6e-a860f827c957-kube-api-access-djgkj\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468287 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468109    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468287 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468168    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c387b6cd-dcb5-468d-8e6e-a860f827c957-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468287 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468185    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c387b6cd-dcb5-468d-8e6e-a860f827c957-config-out\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468287 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468217    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468287 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468234    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468294    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-web-config\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468321    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468346    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468372    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468387    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468432    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-config\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468673 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468462    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468673 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468481    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468673 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468494    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468673 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468510    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.468673 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.468534    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.569865 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.569826    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.569865 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.569868    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.569899    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.569924    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djgkj\" (UniqueName: \"kubernetes.io/projected/c387b6cd-dcb5-468d-8e6e-a860f827c957-kube-api-access-djgkj\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.569949    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.569975    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c387b6cd-dcb5-468d-8e6e-a860f827c957-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570002    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c387b6cd-dcb5-468d-8e6e-a860f827c957-config-out\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570031    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570058    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570096    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-web-config\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570128    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570184    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570262    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570296    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570323    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-config\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570650 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570354    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570650 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570390    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570650 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570416    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570650 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570448    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.570650 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570477    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.571944 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570887    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.571944 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.570901    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.571944 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.571019    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.571944 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.571620    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.571944 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.571753    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.572290 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.572010    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.572800 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.572772    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c387b6cd-dcb5-468d-8e6e-a860f827c957-config-out\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.573013 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.572988    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.573552 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.573433    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-web-config\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.573552 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.573451    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c387b6cd-dcb5-468d-8e6e-a860f827c957-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.573970 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.573699    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-config\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.573970 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.573796    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.574113 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.574079    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c387b6cd-dcb5-468d-8e6e-a860f827c957-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.574758 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.574731    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.574842 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.574793    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.575421 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.575401    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.575833 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.575812    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.576291 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.576270    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.576345 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.576305    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c387b6cd-dcb5-468d-8e6e-a860f827c957-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.579421 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.579404    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djgkj\" (UniqueName: \"kubernetes.io/projected/c387b6cd-dcb5-468d-8e6e-a860f827c957-kube-api-access-djgkj\") pod \"prometheus-k8s-0\" (UID: \"c387b6cd-dcb5-468d-8e6e-a860f827c957\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.660923 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.660892    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:00:09.791550 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:09.791427    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 26 18:00:09.795808 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:00:09.795778    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc387b6cd_dcb5_468d_8e6e_a860f827c957.slice/crio-746b1e9415bd873859e38798c3a491e741a26658bcac0f5c645da5ab2695d6e6 WatchSource:0}: Error finding container 746b1e9415bd873859e38798c3a491e741a26658bcac0f5c645da5ab2695d6e6: Status 404 returned error can't find the container with id 746b1e9415bd873859e38798c3a491e741a26658bcac0f5c645da5ab2695d6e6
Jul 26 18:00:10.290250 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:10.290214    2548 generic.go:356] "Generic (PLEG): container finished" podID="c387b6cd-dcb5-468d-8e6e-a860f827c957" containerID="11b9f4e9fb666047e8aabe0931d32a4237cfda24ab10da05349e422a5f2f02d0" exitCode=0
Jul 26 18:00:10.290454 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:10.290256    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c387b6cd-dcb5-468d-8e6e-a860f827c957","Type":"ContainerDied","Data":"11b9f4e9fb666047e8aabe0931d32a4237cfda24ab10da05349e422a5f2f02d0"}
Jul 26 18:00:10.290454 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:10.290318    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c387b6cd-dcb5-468d-8e6e-a860f827c957","Type":"ContainerStarted","Data":"746b1e9415bd873859e38798c3a491e741a26658bcac0f5c645da5ab2695d6e6"}
Jul 26 18:00:11.297542 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:11.297503    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c387b6cd-dcb5-468d-8e6e-a860f827c957","Type":"ContainerStarted","Data":"b2c397976733c716092f39b87cfebed2e1e8ed5c6c295f9dbb0545f6387096e2"}
Jul 26 18:00:11.297971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:11.297592    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c387b6cd-dcb5-468d-8e6e-a860f827c957","Type":"ContainerStarted","Data":"6c605e08a221bde6ca9c3ca350425db50b650591106fa3d5236268138d3c50e4"}
Jul 26 18:00:11.297971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:11.297621    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c387b6cd-dcb5-468d-8e6e-a860f827c957","Type":"ContainerStarted","Data":"fb664c514baea6b2e21d0918f6c41305fadb90816e3cf81707f22cbcdbac17ad"}
Jul 26 18:00:11.297971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:11.297642    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c387b6cd-dcb5-468d-8e6e-a860f827c957","Type":"ContainerStarted","Data":"a858c65e0b65d80f9559455a9653655906df6c83a3856d37b47a9eff73846af1"}
Jul 26 18:00:11.297971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:11.297669    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c387b6cd-dcb5-468d-8e6e-a860f827c957","Type":"ContainerStarted","Data":"363de45f7969e2f7a5597a911292e34d51e42f9ca1830a7549e5475adff0e549"}
Jul 26 18:00:11.297971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:11.297708    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c387b6cd-dcb5-468d-8e6e-a860f827c957","Type":"ContainerStarted","Data":"943aafb982a2c0c9152f6ea024e292c095201841b298937ad6aafeeec4c5b45a"}
Jul 26 18:00:11.326574 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:11.326517    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.307518277 podStartE2EDuration="2.326501587s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.98331ms" isStatefulPod=false podCreationTimestamp="2026-07-26 18:00:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:00:11.323943614 +0000 UTC m=+168.424196520" watchObservedRunningTime="2026-07-26 18:00:11.326501587 +0000 UTC m=+168.426754472"
Jul 26 18:00:14.661723 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:00:14.661684    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:01:09.661277 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:01:09.661241    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:01:09.675805 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:01:09.675782    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:01:10.523840 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:01:10.523816    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 26 18:02:23.265583 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:02:23.265540    2548 kubelet.go:1648] "Image garbage collection succeeded"
Jul 26 18:03:09.203443 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.203400    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"]
Jul 26 18:03:09.206464 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.206449    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"
Jul 26 18:03:09.208862 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.208833    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 26 18:03:09.208862 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.208859    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 26 18:03:09.209611 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.209594    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vtxvw\""
Jul 26 18:03:09.214042 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.214016    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"]
Jul 26 18:03:09.347431 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.347398    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e693e1f-134c-45c3-9a8d-a92a1bbacc1d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ng7bq\" (UID: \"2e693e1f-134c-45c3-9a8d-a92a1bbacc1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"
Jul 26 18:03:09.347554 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.347443    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt865\" (UniqueName: \"kubernetes.io/projected/2e693e1f-134c-45c3-9a8d-a92a1bbacc1d-kube-api-access-jt865\") pod \"openshift-lws-operator-fd8ccff4c-ng7bq\" (UID: \"2e693e1f-134c-45c3-9a8d-a92a1bbacc1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"
Jul 26 18:03:09.448404 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.448377    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e693e1f-134c-45c3-9a8d-a92a1bbacc1d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ng7bq\" (UID: \"2e693e1f-134c-45c3-9a8d-a92a1bbacc1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"
Jul 26 18:03:09.448566 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.448421    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt865\" (UniqueName: \"kubernetes.io/projected/2e693e1f-134c-45c3-9a8d-a92a1bbacc1d-kube-api-access-jt865\") pod \"openshift-lws-operator-fd8ccff4c-ng7bq\" (UID: \"2e693e1f-134c-45c3-9a8d-a92a1bbacc1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"
Jul 26 18:03:09.448787 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.448767    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e693e1f-134c-45c3-9a8d-a92a1bbacc1d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ng7bq\" (UID: \"2e693e1f-134c-45c3-9a8d-a92a1bbacc1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"
Jul 26 18:03:09.456627 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.456559    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt865\" (UniqueName: \"kubernetes.io/projected/2e693e1f-134c-45c3-9a8d-a92a1bbacc1d-kube-api-access-jt865\") pod \"openshift-lws-operator-fd8ccff4c-ng7bq\" (UID: \"2e693e1f-134c-45c3-9a8d-a92a1bbacc1d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"
Jul 26 18:03:09.526812 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.526790    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"
Jul 26 18:03:09.655620 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.655595    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq"]
Jul 26 18:03:09.658008 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:03:09.657971    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e693e1f_134c_45c3_9a8d_a92a1bbacc1d.slice/crio-dc0ff9e9de8a55d2b810c7357b51e67a3617d59d4b06898354d9bdf865b6a553 WatchSource:0}: Error finding container dc0ff9e9de8a55d2b810c7357b51e67a3617d59d4b06898354d9bdf865b6a553: Status 404 returned error can't find the container with id dc0ff9e9de8a55d2b810c7357b51e67a3617d59d4b06898354d9bdf865b6a553
Jul 26 18:03:09.659523 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.659503    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 18:03:09.924519 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:09.924487    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq" event={"ID":"2e693e1f-134c-45c3-9a8d-a92a1bbacc1d","Type":"ContainerStarted","Data":"dc0ff9e9de8a55d2b810c7357b51e67a3617d59d4b06898354d9bdf865b6a553"}
Jul 26 18:03:12.938314 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:12.938274    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq" event={"ID":"2e693e1f-134c-45c3-9a8d-a92a1bbacc1d","Type":"ContainerStarted","Data":"ce6145cf761efae991abfd85a64665c23ac14a31a2b1c5966f03ddcb34475bc4"}
Jul 26 18:03:12.956683 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:12.956635    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ng7bq" podStartSLOduration=1.233562676 podStartE2EDuration="3.956621114s" totalImagesPullingTime="2.723058438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:03:12.955412878 +0000 UTC m=+350.055665764" watchObservedRunningTime="2026-07-26 18:03:12.956621114 +0000 UTC m=+350.056874001"
Jul 26 18:03:28.358720 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.358644    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"]
Jul 26 18:03:28.366238 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.362426    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.366238 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.365501    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 26 18:03:28.366238 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.365852    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 26 18:03:28.366238 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.366062    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 26 18:03:28.366628 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.366370    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 26 18:03:28.366628 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.366564    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sx8j6\""
Jul 26 18:03:28.381918 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.381887    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1fffcce-e18a-43de-91e6-6ab90db34e5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.382020 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.381948    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1fffcce-e18a-43de-91e6-6ab90db34e5c-manifests\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.382020 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.381983    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1fffcce-e18a-43de-91e6-6ab90db34e5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.382094 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.382052    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1fffcce-e18a-43de-91e6-6ab90db34e5c-tmp\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.382128 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.382110    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89cxf\" (UniqueName: \"kubernetes.io/projected/f1fffcce-e18a-43de-91e6-6ab90db34e5c-kube-api-access-89cxf\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.382280 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.382266    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"]
Jul 26 18:03:28.482687 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.482653    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89cxf\" (UniqueName: \"kubernetes.io/projected/f1fffcce-e18a-43de-91e6-6ab90db34e5c-kube-api-access-89cxf\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.482836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.482696    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1fffcce-e18a-43de-91e6-6ab90db34e5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.482836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.482726    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1fffcce-e18a-43de-91e6-6ab90db34e5c-manifests\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.482836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.482758    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1fffcce-e18a-43de-91e6-6ab90db34e5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.482836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.482799    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1fffcce-e18a-43de-91e6-6ab90db34e5c-tmp\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.483139 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.483121    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f1fffcce-e18a-43de-91e6-6ab90db34e5c-manifests\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.485053 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.485031    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f1fffcce-e18a-43de-91e6-6ab90db34e5c-tmp\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.485301 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.485283    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f1fffcce-e18a-43de-91e6-6ab90db34e5c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.485301 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.485294    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1fffcce-e18a-43de-91e6-6ab90db34e5c-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.490730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.490710    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89cxf\" (UniqueName: \"kubernetes.io/projected/f1fffcce-e18a-43de-91e6-6ab90db34e5c-kube-api-access-89cxf\") pod \"opendatahub-operator-controller-manager-69cc94bb6c-ks5bd\" (UID: \"f1fffcce-e18a-43de-91e6-6ab90db34e5c\") " pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.673978 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.673955    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:28.807474 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.807450    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"]
Jul 26 18:03:28.809983 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:03:28.809951    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1fffcce_e18a_43de_91e6_6ab90db34e5c.slice/crio-e1c72095f8ab28a356b4687300170d0eba957b3e1b6ef9c405008204dde21d9f WatchSource:0}: Error finding container e1c72095f8ab28a356b4687300170d0eba957b3e1b6ef9c405008204dde21d9f: Status 404 returned error can't find the container with id e1c72095f8ab28a356b4687300170d0eba957b3e1b6ef9c405008204dde21d9f
Jul 26 18:03:28.996825 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:28.996743    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd" event={"ID":"f1fffcce-e18a-43de-91e6-6ab90db34e5c","Type":"ContainerStarted","Data":"e1c72095f8ab28a356b4687300170d0eba957b3e1b6ef9c405008204dde21d9f"}
Jul 26 18:03:32.014026 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:32.013931    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd" event={"ID":"f1fffcce-e18a-43de-91e6-6ab90db34e5c","Type":"ContainerStarted","Data":"c126ef35c1c8ce63eecf5119913d0b8a72935c235f323a34c7a6d5fbe7fb53f5"}
Jul 26 18:03:33.019986 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:33.019953    2548 generic.go:356] "Generic (PLEG): container finished" podID="f1fffcce-e18a-43de-91e6-6ab90db34e5c" containerID="c126ef35c1c8ce63eecf5119913d0b8a72935c235f323a34c7a6d5fbe7fb53f5" exitCode=0
Jul 26 18:03:33.019986 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:33.019991    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd" event={"ID":"f1fffcce-e18a-43de-91e6-6ab90db34e5c","Type":"ContainerDied","Data":"c126ef35c1c8ce63eecf5119913d0b8a72935c235f323a34c7a6d5fbe7fb53f5"}
Jul 26 18:03:34.025371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:34.025335    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd" event={"ID":"f1fffcce-e18a-43de-91e6-6ab90db34e5c","Type":"ContainerStarted","Data":"91ff19fe9c6dd8fbeeffe8730d66670e64ed7267c4093a74450b5e2c7eaac99e"}
Jul 26 18:03:34.025773 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:34.025409    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:45.030996 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:45.030960    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd"
Jul 26 18:03:45.054482 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:45.054434    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69cc94bb6c-ks5bd" podStartSLOduration=12.694194126 podStartE2EDuration="17.054418023s" totalImagesPullingTime="3.343058376s" totalInitContainerRuntime="1.017165521s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:03:34.046039024 +0000 UTC m=+371.146291910" watchObservedRunningTime="2026-07-26 18:03:45.054418023 +0000 UTC m=+382.154670910"
Jul 26 18:03:56.295681 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.295645    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"]
Jul 26 18:03:56.303722 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.303696    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.312443 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.312413    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-746b8\""
Jul 26 18:03:56.312615 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.312571    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 26 18:03:56.312695 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.312654    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 26 18:03:56.312807 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.312774    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 26 18:03:56.331222 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.331168    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"]
Jul 26 18:03:56.389264 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.389221    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.389264 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.389266    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e6721e-f772-4160-ab4b-1d2695fec4ac-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.389473 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.389352    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.389473 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.389409    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.389473 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.389462    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf7nv\" (UniqueName: \"kubernetes.io/projected/19e6721e-f772-4160-ab4b-1d2695fec4ac-kube-api-access-bf7nv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.389598 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.389489    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.389598 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.389536    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.389598 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.389561    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.389703 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.389645    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490019 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.489980    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf7nv\" (UniqueName: \"kubernetes.io/projected/19e6721e-f772-4160-ab4b-1d2695fec4ac-kube-api-access-bf7nv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490230 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490025    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490230 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490057    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490230 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490079    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490230 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490173    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490276    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490305    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e6721e-f772-4160-ab4b-1d2695fec4ac-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490338    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490386    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490665 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490535    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490763 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490738    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490839 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490795    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.490904 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.490884    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.491298 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.491270    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/19e6721e-f772-4160-ab4b-1d2695fec4ac-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.492757 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.492738    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.492866 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.492841    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.501310 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.501283    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19e6721e-f772-4160-ab4b-1d2695fec4ac-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.504706 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.504683    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf7nv\" (UniqueName: \"kubernetes.io/projected/19e6721e-f772-4160-ab4b-1d2695fec4ac-kube-api-access-bf7nv\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp\" (UID: \"19e6721e-f772-4160-ab4b-1d2695fec4ac\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.616761 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.616731    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:03:56.756762 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.756602    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"]
Jul 26 18:03:56.759789 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:03:56.759751    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e6721e_f772_4160_ab4b_1d2695fec4ac.slice/crio-64ce63339aa707a3ee2064dc648f757ee5b04d0e53dcb15fa0a46d6361e92028 WatchSource:0}: Error finding container 64ce63339aa707a3ee2064dc648f757ee5b04d0e53dcb15fa0a46d6361e92028: Status 404 returned error can't find the container with id 64ce63339aa707a3ee2064dc648f757ee5b04d0e53dcb15fa0a46d6361e92028
Jul 26 18:03:56.981696 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.981617    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"]
Jul 26 18:03:56.984477 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.984452    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:56.987627 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.987602    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 26 18:03:56.987837 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.987815    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 26 18:03:56.987919 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.987874    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6nlhm\""
Jul 26 18:03:56.988704 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.988689    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 26 18:03:56.998386 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:56.998363    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"]
Jul 26 18:03:57.096178 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.096150    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/562f84a9-1611-4c8e-adf1-1b3957b2c48a-manager-config\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.096350 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.096213    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/562f84a9-1611-4c8e-adf1-1b3957b2c48a-cert\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.096350 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.096260    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbst7\" (UniqueName: \"kubernetes.io/projected/562f84a9-1611-4c8e-adf1-1b3957b2c48a-kube-api-access-bbst7\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.096350 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.096296    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/562f84a9-1611-4c8e-adf1-1b3957b2c48a-metrics-cert\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.116606 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.116574    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp" event={"ID":"19e6721e-f772-4160-ab4b-1d2695fec4ac","Type":"ContainerStarted","Data":"64ce63339aa707a3ee2064dc648f757ee5b04d0e53dcb15fa0a46d6361e92028"}
Jul 26 18:03:57.197205 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.197166    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/562f84a9-1611-4c8e-adf1-1b3957b2c48a-metrics-cert\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.197338 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.197237    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/562f84a9-1611-4c8e-adf1-1b3957b2c48a-manager-config\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.197338 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.197268    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/562f84a9-1611-4c8e-adf1-1b3957b2c48a-cert\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.197338 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.197289    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbst7\" (UniqueName: \"kubernetes.io/projected/562f84a9-1611-4c8e-adf1-1b3957b2c48a-kube-api-access-bbst7\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.197935 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.197915    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/562f84a9-1611-4c8e-adf1-1b3957b2c48a-manager-config\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.199576 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.199555    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/562f84a9-1611-4c8e-adf1-1b3957b2c48a-metrics-cert\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.199663 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.199588    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/562f84a9-1611-4c8e-adf1-1b3957b2c48a-cert\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.219862 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.219841    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbst7\" (UniqueName: \"kubernetes.io/projected/562f84a9-1611-4c8e-adf1-1b3957b2c48a-kube-api-access-bbst7\") pod \"lws-controller-manager-7b54d88cb5-cwvmm\" (UID: \"562f84a9-1611-4c8e-adf1-1b3957b2c48a\") " pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.294882 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.294811    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:03:57.449301 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:57.449264    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"]
Jul 26 18:03:57.451781 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:03:57.451753    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562f84a9_1611_4c8e_adf1_1b3957b2c48a.slice/crio-ed99c795bbe00d9739134b6848a025b4028b33d37b4fec36c7202ab1c1f8987c WatchSource:0}: Error finding container ed99c795bbe00d9739134b6848a025b4028b33d37b4fec36c7202ab1c1f8987c: Status 404 returned error can't find the container with id ed99c795bbe00d9739134b6848a025b4028b33d37b4fec36c7202ab1c1f8987c
Jul 26 18:03:58.125180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.125141    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm" event={"ID":"562f84a9-1611-4c8e-adf1-1b3957b2c48a","Type":"ContainerStarted","Data":"ed99c795bbe00d9739134b6848a025b4028b33d37b4fec36c7202ab1c1f8987c"}
Jul 26 18:03:58.571738 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.571660    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"]
Jul 26 18:03:58.574477 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.574453    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:03:58.577590 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.577384    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-99gxm\""
Jul 26 18:03:58.577701 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.577600    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 26 18:03:58.598393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.598358    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"]
Jul 26 18:03:58.610727 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.609454    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpzr8\" (UniqueName: \"kubernetes.io/projected/d11c3a3a-0fde-47c3-95d4-6670128a6e89-kube-api-access-bpzr8\") pod \"kserve-controller-manager-d6f4b65b8-dtzsn\" (UID: \"d11c3a3a-0fde-47c3-95d4-6670128a6e89\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:03:58.610727 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.609516    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d11c3a3a-0fde-47c3-95d4-6670128a6e89-cert\") pod \"kserve-controller-manager-d6f4b65b8-dtzsn\" (UID: \"d11c3a3a-0fde-47c3-95d4-6670128a6e89\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:03:58.711089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.711055    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d11c3a3a-0fde-47c3-95d4-6670128a6e89-cert\") pod \"kserve-controller-manager-d6f4b65b8-dtzsn\" (UID: \"d11c3a3a-0fde-47c3-95d4-6670128a6e89\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:03:58.711613 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.711228    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpzr8\" (UniqueName: \"kubernetes.io/projected/d11c3a3a-0fde-47c3-95d4-6670128a6e89-kube-api-access-bpzr8\") pod \"kserve-controller-manager-d6f4b65b8-dtzsn\" (UID: \"d11c3a3a-0fde-47c3-95d4-6670128a6e89\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:03:58.711613 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:03:58.711326    2548 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 26 18:03:58.711613 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:03:58.711406    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11c3a3a-0fde-47c3-95d4-6670128a6e89-cert podName:d11c3a3a-0fde-47c3-95d4-6670128a6e89 nodeName:}" failed. No retries permitted until 2026-07-26 18:03:59.211383644 +0000 UTC m=+396.311636514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d11c3a3a-0fde-47c3-95d4-6670128a6e89-cert") pod "kserve-controller-manager-d6f4b65b8-dtzsn" (UID: "d11c3a3a-0fde-47c3-95d4-6670128a6e89") : secret "kserve-webhook-server-cert" not found
Jul 26 18:03:58.747241 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:58.745236    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpzr8\" (UniqueName: \"kubernetes.io/projected/d11c3a3a-0fde-47c3-95d4-6670128a6e89-kube-api-access-bpzr8\") pod \"kserve-controller-manager-d6f4b65b8-dtzsn\" (UID: \"d11c3a3a-0fde-47c3-95d4-6670128a6e89\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:03:59.216550 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:59.216512    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d11c3a3a-0fde-47c3-95d4-6670128a6e89-cert\") pod \"kserve-controller-manager-d6f4b65b8-dtzsn\" (UID: \"d11c3a3a-0fde-47c3-95d4-6670128a6e89\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:03:59.219296 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:59.219174    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d11c3a3a-0fde-47c3-95d4-6670128a6e89-cert\") pod \"kserve-controller-manager-d6f4b65b8-dtzsn\" (UID: \"d11c3a3a-0fde-47c3-95d4-6670128a6e89\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:03:59.499313 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:03:59.499231    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:04:00.245471 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:00.245430    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:04:00.245860 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:00.245514    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:04:00.245860 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:00.245548    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:04:00.373448 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:00.373407    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"]
Jul 26 18:04:00.378269 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:04:00.378211    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11c3a3a_0fde_47c3_95d4_6670128a6e89.slice/crio-37f448917599b48df45d15bdfc569ec2589103975a582651581a6a9e4a21966f WatchSource:0}: Error finding container 37f448917599b48df45d15bdfc569ec2589103975a582651581a6a9e4a21966f: Status 404 returned error can't find the container with id 37f448917599b48df45d15bdfc569ec2589103975a582651581a6a9e4a21966f
Jul 26 18:04:01.141290 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:01.141255    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm" event={"ID":"562f84a9-1611-4c8e-adf1-1b3957b2c48a","Type":"ContainerStarted","Data":"a0142616db644e357867cd215626abaa475b95fb818c6240a1fbcb7197ca1e32"}
Jul 26 18:04:01.141474 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:01.141354    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:04:01.143025 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:01.142983    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp" event={"ID":"19e6721e-f772-4160-ab4b-1d2695fec4ac","Type":"ContainerStarted","Data":"1c91799ee1f2ec9e2dcffa0c8d55c2dbcfe497864ef86e203234a32a3eb9196b"}
Jul 26 18:04:01.144248 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:01.144218    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn" event={"ID":"d11c3a3a-0fde-47c3-95d4-6670128a6e89","Type":"ContainerStarted","Data":"37f448917599b48df45d15bdfc569ec2589103975a582651581a6a9e4a21966f"}
Jul 26 18:04:01.169409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:01.169365    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm" podStartSLOduration=2.384751707 podStartE2EDuration="5.169348742s" totalImagesPullingTime="2.784597035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:04:01.168493352 +0000 UTC m=+398.268746256" watchObservedRunningTime="2026-07-26 18:04:01.169348742 +0000 UTC m=+398.269601628"
Jul 26 18:04:01.240857 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:01.240601    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp" podStartSLOduration=1.75732862 podStartE2EDuration="5.240581393s" totalImagesPullingTime="3.483252773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:04:01.239593145 +0000 UTC m=+398.339846052" watchObservedRunningTime="2026-07-26 18:04:01.240581393 +0000 UTC m=+398.340834280"
Jul 26 18:04:01.617864 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:01.617834    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:04:01.622292 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:01.622265    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:04:02.148924 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:02.148890    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:04:02.149959 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:02.149939    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp"
Jul 26 18:04:03.153850 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:03.153823    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn" event={"ID":"d11c3a3a-0fde-47c3-95d4-6670128a6e89","Type":"ContainerStarted","Data":"d9404a448f283621da19db47fa53e793447ea7b6657d42c023d98abd7105cefb"}
Jul 26 18:04:03.173039 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:03.172966    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn" podStartSLOduration=2.511085712 podStartE2EDuration="5.172951201s" totalImagesPullingTime="2.661865489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:04:03.171812745 +0000 UTC m=+400.272065652" watchObservedRunningTime="2026-07-26 18:04:03.172951201 +0000 UTC m=+400.273204086"
Jul 26 18:04:04.158283 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:04.158254    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:04:12.150823 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:12.150792    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b54d88cb5-cwvmm"
Jul 26 18:04:35.167019 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:35.166981    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dtzsn"
Jul 26 18:04:49.008961 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.008877    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l92v5"]
Jul 26 18:04:49.011288 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.011264    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l92v5"
Jul 26 18:04:49.013655 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.013629    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 26 18:04:49.014472 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.014452    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 26 18:04:49.014565 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.014459    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mr68s\""
Jul 26 18:04:49.024182 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.024159    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l92v5"]
Jul 26 18:04:49.120985 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.120952    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbtmq\" (UniqueName: \"kubernetes.io/projected/d5a95136-a931-488e-a125-70486c9484b8-kube-api-access-nbtmq\") pod \"kuadrant-operator-catalog-l92v5\" (UID: \"d5a95136-a931-488e-a125-70486c9484b8\") " pod="kuadrant-system/kuadrant-operator-catalog-l92v5"
Jul 26 18:04:49.222261 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.222228    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbtmq\" (UniqueName: \"kubernetes.io/projected/d5a95136-a931-488e-a125-70486c9484b8-kube-api-access-nbtmq\") pod \"kuadrant-operator-catalog-l92v5\" (UID: \"d5a95136-a931-488e-a125-70486c9484b8\") " pod="kuadrant-system/kuadrant-operator-catalog-l92v5"
Jul 26 18:04:49.234185 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.234155    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbtmq\" (UniqueName: \"kubernetes.io/projected/d5a95136-a931-488e-a125-70486c9484b8-kube-api-access-nbtmq\") pod \"kuadrant-operator-catalog-l92v5\" (UID: \"d5a95136-a931-488e-a125-70486c9484b8\") " pod="kuadrant-system/kuadrant-operator-catalog-l92v5"
Jul 26 18:04:49.320891 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.320830    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l92v5"
Jul 26 18:04:49.365643 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.365614    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l92v5"]
Jul 26 18:04:49.444469 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.444447    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l92v5"]
Jul 26 18:04:49.446805 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:04:49.446775    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a95136_a931_488e_a125_70486c9484b8.slice/crio-2acdaa4c5f1d4d2b9417f7437281943a82e3063c4995d91162883cd5b0f2495c WatchSource:0}: Error finding container 2acdaa4c5f1d4d2b9417f7437281943a82e3063c4995d91162883cd5b0f2495c: Status 404 returned error can't find the container with id 2acdaa4c5f1d4d2b9417f7437281943a82e3063c4995d91162883cd5b0f2495c
Jul 26 18:04:49.577208 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.577131    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cf7h8"]
Jul 26 18:04:49.579866 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.579850    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cf7h8"
Jul 26 18:04:49.587951 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.587928    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cf7h8"]
Jul 26 18:04:49.624944 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.624922    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plnjk\" (UniqueName: \"kubernetes.io/projected/19350b39-b55b-479c-a107-3307206ad382-kube-api-access-plnjk\") pod \"kuadrant-operator-catalog-cf7h8\" (UID: \"19350b39-b55b-479c-a107-3307206ad382\") " pod="kuadrant-system/kuadrant-operator-catalog-cf7h8"
Jul 26 18:04:49.725337 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.725310    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plnjk\" (UniqueName: \"kubernetes.io/projected/19350b39-b55b-479c-a107-3307206ad382-kube-api-access-plnjk\") pod \"kuadrant-operator-catalog-cf7h8\" (UID: \"19350b39-b55b-479c-a107-3307206ad382\") " pod="kuadrant-system/kuadrant-operator-catalog-cf7h8"
Jul 26 18:04:49.733389 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.733365    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plnjk\" (UniqueName: \"kubernetes.io/projected/19350b39-b55b-479c-a107-3307206ad382-kube-api-access-plnjk\") pod \"kuadrant-operator-catalog-cf7h8\" (UID: \"19350b39-b55b-479c-a107-3307206ad382\") " pod="kuadrant-system/kuadrant-operator-catalog-cf7h8"
Jul 26 18:04:49.890162 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:49.890130    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cf7h8"
Jul 26 18:04:50.023739 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:50.023716    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cf7h8"]
Jul 26 18:04:50.041273 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:04:50.041232    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19350b39_b55b_479c_a107_3307206ad382.slice/crio-1dfb51a209873eeda33ef84d9180ec82cc720bd1c70760e6febd31c1e6133039 WatchSource:0}: Error finding container 1dfb51a209873eeda33ef84d9180ec82cc720bd1c70760e6febd31c1e6133039: Status 404 returned error can't find the container with id 1dfb51a209873eeda33ef84d9180ec82cc720bd1c70760e6febd31c1e6133039
Jul 26 18:04:50.358853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:50.358759    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l92v5" event={"ID":"d5a95136-a931-488e-a125-70486c9484b8","Type":"ContainerStarted","Data":"2acdaa4c5f1d4d2b9417f7437281943a82e3063c4995d91162883cd5b0f2495c"}
Jul 26 18:04:50.359962 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:50.359932    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cf7h8" event={"ID":"19350b39-b55b-479c-a107-3307206ad382","Type":"ContainerStarted","Data":"1dfb51a209873eeda33ef84d9180ec82cc720bd1c70760e6febd31c1e6133039"}
Jul 26 18:04:52.370503 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:52.370466    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cf7h8" event={"ID":"19350b39-b55b-479c-a107-3307206ad382","Type":"ContainerStarted","Data":"32d07c858736bc5427fde0154b9e2cdb1f4da39090d7f6ef547a27eb0a2cc161"}
Jul 26 18:04:52.371956 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:52.371931    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l92v5" event={"ID":"d5a95136-a931-488e-a125-70486c9484b8","Type":"ContainerStarted","Data":"b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab"}
Jul 26 18:04:52.372083 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:52.371992    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-l92v5" podUID="d5a95136-a931-488e-a125-70486c9484b8" containerName="registry-server" containerID="cri-o://b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab" gracePeriod=2
Jul 26 18:04:52.387987 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:52.387945    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cf7h8" podStartSLOduration=2.036778365 podStartE2EDuration="3.387931508s" totalImagesPullingTime="1.351153143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:04:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:04:52.386473302 +0000 UTC m=+449.486726202" watchObservedRunningTime="2026-07-26 18:04:52.387931508 +0000 UTC m=+449.488184393"
Jul 26 18:04:52.408703 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:52.408664    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-l92v5" podStartSLOduration=2.465682719 podStartE2EDuration="4.408652157s" totalImagesPullingTime="1.942969438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:04:52.407528549 +0000 UTC m=+449.507781437" watchObservedRunningTime="2026-07-26 18:04:52.408652157 +0000 UTC m=+449.508905054"
Jul 26 18:04:52.605575 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:52.605546    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l92v5"
Jul 26 18:04:52.651762 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:52.651697    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbtmq\" (UniqueName: \"kubernetes.io/projected/d5a95136-a931-488e-a125-70486c9484b8-kube-api-access-nbtmq\") pod \"d5a95136-a931-488e-a125-70486c9484b8\" (UID: \"d5a95136-a931-488e-a125-70486c9484b8\") "
Jul 26 18:04:52.653744 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:52.653722    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5a95136-a931-488e-a125-70486c9484b8-kube-api-access-nbtmq" (OuterVolumeSpecName: "kube-api-access-nbtmq") pod "d5a95136-a931-488e-a125-70486c9484b8" (UID: "d5a95136-a931-488e-a125-70486c9484b8"). InnerVolumeSpecName "kube-api-access-nbtmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:04:52.753172 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:52.753148    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbtmq\" (UniqueName: \"kubernetes.io/projected/d5a95136-a931-488e-a125-70486c9484b8-kube-api-access-nbtmq\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:04:53.377180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:53.377150    2548 generic.go:356] "Generic (PLEG): container finished" podID="d5a95136-a931-488e-a125-70486c9484b8" containerID="b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab" exitCode=0
Jul 26 18:04:53.377629 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:53.377209    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-l92v5"
Jul 26 18:04:53.377629 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:53.377241    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l92v5" event={"ID":"d5a95136-a931-488e-a125-70486c9484b8","Type":"ContainerDied","Data":"b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab"}
Jul 26 18:04:53.377629 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:53.377287    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-l92v5" event={"ID":"d5a95136-a931-488e-a125-70486c9484b8","Type":"ContainerDied","Data":"2acdaa4c5f1d4d2b9417f7437281943a82e3063c4995d91162883cd5b0f2495c"}
Jul 26 18:04:53.377629 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:53.377314    2548 scope.go:117] "RemoveContainer" containerID="b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab"
Jul 26 18:04:53.385776 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:53.385756    2548 scope.go:117] "RemoveContainer" containerID="b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab"
Jul 26 18:04:53.385995 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:04:53.385975    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab\": container with ID starting with b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab not found: ID does not exist" containerID="b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab"
Jul 26 18:04:53.386059 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:53.386007    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab"} err="failed to get container status \"b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab\": rpc error: code = NotFound desc = could not find container \"b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab\": container with ID starting with b6bf1100130c36cfd775fce9e3e709099c2acbc4c52593ad438ba2e0907aacab not found: ID does not exist"
Jul 26 18:04:53.397472 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:53.397452    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l92v5"]
Jul 26 18:04:53.401238 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:53.401219    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-l92v5"]
Jul 26 18:04:53.418382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:53.413849    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5a95136-a931-488e-a125-70486c9484b8" path="/var/lib/kubelet/pods/d5a95136-a931-488e-a125-70486c9484b8/volumes"
Jul 26 18:04:59.890680 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:59.890645    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-cf7h8"
Jul 26 18:04:59.891217 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:59.890707    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-cf7h8"
Jul 26 18:04:59.912387 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:04:59.912362    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-cf7h8"
Jul 26 18:05:00.427391 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:00.427362    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-cf7h8"
Jul 26 18:05:14.931894 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:14.931860    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"]
Jul 26 18:05:14.932316 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:14.932149    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a95136-a931-488e-a125-70486c9484b8" containerName="registry-server"
Jul 26 18:05:14.932316 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:14.932160    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a95136-a931-488e-a125-70486c9484b8" containerName="registry-server"
Jul 26 18:05:14.937226 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:14.937161    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5a95136-a931-488e-a125-70486c9484b8" containerName="registry-server"
Jul 26 18:05:14.942063 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:14.942026    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:14.945535 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:14.945514    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hj5wg\""
Jul 26 18:05:14.955898 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:14.955828    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"]
Jul 26 18:05:15.023030 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:15.023008    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4lnn\" (UniqueName: \"kubernetes.io/projected/30a04fdb-b2be-402f-87c0-9aae0dd6fb15-kube-api-access-m4lnn\") pod \"limitador-operator-controller-manager-859d7b78bd-jbpsv\" (UID: \"30a04fdb-b2be-402f-87c0-9aae0dd6fb15\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:15.123454 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:15.123428    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4lnn\" (UniqueName: \"kubernetes.io/projected/30a04fdb-b2be-402f-87c0-9aae0dd6fb15-kube-api-access-m4lnn\") pod \"limitador-operator-controller-manager-859d7b78bd-jbpsv\" (UID: \"30a04fdb-b2be-402f-87c0-9aae0dd6fb15\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:15.141301 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:15.141278    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4lnn\" (UniqueName: \"kubernetes.io/projected/30a04fdb-b2be-402f-87c0-9aae0dd6fb15-kube-api-access-m4lnn\") pod \"limitador-operator-controller-manager-859d7b78bd-jbpsv\" (UID: \"30a04fdb-b2be-402f-87c0-9aae0dd6fb15\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:15.252504 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:15.252453    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:15.391308 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:15.391285    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"]
Jul 26 18:05:15.393486 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:05:15.393458    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a04fdb_b2be_402f_87c0_9aae0dd6fb15.slice/crio-43c5f6369df7f420ff31d6da9d12840b639e3bd5060ed245c468bc78d4bc3aa0 WatchSource:0}: Error finding container 43c5f6369df7f420ff31d6da9d12840b639e3bd5060ed245c468bc78d4bc3aa0: Status 404 returned error can't find the container with id 43c5f6369df7f420ff31d6da9d12840b639e3bd5060ed245c468bc78d4bc3aa0
Jul 26 18:05:15.465382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:15.465360    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv" event={"ID":"30a04fdb-b2be-402f-87c0-9aae0dd6fb15","Type":"ContainerStarted","Data":"43c5f6369df7f420ff31d6da9d12840b639e3bd5060ed245c468bc78d4bc3aa0"}
Jul 26 18:05:17.474171 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:17.474140    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv" event={"ID":"30a04fdb-b2be-402f-87c0-9aae0dd6fb15","Type":"ContainerStarted","Data":"c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788"}
Jul 26 18:05:17.474569 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:17.474243    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:17.528326 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:17.528233    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv" podStartSLOduration=1.657510346 podStartE2EDuration="3.528213844s" totalImagesPullingTime="1.870703498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:05:17.527625875 +0000 UTC m=+474.627878760" watchObservedRunningTime="2026-07-26 18:05:17.528213844 +0000 UTC m=+474.628466731"
Jul 26 18:05:28.480155 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:28.480122    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:29.009443 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.009414    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t"]
Jul 26 18:05:29.015592 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.015572    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t"
Jul 26 18:05:29.019014 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.018988    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lh57w\""
Jul 26 18:05:29.019398 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.019378    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 26 18:05:29.034225 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.034186    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t"]
Jul 26 18:05:29.140091 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.140052    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mdxv\" (UniqueName: \"kubernetes.io/projected/85cb1bd4-9005-43f9-bff5-5475db5c2832-kube-api-access-2mdxv\") pod \"dns-operator-controller-manager-864dd78c4c-hkm9t\" (UID: \"85cb1bd4-9005-43f9-bff5-5475db5c2832\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t"
Jul 26 18:05:29.241433 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.241399    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mdxv\" (UniqueName: \"kubernetes.io/projected/85cb1bd4-9005-43f9-bff5-5475db5c2832-kube-api-access-2mdxv\") pod \"dns-operator-controller-manager-864dd78c4c-hkm9t\" (UID: \"85cb1bd4-9005-43f9-bff5-5475db5c2832\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t"
Jul 26 18:05:29.272351 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.272273    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mdxv\" (UniqueName: \"kubernetes.io/projected/85cb1bd4-9005-43f9-bff5-5475db5c2832-kube-api-access-2mdxv\") pod \"dns-operator-controller-manager-864dd78c4c-hkm9t\" (UID: \"85cb1bd4-9005-43f9-bff5-5475db5c2832\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t"
Jul 26 18:05:29.327072 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.327035    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t"
Jul 26 18:05:29.487874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.487850    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t"]
Jul 26 18:05:29.489532 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:05:29.489494    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cb1bd4_9005_43f9_bff5_5475db5c2832.slice/crio-89d6fcbd7dde56c97cd11c9a99c2825e06b6211fa44de88d4281df9d5494177c WatchSource:0}: Error finding container 89d6fcbd7dde56c97cd11c9a99c2825e06b6211fa44de88d4281df9d5494177c: Status 404 returned error can't find the container with id 89d6fcbd7dde56c97cd11c9a99c2825e06b6211fa44de88d4281df9d5494177c
Jul 26 18:05:29.523355 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:29.523296    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t" event={"ID":"85cb1bd4-9005-43f9-bff5-5475db5c2832","Type":"ContainerStarted","Data":"89d6fcbd7dde56c97cd11c9a99c2825e06b6211fa44de88d4281df9d5494177c"}
Jul 26 18:05:32.539730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:32.539695    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t" event={"ID":"85cb1bd4-9005-43f9-bff5-5475db5c2832","Type":"ContainerStarted","Data":"ebbb15e6edb6e054949b4e1a1f90a3ef86c05e1426e474c7f6a67b4c544449e7"}
Jul 26 18:05:32.540102 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:32.539805    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t"
Jul 26 18:05:32.562291 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:32.562252    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t" podStartSLOduration=2.495736645 podStartE2EDuration="4.562239605s" totalImagesPullingTime="2.06650296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:05:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:05:32.560967602 +0000 UTC m=+489.661220489" watchObservedRunningTime="2026-07-26 18:05:32.562239605 +0000 UTC m=+489.662492491"
Jul 26 18:05:40.724118 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.724084    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"]
Jul 26 18:05:40.727745 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.727725    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:40.728974 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.728950    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"]
Jul 26 18:05:40.729178 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.729155    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv" podUID="30a04fdb-b2be-402f-87c0-9aae0dd6fb15" containerName="manager" containerID="cri-o://c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788" gracePeriod=2
Jul 26 18:05:40.741489 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.739210    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t2d9w\""
Jul 26 18:05:40.742961 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.742935    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"]
Jul 26 18:05:40.760793 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.760770    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"]
Jul 26 18:05:40.811706 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:05:40.811664    2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jbpsv\" is forbidden: User \"system:node:ip-10-0-143-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-214.ec2.internal' and this object" podUID="30a04fdb-b2be-402f-87c0-9aae0dd6fb15" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:40.837867 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.837836    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8ttq\" (UniqueName: \"kubernetes.io/projected/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-kube-api-access-v8ttq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tk75c\" (UID: \"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:40.837989 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.837894    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tk75c\" (UID: \"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:40.938798 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.938761    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8ttq\" (UniqueName: \"kubernetes.io/projected/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-kube-api-access-v8ttq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tk75c\" (UID: \"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:40.938970 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.938841    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tk75c\" (UID: \"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:40.939229 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.939177    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tk75c\" (UID: \"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:40.952258 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.952233    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8ttq\" (UniqueName: \"kubernetes.io/projected/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-kube-api-access-v8ttq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tk75c\" (UID: \"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:40.968774 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:40.968748    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:40.971402 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:05:40.971376    2548 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jbpsv\" is forbidden: User \"system:node:ip-10-0-143-214.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-214.ec2.internal' and this object" podUID="30a04fdb-b2be-402f-87c0-9aae0dd6fb15" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:41.087875 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.087805    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:41.140623 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.140587    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4lnn\" (UniqueName: \"kubernetes.io/projected/30a04fdb-b2be-402f-87c0-9aae0dd6fb15-kube-api-access-m4lnn\") pod \"30a04fdb-b2be-402f-87c0-9aae0dd6fb15\" (UID: \"30a04fdb-b2be-402f-87c0-9aae0dd6fb15\") "
Jul 26 18:05:41.143631 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.143576    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30a04fdb-b2be-402f-87c0-9aae0dd6fb15-kube-api-access-m4lnn" (OuterVolumeSpecName: "kube-api-access-m4lnn") pod "30a04fdb-b2be-402f-87c0-9aae0dd6fb15" (UID: "30a04fdb-b2be-402f-87c0-9aae0dd6fb15"). InnerVolumeSpecName "kube-api-access-m4lnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:05:41.241712 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.241680    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4lnn\" (UniqueName: \"kubernetes.io/projected/30a04fdb-b2be-402f-87c0-9aae0dd6fb15-kube-api-access-m4lnn\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:05:41.250572 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.250542    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"]
Jul 26 18:05:41.254920 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:05:41.254893    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f43b6bf_80a3_4ac8_8756_cf131b3b7f1f.slice/crio-6d6902bb6de24c5c23adb595da243af9f00d8cb187f78335c6eb0d41624355de WatchSource:0}: Error finding container 6d6902bb6de24c5c23adb595da243af9f00d8cb187f78335c6eb0d41624355de: Status 404 returned error can't find the container with id 6d6902bb6de24c5c23adb595da243af9f00d8cb187f78335c6eb0d41624355de
Jul 26 18:05:41.413108 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.413081    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30a04fdb-b2be-402f-87c0-9aae0dd6fb15" path="/var/lib/kubelet/pods/30a04fdb-b2be-402f-87c0-9aae0dd6fb15/volumes"
Jul 26 18:05:41.579230 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.579173    2548 generic.go:356] "Generic (PLEG): container finished" podID="30a04fdb-b2be-402f-87c0-9aae0dd6fb15" containerID="c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788" exitCode=0
Jul 26 18:05:41.579395 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.579233    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jbpsv"
Jul 26 18:05:41.579395 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.579248    2548 scope.go:117] "RemoveContainer" containerID="c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788"
Jul 26 18:05:41.580898 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.580859    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c" event={"ID":"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f","Type":"ContainerStarted","Data":"6d6902bb6de24c5c23adb595da243af9f00d8cb187f78335c6eb0d41624355de"}
Jul 26 18:05:41.587223 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.587186    2548 scope.go:117] "RemoveContainer" containerID="c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788"
Jul 26 18:05:41.587481 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:05:41.587463    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788\": container with ID starting with c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788 not found: ID does not exist" containerID="c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788"
Jul 26 18:05:41.587535 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:41.587489    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788"} err="failed to get container status \"c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788\": rpc error: code = NotFound desc = could not find container \"c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788\": container with ID starting with c7b4c161f92e4abfec417c136fe3f5f356e8e52691cb498ce3d9c9415d17c788 not found: ID does not exist"
Jul 26 18:05:43.265627 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.263828    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"]
Jul 26 18:05:43.266071 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.265992    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30a04fdb-b2be-402f-87c0-9aae0dd6fb15" containerName="manager"
Jul 26 18:05:43.266071 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.266012    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="30a04fdb-b2be-402f-87c0-9aae0dd6fb15" containerName="manager"
Jul 26 18:05:43.266213 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.266097    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="30a04fdb-b2be-402f-87c0-9aae0dd6fb15" containerName="manager"
Jul 26 18:05:43.269152 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.269114    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"]
Jul 26 18:05:43.269307 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.269249    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:05:43.361506 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.361471    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2vgn\" (UniqueName: \"kubernetes.io/projected/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-kube-api-access-m2vgn\") pod \"kuadrant-operator-controller-manager-86878c769f-flgf4\" (UID: \"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:05:43.361653 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.361517    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-flgf4\" (UID: \"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:05:43.462326 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.462297    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2vgn\" (UniqueName: \"kubernetes.io/projected/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-kube-api-access-m2vgn\") pod \"kuadrant-operator-controller-manager-86878c769f-flgf4\" (UID: \"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:05:43.462326 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.462332    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-flgf4\" (UID: \"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:05:43.462724 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.462705    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-flgf4\" (UID: \"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:05:43.479354 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.479324    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2vgn\" (UniqueName: \"kubernetes.io/projected/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-kube-api-access-m2vgn\") pod \"kuadrant-operator-controller-manager-86878c769f-flgf4\" (UID: \"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:05:43.546484 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.546414    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-hkm9t"
Jul 26 18:05:43.582998 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.582967    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:05:43.747767 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:43.747670    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"]
Jul 26 18:05:43.751321 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:05:43.751286    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e22737_8fc0_4cc5_9697_6a0a5e67f7e9.slice/crio-ce6ba0131fb216fc1ba9dbc2401cb0fc8536e5e7613374fe7e7591911ae37079 WatchSource:0}: Error finding container ce6ba0131fb216fc1ba9dbc2401cb0fc8536e5e7613374fe7e7591911ae37079: Status 404 returned error can't find the container with id ce6ba0131fb216fc1ba9dbc2401cb0fc8536e5e7613374fe7e7591911ae37079
Jul 26 18:05:44.598479 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:44.598442    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4" event={"ID":"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9","Type":"ContainerStarted","Data":"ce6ba0131fb216fc1ba9dbc2401cb0fc8536e5e7613374fe7e7591911ae37079"}
Jul 26 18:05:46.611421 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:46.611382    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4" event={"ID":"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9","Type":"ContainerStarted","Data":"d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c"}
Jul 26 18:05:46.611920 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:46.611549    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:05:46.613154 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:46.613129    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c" event={"ID":"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f","Type":"ContainerStarted","Data":"cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9"}
Jul 26 18:05:46.613296 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:46.613176    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:46.661579 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:46.661530    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4" podStartSLOduration=1.4089425 podStartE2EDuration="3.661492001s" totalImagesPullingTime="2.252549501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:05:46.65873327 +0000 UTC m=+503.758986170" watchObservedRunningTime="2026-07-26 18:05:46.661492001 +0000 UTC m=+503.761744888"
Jul 26 18:05:46.697254 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:46.697212    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c" podStartSLOduration=2.185785799 podStartE2EDuration="6.697182127s" totalImagesPullingTime="4.511396328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:05:46.695329424 +0000 UTC m=+503.795582327" watchObservedRunningTime="2026-07-26 18:05:46.697182127 +0000 UTC m=+503.797435012"
Jul 26 18:05:57.620447 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:57.620411    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:05:57.620877 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:57.620487    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:57.684913 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:57.684879    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"]
Jul 26 18:05:57.685073 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:57.685055    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c" podUID="6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f" containerName="manager" containerID="cri-o://cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9" gracePeriod=10
Jul 26 18:05:57.933130 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:57.933109    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:57.980445 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:57.980415    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8ttq\" (UniqueName: \"kubernetes.io/projected/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-kube-api-access-v8ttq\") pod \"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f\" (UID: \"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f\") "
Jul 26 18:05:57.980562 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:57.980508    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-extensions-socket-volume\") pod \"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f\" (UID: \"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f\") "
Jul 26 18:05:57.980994 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:57.980973    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f" (UID: "6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:05:57.982277 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:57.982245    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-kube-api-access-v8ttq" (OuterVolumeSpecName: "kube-api-access-v8ttq") pod "6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f" (UID: "6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f"). InnerVolumeSpecName "kube-api-access-v8ttq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:05:58.081962 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.081941    2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-extensions-socket-volume\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:05:58.081962 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.081963    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8ttq\" (UniqueName: \"kubernetes.io/projected/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f-kube-api-access-v8ttq\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:05:58.665399 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.665366    2548 generic.go:356] "Generic (PLEG): container finished" podID="6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f" containerID="cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9" exitCode=0
Jul 26 18:05:58.665874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.665416    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"
Jul 26 18:05:58.665874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.665424    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c" event={"ID":"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f","Type":"ContainerDied","Data":"cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9"}
Jul 26 18:05:58.665874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.665462    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c" event={"ID":"6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f","Type":"ContainerDied","Data":"6d6902bb6de24c5c23adb595da243af9f00d8cb187f78335c6eb0d41624355de"}
Jul 26 18:05:58.665874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.665483    2548 scope.go:117] "RemoveContainer" containerID="cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9"
Jul 26 18:05:58.673585 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.673570    2548 scope.go:117] "RemoveContainer" containerID="cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9"
Jul 26 18:05:58.673823 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:05:58.673802    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9\": container with ID starting with cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9 not found: ID does not exist" containerID="cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9"
Jul 26 18:05:58.673889 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.673835    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9"} err="failed to get container status \"cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9\": rpc error: code = NotFound desc = could not find container \"cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9\": container with ID starting with cac4a0eb484692901993a75467000828f57bb8a0c6f11404ae858296a0fd44d9 not found: ID does not exist"
Jul 26 18:05:58.704835 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.704809    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"]
Jul 26 18:05:58.717894 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:58.717871    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tk75c"]
Jul 26 18:05:59.412916 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:05:59.412886    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f" path="/var/lib/kubelet/pods/6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f/volumes"
Jul 26 18:06:14.458991 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.458957    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"]
Jul 26 18:06:14.459440 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.459338    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f" containerName="manager"
Jul 26 18:06:14.459440 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.459354    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f" containerName="manager"
Jul 26 18:06:14.459440 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.459411    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f43b6bf-80a3-4ac8-8756-cf131b3b7f1f" containerName="manager"
Jul 26 18:06:14.465066 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.465048    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.468814 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.468750    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lkbxx\""
Jul 26 18:06:14.514420 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.514387    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbxpw\" (UniqueName: \"kubernetes.io/projected/040cdc62-332d-4b21-b893-0956b30523ab-kube-api-access-fbxpw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.514559 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.514436    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.514559 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.514500    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.514559 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.514537    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.514715 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.514572    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/040cdc62-332d-4b21-b893-0956b30523ab-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.514715 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.514602    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/040cdc62-332d-4b21-b893-0956b30523ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.514715 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.514647    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/040cdc62-332d-4b21-b893-0956b30523ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.514715 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.514698    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.514858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.514756    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.538515 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.538489    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"]
Jul 26 18:06:14.615692 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.615660    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbxpw\" (UniqueName: \"kubernetes.io/projected/040cdc62-332d-4b21-b893-0956b30523ab-kube-api-access-fbxpw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.615837 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.615704    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.615837 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.615805    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.615917 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.615842    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.615917 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.615882    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/040cdc62-332d-4b21-b893-0956b30523ab-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.616020 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.615915    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/040cdc62-332d-4b21-b893-0956b30523ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.616020 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.615950    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/040cdc62-332d-4b21-b893-0956b30523ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.616020 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.615980    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.616162 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.616086    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.616162 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.616122    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.616308 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.616294    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.616382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.616362    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.616535 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.616516    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.616599 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.616570    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/040cdc62-332d-4b21-b893-0956b30523ab-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.618045 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.618014    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/040cdc62-332d-4b21-b893-0956b30523ab-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.618320 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.618300    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/040cdc62-332d-4b21-b893-0956b30523ab-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.648034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.648007    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/040cdc62-332d-4b21-b893-0956b30523ab-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.652095 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.652072    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbxpw\" (UniqueName: \"kubernetes.io/projected/040cdc62-332d-4b21-b893-0956b30523ab-kube-api-access-fbxpw\") pod \"maas-default-gateway-openshift-default-78bb78ff78-79jtn\" (UID: \"040cdc62-332d-4b21-b893-0956b30523ab\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.781482 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.781413    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:14.925839 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.925815    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"]
Jul 26 18:06:14.927330 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:06:14.927299    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040cdc62_332d_4b21_b893_0956b30523ab.slice/crio-8f25b872f6017272b48f65044ae7d5d6472711ab44fed79a90f1df5cfc8b441e WatchSource:0}: Error finding container 8f25b872f6017272b48f65044ae7d5d6472711ab44fed79a90f1df5cfc8b441e: Status 404 returned error can't find the container with id 8f25b872f6017272b48f65044ae7d5d6472711ab44fed79a90f1df5cfc8b441e
Jul 26 18:06:14.929490 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.929457    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:06:14.929598 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.929536    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:06:14.929598 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:14.929582    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:06:15.742176 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:15.742082    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn" event={"ID":"040cdc62-332d-4b21-b893-0956b30523ab","Type":"ContainerStarted","Data":"8bccc3b9de666279a335986f57b1d62b51bae346ad08b4f423dcdd2530128415"}
Jul 26 18:06:15.742176 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:15.742143    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn" event={"ID":"040cdc62-332d-4b21-b893-0956b30523ab","Type":"ContainerStarted","Data":"8f25b872f6017272b48f65044ae7d5d6472711ab44fed79a90f1df5cfc8b441e"}
Jul 26 18:06:15.782008 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:15.781981    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:15.783327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:15.783301    2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-79jtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 26 18:06:15.783435 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:15.783348    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn" podUID="040cdc62-332d-4b21-b893-0956b30523ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 26 18:06:16.785719 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:16.785692    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:16.831424 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:16.831377    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn" podStartSLOduration=2.8313597550000003 podStartE2EDuration="2.831359755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:06:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:06:15.777510992 +0000 UTC m=+532.877763878" watchObservedRunningTime="2026-07-26 18:06:16.831359755 +0000 UTC m=+533.931612643"
Jul 26 18:06:17.092866 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.092795    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"]
Jul 26 18:06:17.096063 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.096047    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:17.101773 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.101740    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-szp9z\""
Jul 26 18:06:17.101887 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.101778    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 26 18:06:17.134873 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.134844    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"]
Jul 26 18:06:17.154984 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.154956    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"]
Jul 26 18:06:17.240787 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.240763    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2l2z\" (UniqueName: \"kubernetes.io/projected/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-kube-api-access-j2l2z\") pod \"limitador-limitador-64c94fd64f-r7q9z\" (UID: \"5bae8dbd-ab49-4e3e-a6af-683835cd4c81\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:17.240939 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.240794    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-config-file\") pod \"limitador-limitador-64c94fd64f-r7q9z\" (UID: \"5bae8dbd-ab49-4e3e-a6af-683835cd4c81\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:17.341712 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.341670    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2l2z\" (UniqueName: \"kubernetes.io/projected/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-kube-api-access-j2l2z\") pod \"limitador-limitador-64c94fd64f-r7q9z\" (UID: \"5bae8dbd-ab49-4e3e-a6af-683835cd4c81\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:17.341712 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.341715    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-config-file\") pod \"limitador-limitador-64c94fd64f-r7q9z\" (UID: \"5bae8dbd-ab49-4e3e-a6af-683835cd4c81\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:17.342393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.342375    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-config-file\") pod \"limitador-limitador-64c94fd64f-r7q9z\" (UID: \"5bae8dbd-ab49-4e3e-a6af-683835cd4c81\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:17.365901 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.365866    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2l2z\" (UniqueName: \"kubernetes.io/projected/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-kube-api-access-j2l2z\") pod \"limitador-limitador-64c94fd64f-r7q9z\" (UID: \"5bae8dbd-ab49-4e3e-a6af-683835cd4c81\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:17.405796 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.405775    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:17.558356 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.558326    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"]
Jul 26 18:06:17.561505 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:06:17.561469    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bae8dbd_ab49_4e3e_a6af_683835cd4c81.slice/crio-2a7353ee5dfa188cbac97fa7586dc2df31769182b32e9261ba2838c503431d8a WatchSource:0}: Error finding container 2a7353ee5dfa188cbac97fa7586dc2df31769182b32e9261ba2838c503431d8a: Status 404 returned error can't find the container with id 2a7353ee5dfa188cbac97fa7586dc2df31769182b32e9261ba2838c503431d8a
Jul 26 18:06:17.751302 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.751220    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z" event={"ID":"5bae8dbd-ab49-4e3e-a6af-683835cd4c81","Type":"ContainerStarted","Data":"2a7353ee5dfa188cbac97fa7586dc2df31769182b32e9261ba2838c503431d8a"}
Jul 26 18:06:17.751447 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.751426    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:17.752301 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:17.752283    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:06:20.767897 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:20.767868    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z" event={"ID":"5bae8dbd-ab49-4e3e-a6af-683835cd4c81","Type":"ContainerStarted","Data":"731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7"}
Jul 26 18:06:20.768296 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:20.767996    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:20.799121 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:20.799078    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z" podStartSLOduration=1.170979593 podStartE2EDuration="3.799066068s" totalImagesPullingTime="2.628086475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:06:20.798548755 +0000 UTC m=+537.898801637" watchObservedRunningTime="2026-07-26 18:06:20.799066068 +0000 UTC m=+537.899318952"
Jul 26 18:06:31.772787 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:31.772756    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:32.641037 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:32.641006    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"]
Jul 26 18:06:32.641321 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:32.641182    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z" podUID="5bae8dbd-ab49-4e3e-a6af-683835cd4c81" containerName="limitador" containerID="cri-o://731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7" gracePeriod=30
Jul 26 18:06:33.182740 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.182718    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:33.287836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.287769    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2l2z\" (UniqueName: \"kubernetes.io/projected/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-kube-api-access-j2l2z\") pod \"5bae8dbd-ab49-4e3e-a6af-683835cd4c81\" (UID: \"5bae8dbd-ab49-4e3e-a6af-683835cd4c81\") "
Jul 26 18:06:33.287953 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.287838    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-config-file\") pod \"5bae8dbd-ab49-4e3e-a6af-683835cd4c81\" (UID: \"5bae8dbd-ab49-4e3e-a6af-683835cd4c81\") "
Jul 26 18:06:33.288172 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.288146    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-config-file" (OuterVolumeSpecName: "config-file") pod "5bae8dbd-ab49-4e3e-a6af-683835cd4c81" (UID: "5bae8dbd-ab49-4e3e-a6af-683835cd4c81"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:06:33.289766 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.289746    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-kube-api-access-j2l2z" (OuterVolumeSpecName: "kube-api-access-j2l2z") pod "5bae8dbd-ab49-4e3e-a6af-683835cd4c81" (UID: "5bae8dbd-ab49-4e3e-a6af-683835cd4c81"). InnerVolumeSpecName "kube-api-access-j2l2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:06:33.388558 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.388518    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2l2z\" (UniqueName: \"kubernetes.io/projected/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-kube-api-access-j2l2z\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:06:33.388558 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.388554    2548 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5bae8dbd-ab49-4e3e-a6af-683835cd4c81-config-file\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:06:33.827689 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.827653    2548 generic.go:356] "Generic (PLEG): container finished" podID="5bae8dbd-ab49-4e3e-a6af-683835cd4c81" containerID="731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7" exitCode=0
Jul 26 18:06:33.827858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.827707    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"
Jul 26 18:06:33.827858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.827719    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z" event={"ID":"5bae8dbd-ab49-4e3e-a6af-683835cd4c81","Type":"ContainerDied","Data":"731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7"}
Jul 26 18:06:33.827858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.827783    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r7q9z" event={"ID":"5bae8dbd-ab49-4e3e-a6af-683835cd4c81","Type":"ContainerDied","Data":"2a7353ee5dfa188cbac97fa7586dc2df31769182b32e9261ba2838c503431d8a"}
Jul 26 18:06:33.827858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.827803    2548 scope.go:117] "RemoveContainer" containerID="731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7"
Jul 26 18:06:33.835794 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.835775    2548 scope.go:117] "RemoveContainer" containerID="731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7"
Jul 26 18:06:33.836052 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:06:33.836035    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7\": container with ID starting with 731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7 not found: ID does not exist" containerID="731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7"
Jul 26 18:06:33.836108 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.836059    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7"} err="failed to get container status \"731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7\": rpc error: code = NotFound desc = could not find container \"731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7\": container with ID starting with 731d36f36a151ade5fc6c75933dca2591aa5cb041834ad5b4c93d81d59168bd7 not found: ID does not exist"
Jul 26 18:06:33.846834 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.846810    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"]
Jul 26 18:06:33.854725 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:33.854704    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r7q9z"]
Jul 26 18:06:35.413618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:35.413586    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bae8dbd-ab49-4e3e-a6af-683835cd4c81" path="/var/lib/kubelet/pods/5bae8dbd-ab49-4e3e-a6af-683835cd4c81/volumes"
Jul 26 18:06:38.590128 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.590095    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"]
Jul 26 18:06:38.590599 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.590581    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bae8dbd-ab49-4e3e-a6af-683835cd4c81" containerName="limitador"
Jul 26 18:06:38.590643 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.590601    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bae8dbd-ab49-4e3e-a6af-683835cd4c81" containerName="limitador"
Jul 26 18:06:38.590678 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.590661    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bae8dbd-ab49-4e3e-a6af-683835cd4c81" containerName="limitador"
Jul 26 18:06:38.595116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.595097    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"
Jul 26 18:06:38.602483 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.602462    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 26 18:06:38.602603 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.602471    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 26 18:06:38.603039 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.603025    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 26 18:06:38.603214 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.603187    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-brhxn\""
Jul 26 18:06:38.613988 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.613963    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"]
Jul 26 18:06:38.630066 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.630034    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc822562-859d-4c56-89a3-76e14426ec8a-data\") pod \"postgres-69fb4594cf-zbcrc\" (UID: \"bc822562-859d-4c56-89a3-76e14426ec8a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"
Jul 26 18:06:38.630177 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.630074    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crdtl\" (UniqueName: \"kubernetes.io/projected/bc822562-859d-4c56-89a3-76e14426ec8a-kube-api-access-crdtl\") pod \"postgres-69fb4594cf-zbcrc\" (UID: \"bc822562-859d-4c56-89a3-76e14426ec8a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"
Jul 26 18:06:38.730820 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.730788    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc822562-859d-4c56-89a3-76e14426ec8a-data\") pod \"postgres-69fb4594cf-zbcrc\" (UID: \"bc822562-859d-4c56-89a3-76e14426ec8a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"
Jul 26 18:06:38.730987 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.730834    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdtl\" (UniqueName: \"kubernetes.io/projected/bc822562-859d-4c56-89a3-76e14426ec8a-kube-api-access-crdtl\") pod \"postgres-69fb4594cf-zbcrc\" (UID: \"bc822562-859d-4c56-89a3-76e14426ec8a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"
Jul 26 18:06:38.731178 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.731158    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bc822562-859d-4c56-89a3-76e14426ec8a-data\") pod \"postgres-69fb4594cf-zbcrc\" (UID: \"bc822562-859d-4c56-89a3-76e14426ec8a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"
Jul 26 18:06:38.746113 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.746086    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crdtl\" (UniqueName: \"kubernetes.io/projected/bc822562-859d-4c56-89a3-76e14426ec8a-kube-api-access-crdtl\") pod \"postgres-69fb4594cf-zbcrc\" (UID: \"bc822562-859d-4c56-89a3-76e14426ec8a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"
Jul 26 18:06:38.905319 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:38.905281    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"
Jul 26 18:06:39.050748 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:39.050717    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"]
Jul 26 18:06:39.053075 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:06:39.053052    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc822562_859d_4c56_89a3_76e14426ec8a.slice/crio-35dc6f6c81883edc389dcdb2cccdac807c525b3b04d73983cba3dabb48810b42 WatchSource:0}: Error finding container 35dc6f6c81883edc389dcdb2cccdac807c525b3b04d73983cba3dabb48810b42: Status 404 returned error can't find the container with id 35dc6f6c81883edc389dcdb2cccdac807c525b3b04d73983cba3dabb48810b42
Jul 26 18:06:39.854923 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:39.854886    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc" event={"ID":"bc822562-859d-4c56-89a3-76e14426ec8a","Type":"ContainerStarted","Data":"35dc6f6c81883edc389dcdb2cccdac807c525b3b04d73983cba3dabb48810b42"}
Jul 26 18:06:44.882511 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:44.882477    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc" event={"ID":"bc822562-859d-4c56-89a3-76e14426ec8a","Type":"ContainerStarted","Data":"97b7e9fce0812f83b867f7385033866b90c67faa0626f81b4f2bfda3b50dde90"}
Jul 26 18:06:44.882920 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:44.882543    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"
Jul 26 18:06:44.900007 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:44.899955    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc" podStartSLOduration=1.97408088 podStartE2EDuration="6.899939195s" totalImagesPullingTime="4.925858315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:06:44.899184906 +0000 UTC m=+561.999437784" watchObservedRunningTime="2026-07-26 18:06:44.899939195 +0000 UTC m=+562.000192080"
Jul 26 18:06:50.915174 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:50.915146    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zbcrc"
Jul 26 18:06:57.509221 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.509158    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-57f777b897-92nmv"]
Jul 26 18:06:57.513966 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.513944    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:06:57.516915 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.516891    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 26 18:06:57.517043 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.516931    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 26 18:06:57.517043 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.517018    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jq28c\""
Jul 26 18:06:57.525847 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.525826    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57f777b897-92nmv"]
Jul 26 18:06:57.599045 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.599009    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-webhook-cert\") pod \"maas-controller-57f777b897-92nmv\" (UID: \"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e\") " pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:06:57.599252 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.599218    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c29k2\" (UniqueName: \"kubernetes.io/projected/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-kube-api-access-c29k2\") pod \"maas-controller-57f777b897-92nmv\" (UID: \"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e\") " pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:06:57.700263 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.700229    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c29k2\" (UniqueName: \"kubernetes.io/projected/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-kube-api-access-c29k2\") pod \"maas-controller-57f777b897-92nmv\" (UID: \"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e\") " pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:06:57.700437 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.700282    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-webhook-cert\") pod \"maas-controller-57f777b897-92nmv\" (UID: \"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e\") " pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:06:57.702668 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.702637    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-webhook-cert\") pod \"maas-controller-57f777b897-92nmv\" (UID: \"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e\") " pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:06:57.709867 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.709839    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c849f48d4-rlmhb"]
Jul 26 18:06:57.712409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.712388    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:06:57.713524 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.713504    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c29k2\" (UniqueName: \"kubernetes.io/projected/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-kube-api-access-c29k2\") pod \"maas-controller-57f777b897-92nmv\" (UID: \"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e\") " pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:06:57.728210 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.723289    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-rlmhb"]
Jul 26 18:06:57.801032 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.800941    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-webhook-cert\") pod \"maas-controller-5c849f48d4-rlmhb\" (UID: \"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc\") " pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:06:57.801032 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.801004    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6jl2\" (UniqueName: \"kubernetes.io/projected/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-kube-api-access-t6jl2\") pod \"maas-controller-5c849f48d4-rlmhb\" (UID: \"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc\") " pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:06:57.824500 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.824466    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:06:57.901857 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.901756    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-webhook-cert\") pod \"maas-controller-5c849f48d4-rlmhb\" (UID: \"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc\") " pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:06:57.901857 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.901821    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6jl2\" (UniqueName: \"kubernetes.io/projected/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-kube-api-access-t6jl2\") pod \"maas-controller-5c849f48d4-rlmhb\" (UID: \"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc\") " pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:06:57.905021 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.904771    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-webhook-cert\") pod \"maas-controller-5c849f48d4-rlmhb\" (UID: \"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc\") " pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:06:57.910964 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.910939    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6jl2\" (UniqueName: \"kubernetes.io/projected/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-kube-api-access-t6jl2\") pod \"maas-controller-5c849f48d4-rlmhb\" (UID: \"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc\") " pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:06:57.951749 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:57.951723    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-57f777b897-92nmv"]
Jul 26 18:06:57.953136 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:06:57.953109    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad3b1cb_c2f9_43a5_99af_3d8eea712c0e.slice/crio-afacd454185c8692bb7be86d45028a7f37f481137be109b9c52a61bd51a95e7f WatchSource:0}: Error finding container afacd454185c8692bb7be86d45028a7f37f481137be109b9c52a61bd51a95e7f: Status 404 returned error can't find the container with id afacd454185c8692bb7be86d45028a7f37f481137be109b9c52a61bd51a95e7f
Jul 26 18:06:58.037406 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:58.037361    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:06:58.166764 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:58.166736    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-rlmhb"]
Jul 26 18:06:58.168883 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:06:58.168854    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9acc3c3b_cc6e_42c7_99ba_64123c90b3bc.slice/crio-29731c5c5156d5960b6de21550da66142db672a994eb3fda7756e0133a6ab6ab WatchSource:0}: Error finding container 29731c5c5156d5960b6de21550da66142db672a994eb3fda7756e0133a6ab6ab: Status 404 returned error can't find the container with id 29731c5c5156d5960b6de21550da66142db672a994eb3fda7756e0133a6ab6ab
Jul 26 18:06:58.949367 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:58.949328    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f777b897-92nmv" event={"ID":"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e","Type":"ContainerStarted","Data":"afacd454185c8692bb7be86d45028a7f37f481137be109b9c52a61bd51a95e7f"}
Jul 26 18:06:58.952623 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:06:58.952583    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c849f48d4-rlmhb" event={"ID":"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc","Type":"ContainerStarted","Data":"29731c5c5156d5960b6de21550da66142db672a994eb3fda7756e0133a6ab6ab"}
Jul 26 18:07:00.963714 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:00.963675    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f777b897-92nmv" event={"ID":"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e","Type":"ContainerStarted","Data":"eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632"}
Jul 26 18:07:00.964209 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:00.963860    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:07:00.965160 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:00.965134    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c849f48d4-rlmhb" event={"ID":"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc","Type":"ContainerStarted","Data":"b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7"}
Jul 26 18:07:00.965290 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:00.965270    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:07:00.989128 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:00.989084    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-57f777b897-92nmv" podStartSLOduration=1.551643055 podStartE2EDuration="3.989070234s" totalImagesPullingTime="2.437427179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:07:00.988416535 +0000 UTC m=+578.088669444" watchObservedRunningTime="2026-07-26 18:07:00.989070234 +0000 UTC m=+578.089323134"
Jul 26 18:07:01.012661 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:01.012607    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c849f48d4-rlmhb" podStartSLOduration=1.786413716 podStartE2EDuration="4.012594379s" totalImagesPullingTime="2.226180663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:06:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:07:01.010412181 +0000 UTC m=+578.110665093" watchObservedRunningTime="2026-07-26 18:07:01.012594379 +0000 UTC m=+578.112847288"
Jul 26 18:07:11.973522 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:11.973489    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:07:11.973948 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:11.973577    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:07:12.040536 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:12.040497    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57f777b897-92nmv"]
Jul 26 18:07:12.040730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:12.040670    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-57f777b897-92nmv" podUID="7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e" containerName="manager" containerID="cri-o://eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632" gracePeriod=30
Jul 26 18:07:12.278699 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:12.278664    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:07:12.434309 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:12.434270    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-webhook-cert\") pod \"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e\" (UID: \"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e\") "
Jul 26 18:07:12.434528 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:12.434353    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c29k2\" (UniqueName: \"kubernetes.io/projected/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-kube-api-access-c29k2\") pod \"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e\" (UID: \"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e\") "
Jul 26 18:07:12.436514 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:12.436477    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e" (UID: "7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:07:12.436636 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:12.436582    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-kube-api-access-c29k2" (OuterVolumeSpecName: "kube-api-access-c29k2") pod "7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e" (UID: "7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e"). InnerVolumeSpecName "kube-api-access-c29k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:07:12.536030 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:12.535944    2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-webhook-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:07:12.536030 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:12.535973    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c29k2\" (UniqueName: \"kubernetes.io/projected/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e-kube-api-access-c29k2\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:07:13.021943 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:13.021912    2548 generic.go:356] "Generic (PLEG): container finished" podID="7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e" containerID="eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632" exitCode=0
Jul 26 18:07:13.022376 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:13.021957    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-57f777b897-92nmv"
Jul 26 18:07:13.022376 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:13.021996    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f777b897-92nmv" event={"ID":"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e","Type":"ContainerDied","Data":"eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632"}
Jul 26 18:07:13.022376 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:13.022035    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-57f777b897-92nmv" event={"ID":"7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e","Type":"ContainerDied","Data":"afacd454185c8692bb7be86d45028a7f37f481137be109b9c52a61bd51a95e7f"}
Jul 26 18:07:13.022376 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:13.022056    2548 scope.go:117] "RemoveContainer" containerID="eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632"
Jul 26 18:07:13.031296 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:13.031278    2548 scope.go:117] "RemoveContainer" containerID="eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632"
Jul 26 18:07:13.031549 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:07:13.031531    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632\": container with ID starting with eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632 not found: ID does not exist" containerID="eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632"
Jul 26 18:07:13.031591 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:13.031560    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632"} err="failed to get container status \"eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632\": rpc error: code = NotFound desc = could not find container \"eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632\": container with ID starting with eb4d5bce3748a6975afe8e20491d232ffefce69af48147e7f13263270dd98632 not found: ID does not exist"
Jul 26 18:07:13.044852 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:13.044827    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-57f777b897-92nmv"]
Jul 26 18:07:13.049523 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:13.049498    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-57f777b897-92nmv"]
Jul 26 18:07:13.414087 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:13.414056    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e" path="/var/lib/kubelet/pods/7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e/volumes"
Jul 26 18:07:33.270998 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.270961    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"]
Jul 26 18:07:33.271419 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.271344    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e" containerName="manager"
Jul 26 18:07:33.271419 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.271358    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e" containerName="manager"
Jul 26 18:07:33.271528 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.271424    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ad3b1cb-c2f9-43a5-99af-3d8eea712c0e" containerName="manager"
Jul 26 18:07:33.278504 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.278482    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.284289 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.284262    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-96p2z\""
Jul 26 18:07:33.284401 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.284268    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 26 18:07:33.294630 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.294604    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"]
Jul 26 18:07:33.326126 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.326090    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b139a0e-7c6c-4e54-9043-1d58616ca8e5-openshift-service-ca\") pod \"maas-api-d7b97ccf-k8gq9\" (UID: \"5b139a0e-7c6c-4e54-9043-1d58616ca8e5\") " pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.326323 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.326167    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnrdt\" (UniqueName: \"kubernetes.io/projected/5b139a0e-7c6c-4e54-9043-1d58616ca8e5-kube-api-access-bnrdt\") pod \"maas-api-d7b97ccf-k8gq9\" (UID: \"5b139a0e-7c6c-4e54-9043-1d58616ca8e5\") " pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.326323 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.326186    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b139a0e-7c6c-4e54-9043-1d58616ca8e5-maas-api-tls\") pod \"maas-api-d7b97ccf-k8gq9\" (UID: \"5b139a0e-7c6c-4e54-9043-1d58616ca8e5\") " pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.426860 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.426829    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnrdt\" (UniqueName: \"kubernetes.io/projected/5b139a0e-7c6c-4e54-9043-1d58616ca8e5-kube-api-access-bnrdt\") pod \"maas-api-d7b97ccf-k8gq9\" (UID: \"5b139a0e-7c6c-4e54-9043-1d58616ca8e5\") " pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.426860 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.426861    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b139a0e-7c6c-4e54-9043-1d58616ca8e5-maas-api-tls\") pod \"maas-api-d7b97ccf-k8gq9\" (UID: \"5b139a0e-7c6c-4e54-9043-1d58616ca8e5\") " pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.427103 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.427004    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b139a0e-7c6c-4e54-9043-1d58616ca8e5-openshift-service-ca\") pod \"maas-api-d7b97ccf-k8gq9\" (UID: \"5b139a0e-7c6c-4e54-9043-1d58616ca8e5\") " pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.427787 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.427762    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b139a0e-7c6c-4e54-9043-1d58616ca8e5-openshift-service-ca\") pod \"maas-api-d7b97ccf-k8gq9\" (UID: \"5b139a0e-7c6c-4e54-9043-1d58616ca8e5\") " pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.429442 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.429427    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b139a0e-7c6c-4e54-9043-1d58616ca8e5-maas-api-tls\") pod \"maas-api-d7b97ccf-k8gq9\" (UID: \"5b139a0e-7c6c-4e54-9043-1d58616ca8e5\") " pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.437664 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.437635    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnrdt\" (UniqueName: \"kubernetes.io/projected/5b139a0e-7c6c-4e54-9043-1d58616ca8e5-kube-api-access-bnrdt\") pod \"maas-api-d7b97ccf-k8gq9\" (UID: \"5b139a0e-7c6c-4e54-9043-1d58616ca8e5\") " pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.588415 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.588333    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:33.730393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.730366    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"]
Jul 26 18:07:33.733079 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:07:33.733041    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b139a0e_7c6c_4e54_9043_1d58616ca8e5.slice/crio-36f16c49b0f25aeec7c0ada864fb5a401b0cb08bf5a4a96ec90af1bf3e6f22cd WatchSource:0}: Error finding container 36f16c49b0f25aeec7c0ada864fb5a401b0cb08bf5a4a96ec90af1bf3e6f22cd: Status 404 returned error can't find the container with id 36f16c49b0f25aeec7c0ada864fb5a401b0cb08bf5a4a96ec90af1bf3e6f22cd
Jul 26 18:07:33.862883 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.862854    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"]
Jul 26 18:07:33.866323 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.866305    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"
Jul 26 18:07:33.868998 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.868974    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 26 18:07:33.876585 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.876496    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"]
Jul 26 18:07:33.892765 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.892738    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-dk9v8"]
Jul 26 18:07:33.895217 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.895175    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8"
Jul 26 18:07:33.899149 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.899129    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-h9wzk\""
Jul 26 18:07:33.915413 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.915387    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-dk9v8"]
Jul 26 18:07:33.931568 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.931538    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc4rc\" (UniqueName: \"kubernetes.io/projected/806c5996-5e66-41bd-84c0-38ca75e60474-kube-api-access-mc4rc\") pod \"payload-pre-processing-687dbb6cf6-zfwwx\" (UID: \"806c5996-5e66-41bd-84c0-38ca75e60474\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"
Jul 26 18:07:33.931695 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.931578    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxvlp\" (UniqueName: \"kubernetes.io/projected/cd3aa98a-31bf-49c6-b800-1f62983a6d45-kube-api-access-kxvlp\") pod \"payload-processing-5cc6cd444b-dk9v8\" (UID: \"cd3aa98a-31bf-49c6-b800-1f62983a6d45\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8"
Jul 26 18:07:33.931695 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.931614    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3aa98a-31bf-49c6-b800-1f62983a6d45-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-dk9v8\" (UID: \"cd3aa98a-31bf-49c6-b800-1f62983a6d45\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8"
Jul 26 18:07:33.931807 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:33.931733    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/806c5996-5e66-41bd-84c0-38ca75e60474-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zfwwx\" (UID: \"806c5996-5e66-41bd-84c0-38ca75e60474\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"
Jul 26 18:07:34.033063 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.033026    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/806c5996-5e66-41bd-84c0-38ca75e60474-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zfwwx\" (UID: \"806c5996-5e66-41bd-84c0-38ca75e60474\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"
Jul 26 18:07:34.033273 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.033096    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc4rc\" (UniqueName: \"kubernetes.io/projected/806c5996-5e66-41bd-84c0-38ca75e60474-kube-api-access-mc4rc\") pod \"payload-pre-processing-687dbb6cf6-zfwwx\" (UID: \"806c5996-5e66-41bd-84c0-38ca75e60474\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"
Jul 26 18:07:34.033273 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.033117    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxvlp\" (UniqueName: \"kubernetes.io/projected/cd3aa98a-31bf-49c6-b800-1f62983a6d45-kube-api-access-kxvlp\") pod \"payload-processing-5cc6cd444b-dk9v8\" (UID: \"cd3aa98a-31bf-49c6-b800-1f62983a6d45\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8"
Jul 26 18:07:34.033273 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.033141    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3aa98a-31bf-49c6-b800-1f62983a6d45-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-dk9v8\" (UID: \"cd3aa98a-31bf-49c6-b800-1f62983a6d45\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8"
Jul 26 18:07:34.033900 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.033867    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd3aa98a-31bf-49c6-b800-1f62983a6d45-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-dk9v8\" (UID: \"cd3aa98a-31bf-49c6-b800-1f62983a6d45\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8"
Jul 26 18:07:34.034012 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.033916    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/806c5996-5e66-41bd-84c0-38ca75e60474-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zfwwx\" (UID: \"806c5996-5e66-41bd-84c0-38ca75e60474\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"
Jul 26 18:07:34.042770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.042717    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxvlp\" (UniqueName: \"kubernetes.io/projected/cd3aa98a-31bf-49c6-b800-1f62983a6d45-kube-api-access-kxvlp\") pod \"payload-processing-5cc6cd444b-dk9v8\" (UID: \"cd3aa98a-31bf-49c6-b800-1f62983a6d45\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8"
Jul 26 18:07:34.045115 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.045091    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc4rc\" (UniqueName: \"kubernetes.io/projected/806c5996-5e66-41bd-84c0-38ca75e60474-kube-api-access-mc4rc\") pod \"payload-pre-processing-687dbb6cf6-zfwwx\" (UID: \"806c5996-5e66-41bd-84c0-38ca75e60474\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"
Jul 26 18:07:34.114955 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.114865    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9" event={"ID":"5b139a0e-7c6c-4e54-9043-1d58616ca8e5","Type":"ContainerStarted","Data":"36f16c49b0f25aeec7c0ada864fb5a401b0cb08bf5a4a96ec90af1bf3e6f22cd"}
Jul 26 18:07:34.178423 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.178392    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"
Jul 26 18:07:34.208059 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.208027    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8"
Jul 26 18:07:34.366505 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.366479    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"]
Jul 26 18:07:34.368971 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:07:34.368941    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806c5996_5e66_41bd_84c0_38ca75e60474.slice/crio-dd2b28c21e19f44bc3dfa005f9dc14bb52abc65127f9bd45ede7e8ea8fd8bfff WatchSource:0}: Error finding container dd2b28c21e19f44bc3dfa005f9dc14bb52abc65127f9bd45ede7e8ea8fd8bfff: Status 404 returned error can't find the container with id dd2b28c21e19f44bc3dfa005f9dc14bb52abc65127f9bd45ede7e8ea8fd8bfff
Jul 26 18:07:34.391423 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:34.391397    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-dk9v8"]
Jul 26 18:07:34.393480 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:07:34.393441    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3aa98a_31bf_49c6_b800_1f62983a6d45.slice/crio-d673ccdd6430893e44d311a907c5bb3cdb3fbdec573fd1b63c35ca77e46da8c6 WatchSource:0}: Error finding container d673ccdd6430893e44d311a907c5bb3cdb3fbdec573fd1b63c35ca77e46da8c6: Status 404 returned error can't find the container with id d673ccdd6430893e44d311a907c5bb3cdb3fbdec573fd1b63c35ca77e46da8c6
Jul 26 18:07:35.124669 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:35.124626    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8" event={"ID":"cd3aa98a-31bf-49c6-b800-1f62983a6d45","Type":"ContainerStarted","Data":"d673ccdd6430893e44d311a907c5bb3cdb3fbdec573fd1b63c35ca77e46da8c6"}
Jul 26 18:07:35.126405 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:35.126374    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx" event={"ID":"806c5996-5e66-41bd-84c0-38ca75e60474","Type":"ContainerStarted","Data":"dd2b28c21e19f44bc3dfa005f9dc14bb52abc65127f9bd45ede7e8ea8fd8bfff"}
Jul 26 18:07:36.135686 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:36.135549    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9" event={"ID":"5b139a0e-7c6c-4e54-9043-1d58616ca8e5","Type":"ContainerStarted","Data":"9e6bfa6e475e4c8375064cde24e27a0b8c0834a0cc4afbee4739686ce6834728"}
Jul 26 18:07:36.135686 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:36.135639    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:36.169229 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:36.164451    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9" podStartSLOduration=0.930667058 podStartE2EDuration="3.164429198s" totalImagesPullingTime="2.23376214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:07:36.153469205 +0000 UTC m=+613.253722116" watchObservedRunningTime="2026-07-26 18:07:36.164429198 +0000 UTC m=+613.264682085"
Jul 26 18:07:38.148131 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:38.148090    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8" event={"ID":"cd3aa98a-31bf-49c6-b800-1f62983a6d45","Type":"ContainerStarted","Data":"9eed118be80cdceec4964eb04c2f026075a2c700591dc21a37c1cd429beff254"}
Jul 26 18:07:38.148620 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:38.148176    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8"
Jul 26 18:07:38.149566 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:38.149541    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx" event={"ID":"806c5996-5e66-41bd-84c0-38ca75e60474","Type":"ContainerStarted","Data":"8c968334f9361bc4704d11111d5685afac16706430014b437ad2dde8e60aa394"}
Jul 26 18:07:38.149645 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:38.149597    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"
Jul 26 18:07:38.166892 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:38.166832    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8" podStartSLOduration=1.8616804390000001 podStartE2EDuration="5.166813123s" totalImagesPullingTime="3.305132684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:07:38.163941942 +0000 UTC m=+615.264194857" watchObservedRunningTime="2026-07-26 18:07:38.166813123 +0000 UTC m=+615.267066010"
Jul 26 18:07:38.185369 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:38.185313    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx" podStartSLOduration=1.848374126 podStartE2EDuration="5.185295187s" totalImagesPullingTime="3.336921061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:07:38.183659702 +0000 UTC m=+615.283912586" watchObservedRunningTime="2026-07-26 18:07:38.185295187 +0000 UTC m=+615.285548074"
Jul 26 18:07:42.147393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:42.147361    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d7b97ccf-k8gq9"
Jul 26 18:07:42.172393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:42.172356    2548 generic.go:356] "Generic (PLEG): container finished" podID="040cdc62-332d-4b21-b893-0956b30523ab" containerID="8bccc3b9de666279a335986f57b1d62b51bae346ad08b4f423dcdd2530128415" exitCode=0
Jul 26 18:07:42.172568 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:42.172428    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn" event={"ID":"040cdc62-332d-4b21-b893-0956b30523ab","Type":"ContainerDied","Data":"8bccc3b9de666279a335986f57b1d62b51bae346ad08b4f423dcdd2530128415"}
Jul 26 18:07:42.172818 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:42.172804    2548 scope.go:117] "RemoveContainer" containerID="8bccc3b9de666279a335986f57b1d62b51bae346ad08b4f423dcdd2530128415"
Jul 26 18:07:42.173801 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:42.173773    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:07:42.173976 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:42.173847    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:07:42.173976 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:42.173900    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:07:43.182122 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:43.182082    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn" event={"ID":"040cdc62-332d-4b21-b893-0956b30523ab","Type":"ContainerStarted","Data":"6fb1301b6f9578aa7f38ced2fab4155f600b605b1a23a59a968bf859f1b9433a"}
Jul 26 18:07:43.782087 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:43.782047    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:07:43.783247 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:43.783218    2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-79jtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 26 18:07:43.783365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:43.783269    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn" podUID="040cdc62-332d-4b21-b893-0956b30523ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 26 18:07:44.782699 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:44.782658    2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-79jtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 26 18:07:44.783181 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:44.782742    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn" podUID="040cdc62-332d-4b21-b893-0956b30523ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 26 18:07:45.782402 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:45.782302    2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-79jtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 26 18:07:45.782402 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:45.782365    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn" podUID="040cdc62-332d-4b21-b893-0956b30523ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 26 18:07:46.782122 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:46.782077    2548 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-79jtn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 26 18:07:46.782538 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:46.782150    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn" podUID="040cdc62-332d-4b21-b893-0956b30523ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 26 18:07:47.751445 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:47.751411    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:07:47.785643 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:47.785618    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:07:48.205967 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:48.205941    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-79jtn"
Jul 26 18:07:49.157844 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:49.157815    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-dk9v8"
Jul 26 18:07:49.158343 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:07:49.158152    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zfwwx"
Jul 26 18:08:14.851164 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.851132    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"]
Jul 26 18:08:14.855815 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.855792    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:14.859278 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.859256    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 26 18:08:14.859408 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.859256    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sc8sl\""
Jul 26 18:08:14.859408 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.859256    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 26 18:08:14.859408 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.859280    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 26 18:08:14.865164 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.865141    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"]
Jul 26 18:08:14.943971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.943937    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db98fe38-41d5-42e8-b868-fe172f14ce82-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:14.943971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.943974    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:14.944252 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.943992    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tcmm\" (UniqueName: \"kubernetes.io/projected/db98fe38-41d5-42e8-b868-fe172f14ce82-kube-api-access-8tcmm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:14.944252 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.944084    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:14.944252 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.944235    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:14.944377 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:14.944271    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.044840 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.044802    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.045011 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.044862    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db98fe38-41d5-42e8-b868-fe172f14ce82-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.045011 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.044888    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.045011 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.044904    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tcmm\" (UniqueName: \"kubernetes.io/projected/db98fe38-41d5-42e8-b868-fe172f14ce82-kube-api-access-8tcmm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.045011 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.044946    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.045249 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.045022    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.045298 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.045255    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.045342 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.045327    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.045406 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.045390    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.047258 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.047223    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db98fe38-41d5-42e8-b868-fe172f14ce82-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.047513 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.047496    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db98fe38-41d5-42e8-b868-fe172f14ce82-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.052960 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.052937    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tcmm\" (UniqueName: \"kubernetes.io/projected/db98fe38-41d5-42e8-b868-fe172f14ce82-kube-api-access-8tcmm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4tfp5\" (UID: \"db98fe38-41d5-42e8-b868-fe172f14ce82\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.166435 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.166412    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:15.301634 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.301603    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"]
Jul 26 18:08:15.302934 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:08:15.302894    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb98fe38_41d5_42e8_b868_fe172f14ce82.slice/crio-40bdd1dd2e575736489b62c39dc4a1caa6a07dd449f897c81f50b2f74303c3ad WatchSource:0}: Error finding container 40bdd1dd2e575736489b62c39dc4a1caa6a07dd449f897c81f50b2f74303c3ad: Status 404 returned error can't find the container with id 40bdd1dd2e575736489b62c39dc4a1caa6a07dd449f897c81f50b2f74303c3ad
Jul 26 18:08:15.304106 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.304084    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 18:08:15.336739 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:15.336711    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5" event={"ID":"db98fe38-41d5-42e8-b868-fe172f14ce82","Type":"ContainerStarted","Data":"40bdd1dd2e575736489b62c39dc4a1caa6a07dd449f897c81f50b2f74303c3ad"}
Jul 26 18:08:17.348982 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:17.348947    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5" event={"ID":"db98fe38-41d5-42e8-b868-fe172f14ce82","Type":"ContainerStarted","Data":"43be9e0f8c1e562f40c74bc09fe077822a6376bc3941109fc108a9067617f5ce"}
Jul 26 18:08:17.374724 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:17.374655    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5" podStartSLOduration=2.393658572 podStartE2EDuration="3.374633636s" totalImagesPullingTime="980.975064ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:08:17.373466622 +0000 UTC m=+654.473719520" watchObservedRunningTime="2026-07-26 18:08:17.374633636 +0000 UTC m=+654.474886523"
Jul 26 18:08:19.333455 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.333408    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"]
Jul 26 18:08:19.335817 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.335798    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.338418 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.338399    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 26 18:08:19.349367 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.349342    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"]
Jul 26 18:08:19.487017 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.486982    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.487240 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.487035    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.487240 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.487081    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4z4r\" (UniqueName: \"kubernetes.io/projected/a88293c8-64eb-4bb7-84ba-fd6170a2720c-kube-api-access-k4z4r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.487240 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.487121    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.487240 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.487142    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a88293c8-64eb-4bb7-84ba-fd6170a2720c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.487240 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.487187    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.587807 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.587712    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.587807 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.587768    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.587807 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.587801    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4z4r\" (UniqueName: \"kubernetes.io/projected/a88293c8-64eb-4bb7-84ba-fd6170a2720c-kube-api-access-k4z4r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.588075 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.587830    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.588075 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.587852    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a88293c8-64eb-4bb7-84ba-fd6170a2720c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.588075 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.587914    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.588275 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.588187    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.588327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.588269    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.588327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.588302    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.590019 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.590002    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a88293c8-64eb-4bb7-84ba-fd6170a2720c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.590307 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.590290    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a88293c8-64eb-4bb7-84ba-fd6170a2720c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.595617 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.595595    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4z4r\" (UniqueName: \"kubernetes.io/projected/a88293c8-64eb-4bb7-84ba-fd6170a2720c-kube-api-access-k4z4r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9\" (UID: \"a88293c8-64eb-4bb7-84ba-fd6170a2720c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.646941 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.646909    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:19.783601 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:19.783577    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"]
Jul 26 18:08:19.785706 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:08:19.785681    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda88293c8_64eb_4bb7_84ba_fd6170a2720c.slice/crio-a6bd93a62804b7c239097a5c6fb2da6bd73a15e4e6366179ef2372be8ee3392b WatchSource:0}: Error finding container a6bd93a62804b7c239097a5c6fb2da6bd73a15e4e6366179ef2372be8ee3392b: Status 404 returned error can't find the container with id a6bd93a62804b7c239097a5c6fb2da6bd73a15e4e6366179ef2372be8ee3392b
Jul 26 18:08:20.368355 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:20.368321    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9" event={"ID":"a88293c8-64eb-4bb7-84ba-fd6170a2720c","Type":"ContainerStarted","Data":"e9ef8c30dab96d54469c8bc033be3cb2a0f7b945db40d2568f5f6549edfa89c7"}
Jul 26 18:08:20.368798 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:20.368374    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9" event={"ID":"a88293c8-64eb-4bb7-84ba-fd6170a2720c","Type":"ContainerStarted","Data":"a6bd93a62804b7c239097a5c6fb2da6bd73a15e4e6366179ef2372be8ee3392b"}
Jul 26 18:08:20.390745 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:20.390695    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9" podStartSLOduration=1.23579481 podStartE2EDuration="1.390678588s" totalImagesPullingTime="154.883778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:08:20.38820393 +0000 UTC m=+657.488456832" watchObservedRunningTime="2026-07-26 18:08:20.390678588 +0000 UTC m=+657.490931519"
Jul 26 18:08:25.167343 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:25.167313    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:25.167707 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:25.167368    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:25.181010 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:25.180987    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:25.403161 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:25.403133    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4tfp5"
Jul 26 18:08:29.647434 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:29.647400    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:29.647891 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:29.647465    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:29.659804 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:29.659776    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:08:30.431481 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:08:30.431241    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9"
Jul 26 18:11:08.475869 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:08.475831    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-rlmhb"]
Jul 26 18:11:08.476436 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:08.476026    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c849f48d4-rlmhb" podUID="9acc3c3b-cc6e-42c7-99ba-64123c90b3bc" containerName="manager" containerID="cri-o://b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7" gracePeriod=30
Jul 26 18:11:08.729658 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:08.729595    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:11:08.807795 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:08.807764    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-webhook-cert\") pod \"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc\" (UID: \"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc\") "
Jul 26 18:11:08.807946 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:08.807832    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6jl2\" (UniqueName: \"kubernetes.io/projected/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-kube-api-access-t6jl2\") pod \"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc\" (UID: \"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc\") "
Jul 26 18:11:08.809843 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:08.809809    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-kube-api-access-t6jl2" (OuterVolumeSpecName: "kube-api-access-t6jl2") pod "9acc3c3b-cc6e-42c7-99ba-64123c90b3bc" (UID: "9acc3c3b-cc6e-42c7-99ba-64123c90b3bc"). InnerVolumeSpecName "kube-api-access-t6jl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:11:08.809843 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:08.809819    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9acc3c3b-cc6e-42c7-99ba-64123c90b3bc" (UID: "9acc3c3b-cc6e-42c7-99ba-64123c90b3bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:11:08.908921 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:08.908891    2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-webhook-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:11:08.908921 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:08.908917    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6jl2\" (UniqueName: \"kubernetes.io/projected/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc-kube-api-access-t6jl2\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:11:09.137416 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:09.137386    2548 generic.go:356] "Generic (PLEG): container finished" podID="9acc3c3b-cc6e-42c7-99ba-64123c90b3bc" containerID="b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7" exitCode=0
Jul 26 18:11:09.137565 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:09.137428    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c849f48d4-rlmhb" event={"ID":"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc","Type":"ContainerDied","Data":"b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7"}
Jul 26 18:11:09.137565 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:09.137465    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c849f48d4-rlmhb" event={"ID":"9acc3c3b-cc6e-42c7-99ba-64123c90b3bc","Type":"ContainerDied","Data":"29731c5c5156d5960b6de21550da66142db672a994eb3fda7756e0133a6ab6ab"}
Jul 26 18:11:09.137565 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:09.137429    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c849f48d4-rlmhb"
Jul 26 18:11:09.137565 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:09.137487    2548 scope.go:117] "RemoveContainer" containerID="b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7"
Jul 26 18:11:09.146912 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:09.146897    2548 scope.go:117] "RemoveContainer" containerID="b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7"
Jul 26 18:11:09.147143 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:11:09.147128    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7\": container with ID starting with b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7 not found: ID does not exist" containerID="b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7"
Jul 26 18:11:09.147212 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:09.147151    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7"} err="failed to get container status \"b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7\": rpc error: code = NotFound desc = could not find container \"b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7\": container with ID starting with b14445dd304e4f375e53c9229082986447811a22754ad3a097274ab50cb622d7 not found: ID does not exist"
Jul 26 18:11:09.161424 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:09.161401    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-rlmhb"]
Jul 26 18:11:09.166040 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:09.166018    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-rlmhb"]
Jul 26 18:11:09.413570 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:11:09.413478    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9acc3c3b-cc6e-42c7-99ba-64123c90b3bc" path="/var/lib/kubelet/pods/9acc3c3b-cc6e-42c7-99ba-64123c90b3bc/volumes"
Jul 26 18:12:09.964690 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:09.964657    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c849f48d4-x6hvh"]
Jul 26 18:12:09.965161 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:09.965023    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9acc3c3b-cc6e-42c7-99ba-64123c90b3bc" containerName="manager"
Jul 26 18:12:09.965161 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:09.965033    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="9acc3c3b-cc6e-42c7-99ba-64123c90b3bc" containerName="manager"
Jul 26 18:12:09.965161 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:09.965110    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="9acc3c3b-cc6e-42c7-99ba-64123c90b3bc" containerName="manager"
Jul 26 18:12:09.968254 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:09.968237    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:09.971762 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:09.971737    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 26 18:12:09.971925 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:09.971737    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 26 18:12:09.971925 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:09.971742    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jq28c\""
Jul 26 18:12:09.976532 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:09.976507    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-x6hvh"]
Jul 26 18:12:10.082457 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:10.082427    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-webhook-cert\") pod \"maas-controller-5c849f48d4-x6hvh\" (UID: \"cbc6b49c-9d80-40d1-9278-ad44ca4510bc\") " pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:10.082578 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:10.082503    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vhcv\" (UniqueName: \"kubernetes.io/projected/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-kube-api-access-9vhcv\") pod \"maas-controller-5c849f48d4-x6hvh\" (UID: \"cbc6b49c-9d80-40d1-9278-ad44ca4510bc\") " pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:10.183373 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:10.183347    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-webhook-cert\") pod \"maas-controller-5c849f48d4-x6hvh\" (UID: \"cbc6b49c-9d80-40d1-9278-ad44ca4510bc\") " pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:10.183507 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:10.183414    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vhcv\" (UniqueName: \"kubernetes.io/projected/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-kube-api-access-9vhcv\") pod \"maas-controller-5c849f48d4-x6hvh\" (UID: \"cbc6b49c-9d80-40d1-9278-ad44ca4510bc\") " pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:10.185801 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:10.185779    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-webhook-cert\") pod \"maas-controller-5c849f48d4-x6hvh\" (UID: \"cbc6b49c-9d80-40d1-9278-ad44ca4510bc\") " pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:10.191986 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:10.191963    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vhcv\" (UniqueName: \"kubernetes.io/projected/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-kube-api-access-9vhcv\") pod \"maas-controller-5c849f48d4-x6hvh\" (UID: \"cbc6b49c-9d80-40d1-9278-ad44ca4510bc\") " pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:10.305959 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:10.305873    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:10.443748 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:10.443723    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-x6hvh"]
Jul 26 18:12:10.445505 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:12:10.445478    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc6b49c_9d80_40d1_9278_ad44ca4510bc.slice/crio-3fde6540424ce0c0638ef95318d9e496ffaa0c7a7a8952632c8ca96615bb87d7 WatchSource:0}: Error finding container 3fde6540424ce0c0638ef95318d9e496ffaa0c7a7a8952632c8ca96615bb87d7: Status 404 returned error can't find the container with id 3fde6540424ce0c0638ef95318d9e496ffaa0c7a7a8952632c8ca96615bb87d7
Jul 26 18:12:11.435853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:11.435751    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c849f48d4-x6hvh" event={"ID":"cbc6b49c-9d80-40d1-9278-ad44ca4510bc","Type":"ContainerStarted","Data":"4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2"}
Jul 26 18:12:11.435853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:11.435812    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c849f48d4-x6hvh" event={"ID":"cbc6b49c-9d80-40d1-9278-ad44ca4510bc","Type":"ContainerStarted","Data":"3fde6540424ce0c0638ef95318d9e496ffaa0c7a7a8952632c8ca96615bb87d7"}
Jul 26 18:12:11.436349 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:11.435926    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:11.453065 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:11.453020    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c849f48d4-x6hvh" podStartSLOduration=1.7344067779999999 podStartE2EDuration="2.453002256s" totalImagesPullingTime="718.595478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:12:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:12:11.452058757 +0000 UTC m=+888.552311682" watchObservedRunningTime="2026-07-26 18:12:11.453002256 +0000 UTC m=+888.553255163"
Jul 26 18:12:22.442758 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:22.442726    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:27.071207 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.071156    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-x6hvh"]
Jul 26 18:12:27.071621 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.071367    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c849f48d4-x6hvh" podUID="cbc6b49c-9d80-40d1-9278-ad44ca4510bc" containerName="manager" containerID="cri-o://4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2" gracePeriod=30
Jul 26 18:12:27.322568 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.322499    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:27.442360 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.442331    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-webhook-cert\") pod \"cbc6b49c-9d80-40d1-9278-ad44ca4510bc\" (UID: \"cbc6b49c-9d80-40d1-9278-ad44ca4510bc\") "
Jul 26 18:12:27.442519 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.442478    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vhcv\" (UniqueName: \"kubernetes.io/projected/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-kube-api-access-9vhcv\") pod \"cbc6b49c-9d80-40d1-9278-ad44ca4510bc\" (UID: \"cbc6b49c-9d80-40d1-9278-ad44ca4510bc\") "
Jul 26 18:12:27.444460 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.444435    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cbc6b49c-9d80-40d1-9278-ad44ca4510bc" (UID: "cbc6b49c-9d80-40d1-9278-ad44ca4510bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:12:27.444584 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.444454    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-kube-api-access-9vhcv" (OuterVolumeSpecName: "kube-api-access-9vhcv") pod "cbc6b49c-9d80-40d1-9278-ad44ca4510bc" (UID: "cbc6b49c-9d80-40d1-9278-ad44ca4510bc"). InnerVolumeSpecName "kube-api-access-9vhcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:12:27.511276 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.511246    2548 generic.go:356] "Generic (PLEG): container finished" podID="cbc6b49c-9d80-40d1-9278-ad44ca4510bc" containerID="4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2" exitCode=0
Jul 26 18:12:27.511393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.511295    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c849f48d4-x6hvh"
Jul 26 18:12:27.511393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.511339    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c849f48d4-x6hvh" event={"ID":"cbc6b49c-9d80-40d1-9278-ad44ca4510bc","Type":"ContainerDied","Data":"4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2"}
Jul 26 18:12:27.511393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.511390    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c849f48d4-x6hvh" event={"ID":"cbc6b49c-9d80-40d1-9278-ad44ca4510bc","Type":"ContainerDied","Data":"3fde6540424ce0c0638ef95318d9e496ffaa0c7a7a8952632c8ca96615bb87d7"}
Jul 26 18:12:27.511555 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.511412    2548 scope.go:117] "RemoveContainer" containerID="4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2"
Jul 26 18:12:27.520531 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.520513    2548 scope.go:117] "RemoveContainer" containerID="4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2"
Jul 26 18:12:27.520761 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:12:27.520744    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2\": container with ID starting with 4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2 not found: ID does not exist" containerID="4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2"
Jul 26 18:12:27.520811 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.520772    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2"} err="failed to get container status \"4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2\": rpc error: code = NotFound desc = could not find container \"4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2\": container with ID starting with 4a974da64966e606f5de677a65768d9c54a355549d70c7954b370f299eb536a2 not found: ID does not exist"
Jul 26 18:12:27.531525 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.531505    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-x6hvh"]
Jul 26 18:12:27.535737 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.535716    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-x6hvh"]
Jul 26 18:12:27.543436 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.543418    2548 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-webhook-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:12:27.543490 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:27.543439    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vhcv\" (UniqueName: \"kubernetes.io/projected/cbc6b49c-9d80-40d1-9278-ad44ca4510bc-kube-api-access-9vhcv\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:12:28.297560 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.297527    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c849f48d4-hzlnm"]
Jul 26 18:12:28.297927 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.297914    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc6b49c-9d80-40d1-9278-ad44ca4510bc" containerName="manager"
Jul 26 18:12:28.297966 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.297928    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc6b49c-9d80-40d1-9278-ad44ca4510bc" containerName="manager"
Jul 26 18:12:28.298012 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.297992    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbc6b49c-9d80-40d1-9278-ad44ca4510bc" containerName="manager"
Jul 26 18:12:28.302173 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.302152    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c849f48d4-hzlnm"
Jul 26 18:12:28.304679 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.304656    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jq28c\""
Jul 26 18:12:28.304803 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.304655    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 26 18:12:28.305255 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.305240    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 26 18:12:28.310899 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.310874    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-hzlnm"]
Jul 26 18:12:28.349629 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.349604    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdgr6\" (UniqueName: \"kubernetes.io/projected/d91b056f-8e96-44b8-97b1-ad05ddc9ec0a-kube-api-access-kdgr6\") pod \"maas-controller-5c849f48d4-hzlnm\" (UID: \"d91b056f-8e96-44b8-97b1-ad05ddc9ec0a\") " pod="opendatahub/maas-controller-5c849f48d4-hzlnm"
Jul 26 18:12:28.349759 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.349649    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d91b056f-8e96-44b8-97b1-ad05ddc9ec0a-webhook-cert\") pod \"maas-controller-5c849f48d4-hzlnm\" (UID: \"d91b056f-8e96-44b8-97b1-ad05ddc9ec0a\") " pod="opendatahub/maas-controller-5c849f48d4-hzlnm"
Jul 26 18:12:28.450392 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.450358    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d91b056f-8e96-44b8-97b1-ad05ddc9ec0a-webhook-cert\") pod \"maas-controller-5c849f48d4-hzlnm\" (UID: \"d91b056f-8e96-44b8-97b1-ad05ddc9ec0a\") " pod="opendatahub/maas-controller-5c849f48d4-hzlnm"
Jul 26 18:12:28.450551 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.450472    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdgr6\" (UniqueName: \"kubernetes.io/projected/d91b056f-8e96-44b8-97b1-ad05ddc9ec0a-kube-api-access-kdgr6\") pod \"maas-controller-5c849f48d4-hzlnm\" (UID: \"d91b056f-8e96-44b8-97b1-ad05ddc9ec0a\") " pod="opendatahub/maas-controller-5c849f48d4-hzlnm"
Jul 26 18:12:28.452891 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.452873    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d91b056f-8e96-44b8-97b1-ad05ddc9ec0a-webhook-cert\") pod \"maas-controller-5c849f48d4-hzlnm\" (UID: \"d91b056f-8e96-44b8-97b1-ad05ddc9ec0a\") " pod="opendatahub/maas-controller-5c849f48d4-hzlnm"
Jul 26 18:12:28.464606 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.464577    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdgr6\" (UniqueName: \"kubernetes.io/projected/d91b056f-8e96-44b8-97b1-ad05ddc9ec0a-kube-api-access-kdgr6\") pod \"maas-controller-5c849f48d4-hzlnm\" (UID: \"d91b056f-8e96-44b8-97b1-ad05ddc9ec0a\") " pod="opendatahub/maas-controller-5c849f48d4-hzlnm"
Jul 26 18:12:28.612880 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.612856    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c849f48d4-hzlnm"
Jul 26 18:12:28.744228 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:28.744205    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c849f48d4-hzlnm"]
Jul 26 18:12:28.746148 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:12:28.746120    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91b056f_8e96_44b8_97b1_ad05ddc9ec0a.slice/crio-f28922f13ae508adf2f4ac69356ab2cfe4d3f4bd1f2b28c7cf45c111d7a54336 WatchSource:0}: Error finding container f28922f13ae508adf2f4ac69356ab2cfe4d3f4bd1f2b28c7cf45c111d7a54336: Status 404 returned error can't find the container with id f28922f13ae508adf2f4ac69356ab2cfe4d3f4bd1f2b28c7cf45c111d7a54336
Jul 26 18:12:29.413925 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:29.413827    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc6b49c-9d80-40d1-9278-ad44ca4510bc" path="/var/lib/kubelet/pods/cbc6b49c-9d80-40d1-9278-ad44ca4510bc/volumes"
Jul 26 18:12:29.523261 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:29.523221    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c849f48d4-hzlnm" event={"ID":"d91b056f-8e96-44b8-97b1-ad05ddc9ec0a","Type":"ContainerStarted","Data":"03552aaea777c667869b1843581d891906d96455916984b7c84744d65962d31b"}
Jul 26 18:12:29.523430 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:29.523283    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c849f48d4-hzlnm" event={"ID":"d91b056f-8e96-44b8-97b1-ad05ddc9ec0a","Type":"ContainerStarted","Data":"f28922f13ae508adf2f4ac69356ab2cfe4d3f4bd1f2b28c7cf45c111d7a54336"}
Jul 26 18:12:29.523430 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:29.523414    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c849f48d4-hzlnm"
Jul 26 18:12:29.547185 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:29.547129    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c849f48d4-hzlnm" podStartSLOduration=1.156845632 podStartE2EDuration="1.547116155s" totalImagesPullingTime="390.270523ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:12:29.546396711 +0000 UTC m=+906.646649600" watchObservedRunningTime="2026-07-26 18:12:29.547116155 +0000 UTC m=+906.647369041"
Jul 26 18:12:40.532758 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:12:40.532728    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c849f48d4-hzlnm"
Jul 26 18:15:00.139710 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:00.139671    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k"]
Jul 26 18:15:00.143365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:00.143345    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k"
Jul 26 18:15:00.145600 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:00.145579    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zbcqv\""
Jul 26 18:15:00.152859 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:00.152839    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k"
Jul 26 18:15:00.159323 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:00.159281    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k"]
Jul 26 18:15:00.294952 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:00.294930    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k"]
Jul 26 18:15:00.297693 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:15:00.297659    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6149eaf_5ae9_472a_b280_7380fc06825f.slice/crio-4df131b74d512790e9a5ca4226d143d29aad8e0c0b8a7eeca84cb8dac0229263 WatchSource:0}: Error finding container 4df131b74d512790e9a5ca4226d143d29aad8e0c0b8a7eeca84cb8dac0229263: Status 404 returned error can't find the container with id 4df131b74d512790e9a5ca4226d143d29aad8e0c0b8a7eeca84cb8dac0229263
Jul 26 18:15:00.299779 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:00.299761    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 18:15:01.254728 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:01.254695    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k" event={"ID":"d6149eaf-5ae9-472a-b280-7380fc06825f","Type":"ContainerStarted","Data":"4df131b74d512790e9a5ca4226d143d29aad8e0c0b8a7eeca84cb8dac0229263"}
Jul 26 18:15:03.267185 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:03.267097    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k" event={"ID":"d6149eaf-5ae9-472a-b280-7380fc06825f","Type":"ContainerStarted","Data":"10bce38bea9da35f433f40a2b2a4d724ef65318299e715246cb6f7d51da1e160"}
Jul 26 18:15:03.284819 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:03.284761    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k" podStartSLOduration=0.86563541 podStartE2EDuration="3.284742239s" totalImagesPullingTime="2.419106829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:15:03.282941402 +0000 UTC m=+1060.383194290" watchObservedRunningTime="2026-07-26 18:15:03.284742239 +0000 UTC m=+1060.384995124"
Jul 26 18:15:04.273603 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:04.273570    2548 generic.go:356] "Generic (PLEG): container finished" podID="d6149eaf-5ae9-472a-b280-7380fc06825f" containerID="10bce38bea9da35f433f40a2b2a4d724ef65318299e715246cb6f7d51da1e160" exitCode=0
Jul 26 18:15:04.273999 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:04.273659    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k" event={"ID":"d6149eaf-5ae9-472a-b280-7380fc06825f","Type":"ContainerDied","Data":"10bce38bea9da35f433f40a2b2a4d724ef65318299e715246cb6f7d51da1e160"}
Jul 26 18:15:05.415865 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:05.415838    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k"
Jul 26 18:15:06.288886 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:06.288845    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k"
Jul 26 18:15:06.288886 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:06.288846    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29751495-dqh4k" event={"ID":"d6149eaf-5ae9-472a-b280-7380fc06825f","Type":"ContainerDied","Data":"4df131b74d512790e9a5ca4226d143d29aad8e0c0b8a7eeca84cb8dac0229263"}
Jul 26 18:15:06.289115 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:15:06.288975    2548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4df131b74d512790e9a5ca4226d143d29aad8e0c0b8a7eeca84cb8dac0229263"
Jul 26 18:17:11.614163 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:11.614121    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"]
Jul 26 18:17:11.614813 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:11.614379    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4" podUID="15e22737-8fc0-4cc5-9697-6a0a5e67f7e9" containerName="manager" containerID="cri-o://d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c" gracePeriod=10
Jul 26 18:17:15.664949 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.664920    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:17:15.770328 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.770299    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-extensions-socket-volume\") pod \"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9\" (UID: \"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9\") "
Jul 26 18:17:15.770488 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.770343    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2vgn\" (UniqueName: \"kubernetes.io/projected/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-kube-api-access-m2vgn\") pod \"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9\" (UID: \"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9\") "
Jul 26 18:17:15.770661 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.770637    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "15e22737-8fc0-4cc5-9697-6a0a5e67f7e9" (UID: "15e22737-8fc0-4cc5-9697-6a0a5e67f7e9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:17:15.772301 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.772267    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-kube-api-access-m2vgn" (OuterVolumeSpecName: "kube-api-access-m2vgn") pod "15e22737-8fc0-4cc5-9697-6a0a5e67f7e9" (UID: "15e22737-8fc0-4cc5-9697-6a0a5e67f7e9"). InnerVolumeSpecName "kube-api-access-m2vgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:17:15.871257 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.871229    2548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-extensions-socket-volume\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:17:15.871257 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.871252    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2vgn\" (UniqueName: \"kubernetes.io/projected/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9-kube-api-access-m2vgn\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:17:15.919740 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.919714    2548 generic.go:356] "Generic (PLEG): container finished" podID="15e22737-8fc0-4cc5-9697-6a0a5e67f7e9" containerID="d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c" exitCode=0
Jul 26 18:17:15.919874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.919754    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"
Jul 26 18:17:15.919874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.919792    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4" event={"ID":"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9","Type":"ContainerDied","Data":"d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c"}
Jul 26 18:17:15.919874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.919846    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4" event={"ID":"15e22737-8fc0-4cc5-9697-6a0a5e67f7e9","Type":"ContainerDied","Data":"ce6ba0131fb216fc1ba9dbc2401cb0fc8536e5e7613374fe7e7591911ae37079"}
Jul 26 18:17:15.919874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.919867    2548 scope.go:117] "RemoveContainer" containerID="d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c"
Jul 26 18:17:15.929515 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.929499    2548 scope.go:117] "RemoveContainer" containerID="d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c"
Jul 26 18:17:15.929757 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:17:15.929741    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c\": container with ID starting with d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c not found: ID does not exist" containerID="d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c"
Jul 26 18:17:15.929818 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.929769    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c"} err="failed to get container status \"d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c\": rpc error: code = NotFound desc = could not find container \"d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c\": container with ID starting with d61606fc8739fcf637fca28452118833c53c3b5e1dc57aae7e0ba2db84bc4b9c not found: ID does not exist"
Jul 26 18:17:15.941745 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.941714    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"]
Jul 26 18:17:15.945875 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:15.945855    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flgf4"]
Jul 26 18:17:17.414386 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:17:17.414355    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e22737-8fc0-4cc5-9697-6a0a5e67f7e9" path="/var/lib/kubelet/pods/15e22737-8fc0-4cc5-9697-6a0a5e67f7e9/volumes"
Jul 26 18:18:12.769365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.769331    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"]
Jul 26 18:18:12.769853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.769709    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e22737-8fc0-4cc5-9697-6a0a5e67f7e9" containerName="manager"
Jul 26 18:18:12.769853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.769720    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e22737-8fc0-4cc5-9697-6a0a5e67f7e9" containerName="manager"
Jul 26 18:18:12.769853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.769730    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6149eaf-5ae9-472a-b280-7380fc06825f" containerName="cleanup"
Jul 26 18:18:12.769853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.769736    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6149eaf-5ae9-472a-b280-7380fc06825f" containerName="cleanup"
Jul 26 18:18:12.769853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.769790    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e22737-8fc0-4cc5-9697-6a0a5e67f7e9" containerName="manager"
Jul 26 18:18:12.769853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.769801    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6149eaf-5ae9-472a-b280-7380fc06825f" containerName="cleanup"
Jul 26 18:18:12.772836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.772819    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"
Jul 26 18:18:12.777400 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.777378    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t2d9w\""
Jul 26 18:18:12.786849 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.786824    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"]
Jul 26 18:18:12.864857 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.864823    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhm65\" (UniqueName: \"kubernetes.io/projected/6be951ec-b464-4210-886f-5c90ac7f0e24-kube-api-access-fhm65\") pod \"kuadrant-operator-controller-manager-86878c769f-sgbz9\" (UID: \"6be951ec-b464-4210-886f-5c90ac7f0e24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"
Jul 26 18:18:12.865019 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.864887    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6be951ec-b464-4210-886f-5c90ac7f0e24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sgbz9\" (UID: \"6be951ec-b464-4210-886f-5c90ac7f0e24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"
Jul 26 18:18:12.966044 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.966009    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6be951ec-b464-4210-886f-5c90ac7f0e24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sgbz9\" (UID: \"6be951ec-b464-4210-886f-5c90ac7f0e24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"
Jul 26 18:18:12.966259 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.966121    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhm65\" (UniqueName: \"kubernetes.io/projected/6be951ec-b464-4210-886f-5c90ac7f0e24-kube-api-access-fhm65\") pod \"kuadrant-operator-controller-manager-86878c769f-sgbz9\" (UID: \"6be951ec-b464-4210-886f-5c90ac7f0e24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"
Jul 26 18:18:12.966390 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.966371    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6be951ec-b464-4210-886f-5c90ac7f0e24-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sgbz9\" (UID: \"6be951ec-b464-4210-886f-5c90ac7f0e24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"
Jul 26 18:18:12.975178 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:12.975150    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhm65\" (UniqueName: \"kubernetes.io/projected/6be951ec-b464-4210-886f-5c90ac7f0e24-kube-api-access-fhm65\") pod \"kuadrant-operator-controller-manager-86878c769f-sgbz9\" (UID: \"6be951ec-b464-4210-886f-5c90ac7f0e24\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"
Jul 26 18:18:13.083969 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:13.083875    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"
Jul 26 18:18:13.232075 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:13.232017    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"]
Jul 26 18:18:13.234890 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:18:13.234861    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be951ec_b464_4210_886f_5c90ac7f0e24.slice/crio-b5f230b022f64c772384332c0c9a1f226db04b461244f38aab694dfc3f14614a WatchSource:0}: Error finding container b5f230b022f64c772384332c0c9a1f226db04b461244f38aab694dfc3f14614a: Status 404 returned error can't find the container with id b5f230b022f64c772384332c0c9a1f226db04b461244f38aab694dfc3f14614a
Jul 26 18:18:14.200209 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:14.200162    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9" event={"ID":"6be951ec-b464-4210-886f-5c90ac7f0e24","Type":"ContainerStarted","Data":"324b5cbedbe4ffe66fe14630f77e1ab6450b5824a43ba0d328f362c76bbbee40"}
Jul 26 18:18:14.200603 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:14.200274    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9" event={"ID":"6be951ec-b464-4210-886f-5c90ac7f0e24","Type":"ContainerStarted","Data":"b5f230b022f64c772384332c0c9a1f226db04b461244f38aab694dfc3f14614a"}
Jul 26 18:18:14.200603 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:14.200302    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"
Jul 26 18:18:14.223236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:14.223173    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9" podStartSLOduration=2.223157353 podStartE2EDuration="2.223157353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:18:14.222022484 +0000 UTC m=+1251.322275370" watchObservedRunningTime="2026-07-26 18:18:14.223157353 +0000 UTC m=+1251.323410239"
Jul 26 18:18:25.208596 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:18:25.208563    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sgbz9"
Jul 26 18:21:06.628275 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.628244    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"]
Jul 26 18:21:06.631902 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.631883    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.634414 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.634391    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-fea2be60-kserve-self-signed-certs\""
Jul 26 18:21:06.641185 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.641161    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"]
Jul 26 18:21:06.685187 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.685161    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tls-certs\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.685318 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.685204    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-dshm\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.685318 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.685270    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-model-cache\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.685413 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.685335    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-home\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.685413 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.685355    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxpz2\" (UniqueName: \"kubernetes.io/projected/21bbb362-78ed-4c66-9f86-5c35a804f1bc-kube-api-access-jxpz2\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.685413 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.685402    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tmp-dir\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.786047 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.786018    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tls-certs\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.786047 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.786052    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-dshm\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.786276 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.786077    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-model-cache\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.786276 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.786113    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-home\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.786276 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.786253    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxpz2\" (UniqueName: \"kubernetes.io/projected/21bbb362-78ed-4c66-9f86-5c35a804f1bc-kube-api-access-jxpz2\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.786438 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.786302    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tmp-dir\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.786538 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.786518    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-home\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.786611 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.786570    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-model-cache\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.786668 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.786636    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tmp-dir\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.788360 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.788341    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-dshm\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.788558 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.788540    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tls-certs\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.795031 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.795010    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxpz2\" (UniqueName: \"kubernetes.io/projected/21bbb362-78ed-4c66-9f86-5c35a804f1bc-kube-api-access-jxpz2\") pod \"e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") " pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:06.941572 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:06.941487    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:07.080427 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:07.080399    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"]
Jul 26 18:21:07.082277 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:21:07.082238    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21bbb362_78ed_4c66_9f86_5c35a804f1bc.slice/crio-006867b99652815cd0f89998babcdba82bd4ae382e2d8730b5c910eadd8eb87b WatchSource:0}: Error finding container 006867b99652815cd0f89998babcdba82bd4ae382e2d8730b5c910eadd8eb87b: Status 404 returned error can't find the container with id 006867b99652815cd0f89998babcdba82bd4ae382e2d8730b5c910eadd8eb87b
Jul 26 18:21:08.020817 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:08.020781    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5" event={"ID":"21bbb362-78ed-4c66-9f86-5c35a804f1bc","Type":"ContainerStarted","Data":"d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085"}
Jul 26 18:21:08.020817 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:08.020820    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5" event={"ID":"21bbb362-78ed-4c66-9f86-5c35a804f1bc","Type":"ContainerStarted","Data":"006867b99652815cd0f89998babcdba82bd4ae382e2d8730b5c910eadd8eb87b"}
Jul 26 18:21:08.039428 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:08.039382    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5" podStartSLOduration=2.039367039 podStartE2EDuration="2.039367039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:21:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:21:08.038072292 +0000 UTC m=+1425.138325177" watchObservedRunningTime="2026-07-26 18:21:08.039367039 +0000 UTC m=+1425.139620032"
Jul 26 18:21:16.942180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:16.942104    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:16.942180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:16.942145    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:16.954440 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:16.954418    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:17.075408 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:17.075375    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:21:45.952063 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:21:45.952017    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"]
Jul 26 18:22:00.972368 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:00.972301    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5" podUID="21bbb362-78ed-4c66-9f86-5c35a804f1bc" containerName="main" containerID="cri-o://d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085" gracePeriod=45
Jul 26 18:22:01.220931 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.220901    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:22:01.271701 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.271602    2548 generic.go:356] "Generic (PLEG): container finished" podID="21bbb362-78ed-4c66-9f86-5c35a804f1bc" containerID="d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085" exitCode=0
Jul 26 18:22:01.271701 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.271649    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"
Jul 26 18:22:01.271701 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.271659    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5" event={"ID":"21bbb362-78ed-4c66-9f86-5c35a804f1bc","Type":"ContainerDied","Data":"d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085"}
Jul 26 18:22:01.271701 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.271700    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5" event={"ID":"21bbb362-78ed-4c66-9f86-5c35a804f1bc","Type":"ContainerDied","Data":"006867b99652815cd0f89998babcdba82bd4ae382e2d8730b5c910eadd8eb87b"}
Jul 26 18:22:01.272017 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.271722    2548 scope.go:117] "RemoveContainer" containerID="d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085"
Jul 26 18:22:01.280326 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.280305    2548 scope.go:117] "RemoveContainer" containerID="d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085"
Jul 26 18:22:01.280601 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:22:01.280578    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085\": container with ID starting with d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085 not found: ID does not exist" containerID="d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085"
Jul 26 18:22:01.280649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.280613    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085"} err="failed to get container status \"d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085\": rpc error: code = NotFound desc = could not find container \"d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085\": container with ID starting with d1bff24bcae3f2b6e6b8ab1ad111a32ca46cb76710757feccc382c987cfbc085 not found: ID does not exist"
Jul 26 18:22:01.282914 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.282897    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-dshm\") pod \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") "
Jul 26 18:22:01.282964 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.282922    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-home\") pod \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") "
Jul 26 18:22:01.282964 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.282952    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-model-cache\") pod \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") "
Jul 26 18:22:01.283030 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.282979    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tls-certs\") pod \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") "
Jul 26 18:22:01.283030 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.282997    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tmp-dir\") pod \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") "
Jul 26 18:22:01.283109 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.283067    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxpz2\" (UniqueName: \"kubernetes.io/projected/21bbb362-78ed-4c66-9f86-5c35a804f1bc-kube-api-access-jxpz2\") pod \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\" (UID: \"21bbb362-78ed-4c66-9f86-5c35a804f1bc\") "
Jul 26 18:22:01.283227 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.283185    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-home" (OuterVolumeSpecName: "home") pod "21bbb362-78ed-4c66-9f86-5c35a804f1bc" (UID: "21bbb362-78ed-4c66-9f86-5c35a804f1bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:22:01.283283 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.283239    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-model-cache" (OuterVolumeSpecName: "model-cache") pod "21bbb362-78ed-4c66-9f86-5c35a804f1bc" (UID: "21bbb362-78ed-4c66-9f86-5c35a804f1bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:22:01.283330 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.283290    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "21bbb362-78ed-4c66-9f86-5c35a804f1bc" (UID: "21bbb362-78ed-4c66-9f86-5c35a804f1bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:22:01.283419 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.283401    2548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-home\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:22:01.283457 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.283419    2548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-model-cache\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:22:01.283457 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.283435    2548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tmp-dir\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:22:01.285089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.285066    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-dshm" (OuterVolumeSpecName: "dshm") pod "21bbb362-78ed-4c66-9f86-5c35a804f1bc" (UID: "21bbb362-78ed-4c66-9f86-5c35a804f1bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:22:01.285234 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.285128    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "21bbb362-78ed-4c66-9f86-5c35a804f1bc" (UID: "21bbb362-78ed-4c66-9f86-5c35a804f1bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:22:01.285234 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.285165    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21bbb362-78ed-4c66-9f86-5c35a804f1bc-kube-api-access-jxpz2" (OuterVolumeSpecName: "kube-api-access-jxpz2") pod "21bbb362-78ed-4c66-9f86-5c35a804f1bc" (UID: "21bbb362-78ed-4c66-9f86-5c35a804f1bc"). InnerVolumeSpecName "kube-api-access-jxpz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:22:01.384252 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.384186    2548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21bbb362-78ed-4c66-9f86-5c35a804f1bc-tls-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:22:01.384252 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.384251    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxpz2\" (UniqueName: \"kubernetes.io/projected/21bbb362-78ed-4c66-9f86-5c35a804f1bc-kube-api-access-jxpz2\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:22:01.384448 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.384262    2548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21bbb362-78ed-4c66-9f86-5c35a804f1bc-dshm\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:22:01.588662 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.588572    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"]
Jul 26 18:22:01.592649 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:01.592622    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-fea2be60-kserve-6dd9b8b49f-dgtf5"]
Jul 26 18:22:03.416871 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:22:03.416835    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21bbb362-78ed-4c66-9f86-5c35a804f1bc" path="/var/lib/kubelet/pods/21bbb362-78ed-4c66-9f86-5c35a804f1bc/volumes"
Jul 26 18:25:27.970637 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:27.970596    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"]
Jul 26 18:25:27.973065 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:27.971167    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21bbb362-78ed-4c66-9f86-5c35a804f1bc" containerName="main"
Jul 26 18:25:27.973065 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:27.971180    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="21bbb362-78ed-4c66-9f86-5c35a804f1bc" containerName="main"
Jul 26 18:25:27.973065 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:27.971292    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="21bbb362-78ed-4c66-9f86-5c35a804f1bc" containerName="main"
Jul 26 18:25:27.974643 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:27.974626    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:27.977841 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:27.977819    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c1daa682-openshift-default-dockercfg-6dshn\""
Jul 26 18:25:28.043834 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.043807    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"]
Jul 26 18:25:28.109180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.107354    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-podinfo\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.109180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.107434    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-certs\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.109180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.107497    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-data\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.109180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.107545    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-token\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.109180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.107635    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-envoy\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.109180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.107681    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/458f63f5-5e95-4836-93aa-92d3526ccca8-istiod-ca-cert\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.109180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.107713    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zw2z\" (UniqueName: \"kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-kube-api-access-5zw2z\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.109180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.107777    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-socket\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.109180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.107802    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-credential-socket\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209052 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209007    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-data\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209052 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209057    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-token\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209118    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-envoy\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209151    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/458f63f5-5e95-4836-93aa-92d3526ccca8-istiod-ca-cert\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209178    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zw2z\" (UniqueName: \"kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-kube-api-access-5zw2z\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209261    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-socket\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209284    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-credential-socket\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209312    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-podinfo\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209342    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-certs\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209829    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-credential-socket\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.209925 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.209849    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-socket\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.210035 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.210001    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-certs\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.210091 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.210040    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/458f63f5-5e95-4836-93aa-92d3526ccca8-istiod-ca-cert\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.210091 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.210040    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-data\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.211625 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.211598    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-envoy\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.211815 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.211797    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-podinfo\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.220534 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.220509    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-token\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.221261 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.221206    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zw2z\" (UniqueName: \"kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-kube-api-access-5zw2z\") pod \"e2e-ait-c1daa682-openshift-default-f996fb48-s4c55\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") " pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.285834 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.285723    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:28.434645 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.434615    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"]
Jul 26 18:25:28.436272 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:25:28.436246    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458f63f5_5e95_4836_93aa_92d3526ccca8.slice/crio-9937de7aa331bd758ce087c5f0ffc6efb71a23c8bb2dfc39b5c0f4ab740d336b WatchSource:0}: Error finding container 9937de7aa331bd758ce087c5f0ffc6efb71a23c8bb2dfc39b5c0f4ab740d336b: Status 404 returned error can't find the container with id 9937de7aa331bd758ce087c5f0ffc6efb71a23c8bb2dfc39b5c0f4ab740d336b
Jul 26 18:25:28.438530 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.438500    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:25:28.438637 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.438564    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:25:28.438637 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:28.438599    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:25:29.279422 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:29.279388    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" event={"ID":"458f63f5-5e95-4836-93aa-92d3526ccca8","Type":"ContainerStarted","Data":"1c1b097ddba46fdf2052b978dde4444e6f943c2287d5b522f975be20178639bf"}
Jul 26 18:25:29.279804 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:29.279449    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" event={"ID":"458f63f5-5e95-4836-93aa-92d3526ccca8","Type":"ContainerStarted","Data":"9937de7aa331bd758ce087c5f0ffc6efb71a23c8bb2dfc39b5c0f4ab740d336b"}
Jul 26 18:25:29.286883 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:29.286859    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:29.292024 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:29.291998    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:29.303088 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:29.303044    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" podStartSLOduration=2.303030278 podStartE2EDuration="2.303030278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:25:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:25:29.301694618 +0000 UTC m=+1686.401947504" watchObservedRunningTime="2026-07-26 18:25:29.303030278 +0000 UTC m=+1686.403283238"
Jul 26 18:25:30.284623 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.284591    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:30.285648 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.285624    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:30.718807 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.718287    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"]
Jul 26 18:25:30.722617 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.722596    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:30.725776 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.725753    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-c1daa682-serving-cert\""
Jul 26 18:25:30.734387 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.734364    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"]
Jul 26 18:25:30.837032 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.836994    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw5q2\" (UniqueName: \"kubernetes.io/projected/d7976a66-d60e-4a8e-be81-ac885acd97fd-kube-api-access-zw5q2\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:30.837350 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.837320    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:30.837647 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.837626    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7976a66-d60e-4a8e-be81-ac885acd97fd-openshift-service-ca\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:30.938467 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.938440    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw5q2\" (UniqueName: \"kubernetes.io/projected/d7976a66-d60e-4a8e-be81-ac885acd97fd-kube-api-access-zw5q2\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:30.938654 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.938482    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:30.938654 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.938524    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7976a66-d60e-4a8e-be81-ac885acd97fd-openshift-service-ca\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:30.938780 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:25:30.938663    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-serving-cert: secret "maas-api-e2e-ait-c1daa682-serving-cert" not found
Jul 26 18:25:30.938780 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:25:30.938733    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls podName:d7976a66-d60e-4a8e-be81-ac885acd97fd nodeName:}" failed. No retries permitted until 2026-07-26 18:25:31.438711888 +0000 UTC m=+1688.538964755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls") pod "maas-api-e2e-ait-c1daa682-cb6794874-vzqcp" (UID: "d7976a66-d60e-4a8e-be81-ac885acd97fd") : secret "maas-api-e2e-ait-c1daa682-serving-cert" not found
Jul 26 18:25:30.939144 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.939125    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7976a66-d60e-4a8e-be81-ac885acd97fd-openshift-service-ca\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:30.967886 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:30.967858    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw5q2\" (UniqueName: \"kubernetes.io/projected/d7976a66-d60e-4a8e-be81-ac885acd97fd-kube-api-access-zw5q2\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:31.444030 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.444000    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:31.444497 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:25:31.444136    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-serving-cert: secret "maas-api-e2e-ait-c1daa682-serving-cert" not found
Jul 26 18:25:31.444497 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:25:31.444222    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls podName:d7976a66-d60e-4a8e-be81-ac885acd97fd nodeName:}" failed. No retries permitted until 2026-07-26 18:25:32.444182628 +0000 UTC m=+1689.544435493 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls") pod "maas-api-e2e-ait-c1daa682-cb6794874-vzqcp" (UID: "d7976a66-d60e-4a8e-be81-ac885acd97fd") : secret "maas-api-e2e-ait-c1daa682-serving-cert" not found
Jul 26 18:25:31.576381 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.576321    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"]
Jul 26 18:25:31.580154 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.580131    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:25:31.584642 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.584613    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-c1daa682-dockercfg-2c2wq\""
Jul 26 18:25:31.584881 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.584864    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-c1daa682\""
Jul 26 18:25:31.595165 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.595136    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"]
Jul 26 18:25:31.610100 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.610048    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"]
Jul 26 18:25:31.614561 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.614536    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:25:31.630331 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.630302    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"]
Jul 26 18:25:31.645708 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.645675    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnmw9\" (UniqueName: \"kubernetes.io/projected/2e089ca1-e1ac-40be-862d-226a03cf9e25-kube-api-access-dnmw9\") pod \"payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67\" (UID: \"2e089ca1-e1ac-40be-862d-226a03cf9e25\") " pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:25:31.645853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.645828    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e089ca1-e1ac-40be-862d-226a03cf9e25-plugins-config-volume\") pod \"payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67\" (UID: \"2e089ca1-e1ac-40be-862d-226a03cf9e25\") " pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:25:31.747279 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.747162    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w\" (UID: \"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:25:31.747279 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.747239    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e089ca1-e1ac-40be-862d-226a03cf9e25-plugins-config-volume\") pod \"payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67\" (UID: \"2e089ca1-e1ac-40be-862d-226a03cf9e25\") " pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:25:31.747511 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.747325    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vrbl\" (UniqueName: \"kubernetes.io/projected/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-kube-api-access-6vrbl\") pod \"payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w\" (UID: \"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:25:31.747511 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.747404    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnmw9\" (UniqueName: \"kubernetes.io/projected/2e089ca1-e1ac-40be-862d-226a03cf9e25-kube-api-access-dnmw9\") pod \"payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67\" (UID: \"2e089ca1-e1ac-40be-862d-226a03cf9e25\") " pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:25:31.748100 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.748075    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e089ca1-e1ac-40be-862d-226a03cf9e25-plugins-config-volume\") pod \"payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67\" (UID: \"2e089ca1-e1ac-40be-862d-226a03cf9e25\") " pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:25:31.757418 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.757393    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnmw9\" (UniqueName: \"kubernetes.io/projected/2e089ca1-e1ac-40be-862d-226a03cf9e25-kube-api-access-dnmw9\") pod \"payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67\" (UID: \"2e089ca1-e1ac-40be-862d-226a03cf9e25\") " pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:25:31.848266 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.848232    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vrbl\" (UniqueName: \"kubernetes.io/projected/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-kube-api-access-6vrbl\") pod \"payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w\" (UID: \"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:25:31.848415 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.848363    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w\" (UID: \"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:25:31.848992 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.848974    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w\" (UID: \"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:25:31.858067 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.858035    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vrbl\" (UniqueName: \"kubernetes.io/projected/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-kube-api-access-6vrbl\") pod \"payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w\" (UID: \"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:25:31.890900 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.890875    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:25:31.932187 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:31.932162    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:25:32.046508 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.046474    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"]
Jul 26 18:25:32.048529 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:25:32.048498    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e089ca1_e1ac_40be_862d_226a03cf9e25.slice/crio-5d572c9ef8d6f961650950b05a0a47fa6e05d8f9595fb883470e444789801fbe WatchSource:0}: Error finding container 5d572c9ef8d6f961650950b05a0a47fa6e05d8f9595fb883470e444789801fbe: Status 404 returned error can't find the container with id 5d572c9ef8d6f961650950b05a0a47fa6e05d8f9595fb883470e444789801fbe
Jul 26 18:25:32.294609 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.294583    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"]
Jul 26 18:25:32.296981 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.296947    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67" event={"ID":"2e089ca1-e1ac-40be-862d-226a03cf9e25","Type":"ContainerStarted","Data":"19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea"}
Jul 26 18:25:32.297117 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.297005    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67" event={"ID":"2e089ca1-e1ac-40be-862d-226a03cf9e25","Type":"ContainerStarted","Data":"5d572c9ef8d6f961650950b05a0a47fa6e05d8f9595fb883470e444789801fbe"}
Jul 26 18:25:32.297117 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:25:32.297071    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea8f3071_e84b_4cb9_9bf2_0b3038b848b5.slice/crio-0a3de2149915bc4813a5cfae96407b95b3e41000c578b405a269c3ed8c6df6f3 WatchSource:0}: Error finding container 0a3de2149915bc4813a5cfae96407b95b3e41000c578b405a269c3ed8c6df6f3: Status 404 returned error can't find the container with id 0a3de2149915bc4813a5cfae96407b95b3e41000c578b405a269c3ed8c6df6f3
Jul 26 18:25:32.297265 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.297168    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:25:32.313000 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.312956    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67" podStartSLOduration=1.3129411819999999 podStartE2EDuration="1.312941182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:25:32.312647354 +0000 UTC m=+1689.412900264" watchObservedRunningTime="2026-07-26 18:25:32.312941182 +0000 UTC m=+1689.413194068"
Jul 26 18:25:32.455290 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.455250    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:32.457977 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.457939    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls\") pod \"maas-api-e2e-ait-c1daa682-cb6794874-vzqcp\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:32.536619 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.536587    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:32.683938 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.683889    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"]
Jul 26 18:25:32.684065 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:25:32.683943    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7976a66_d60e_4a8e_be81_ac885acd97fd.slice/crio-a93be618ef2d84a1dbae5e8991b3436a97e7e5644817023936ddcc8ef4ae71ec WatchSource:0}: Error finding container a93be618ef2d84a1dbae5e8991b3436a97e7e5644817023936ddcc8ef4ae71ec: Status 404 returned error can't find the container with id a93be618ef2d84a1dbae5e8991b3436a97e7e5644817023936ddcc8ef4ae71ec
Jul 26 18:25:32.685562 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:32.685541    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 18:25:33.304137 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:33.304104    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w" event={"ID":"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5","Type":"ContainerStarted","Data":"6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee"}
Jul 26 18:25:33.304346 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:33.304169    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w" event={"ID":"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5","Type":"ContainerStarted","Data":"0a3de2149915bc4813a5cfae96407b95b3e41000c578b405a269c3ed8c6df6f3"}
Jul 26 18:25:33.304346 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:33.304282    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:25:33.305752 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:33.305726    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp" event={"ID":"d7976a66-d60e-4a8e-be81-ac885acd97fd","Type":"ContainerStarted","Data":"e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f"}
Jul 26 18:25:33.305858 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:33.305771    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp" event={"ID":"d7976a66-d60e-4a8e-be81-ac885acd97fd","Type":"ContainerStarted","Data":"a93be618ef2d84a1dbae5e8991b3436a97e7e5644817023936ddcc8ef4ae71ec"}
Jul 26 18:25:33.305963 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:33.305947    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:33.322003 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:33.321956    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w" podStartSLOduration=2.321942263 podStartE2EDuration="2.321942263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:25:33.319766224 +0000 UTC m=+1690.420019109" watchObservedRunningTime="2026-07-26 18:25:33.321942263 +0000 UTC m=+1690.422195149"
Jul 26 18:25:33.337267 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:33.337220    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp" podStartSLOduration=2.846754202 podStartE2EDuration="3.337205678s" totalImagesPullingTime="490.451476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:25:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:25:33.335588393 +0000 UTC m=+1690.435841291" watchObservedRunningTime="2026-07-26 18:25:33.337205678 +0000 UTC m=+1690.437458555"
Jul 26 18:25:39.316381 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:39.316353    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:25:43.307886 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:43.307848    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:25:44.314433 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:44.314398    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:25:45.782590 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:45.781332    2548 patch_prober.go:28] interesting pod/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": read tcp 10.133.0.2:36024->10.133.0.45:15021: read: connection reset by peer" start-of-body=
Jul 26 18:25:45.782590 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:45.781425    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": read tcp 10.133.0.2:36024->10.133.0.45:15021: read: connection reset by peer"
Jul 26 18:25:46.379652 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:46.379614    2548 generic.go:356] "Generic (PLEG): container finished" podID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerID="1c1b097ddba46fdf2052b978dde4444e6f943c2287d5b522f975be20178639bf" exitCode=0
Jul 26 18:25:46.379868 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:46.379692    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" event={"ID":"458f63f5-5e95-4836-93aa-92d3526ccca8","Type":"ContainerDied","Data":"1c1b097ddba46fdf2052b978dde4444e6f943c2287d5b522f975be20178639bf"}
Jul 26 18:25:46.380170 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:46.380152    2548 scope.go:117] "RemoveContainer" containerID="1c1b097ddba46fdf2052b978dde4444e6f943c2287d5b522f975be20178639bf"
Jul 26 18:25:46.381218 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:46.381176    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:25:46.381306 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:46.381255    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:25:46.381306 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:46.381288    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:25:47.389572 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:47.389532    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" event={"ID":"458f63f5-5e95-4836-93aa-92d3526ccca8","Type":"ContainerStarted","Data":"34c8a699821881586be2c579633c5b9d317eeb665428e687f8460e39ca0a439d"}
Jul 26 18:25:48.286024 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:48.285973    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:48.286311 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:48.286284    2548 patch_prober.go:28] interesting pod/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 26 18:25:48.286381 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:48.286339    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 26 18:25:49.286930 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:49.286890    2548 patch_prober.go:28] interesting pod/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 26 18:25:49.287367 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:49.286951    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 26 18:25:50.286563 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:50.286524    2548 patch_prober.go:28] interesting pod/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 26 18:25:50.286768 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:50.286583    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 26 18:25:51.286971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:51.286929    2548 patch_prober.go:28] interesting pod/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Jul 26 18:25:51.287396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:51.286990    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Jul 26 18:25:52.290282 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:52.290251    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:52.290668 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:52.290503    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:25:52.291343 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:25:52.291323    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:26:06.550218 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:06.550160    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"]
Jul 26 18:26:06.550824 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:06.550446    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp" podUID="d7976a66-d60e-4a8e-be81-ac885acd97fd" containerName="maas-api" containerID="cri-o://e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f" gracePeriod=30
Jul 26 18:26:06.612384 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:06.612347    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"]
Jul 26 18:26:06.612903 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:06.612843    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67" podUID="2e089ca1-e1ac-40be-862d-226a03cf9e25" containerName="payload-processing" containerID="cri-o://19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea" gracePeriod=30
Jul 26 18:26:06.617428 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:06.617268    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"]
Jul 26 18:26:06.617548 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:06.617491    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w" podUID="ea8f3071-e84b-4cb9-9bf2-0b3038b848b5" containerName="payload-pre-processing" containerID="cri-o://6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee" gracePeriod=30
Jul 26 18:26:06.882237 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:06.882173    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:26:06.938861 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:06.938835    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:26:06.941728 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:06.941708    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:26:07.010802 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.010769    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7976a66-d60e-4a8e-be81-ac885acd97fd-openshift-service-ca\") pod \"d7976a66-d60e-4a8e-be81-ac885acd97fd\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") "
Jul 26 18:26:07.011001 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.010843    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls\") pod \"d7976a66-d60e-4a8e-be81-ac885acd97fd\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") "
Jul 26 18:26:07.011001 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.010877    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vrbl\" (UniqueName: \"kubernetes.io/projected/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-kube-api-access-6vrbl\") pod \"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5\" (UID: \"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5\") "
Jul 26 18:26:07.011001 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.010918    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw5q2\" (UniqueName: \"kubernetes.io/projected/d7976a66-d60e-4a8e-be81-ac885acd97fd-kube-api-access-zw5q2\") pod \"d7976a66-d60e-4a8e-be81-ac885acd97fd\" (UID: \"d7976a66-d60e-4a8e-be81-ac885acd97fd\") "
Jul 26 18:26:07.011001 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.010963    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-plugins-config-volume\") pod \"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5\" (UID: \"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5\") "
Jul 26 18:26:07.011298 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.011021    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnmw9\" (UniqueName: \"kubernetes.io/projected/2e089ca1-e1ac-40be-862d-226a03cf9e25-kube-api-access-dnmw9\") pod \"2e089ca1-e1ac-40be-862d-226a03cf9e25\" (UID: \"2e089ca1-e1ac-40be-862d-226a03cf9e25\") "
Jul 26 18:26:07.011298 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.011061    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e089ca1-e1ac-40be-862d-226a03cf9e25-plugins-config-volume\") pod \"2e089ca1-e1ac-40be-862d-226a03cf9e25\" (UID: \"2e089ca1-e1ac-40be-862d-226a03cf9e25\") "
Jul 26 18:26:07.011402 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.011324    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7976a66-d60e-4a8e-be81-ac885acd97fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d7976a66-d60e-4a8e-be81-ac885acd97fd" (UID: "d7976a66-d60e-4a8e-be81-ac885acd97fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:26:07.011537 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.011505    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea8f3071-e84b-4cb9-9bf2-0b3038b848b5" (UID: "ea8f3071-e84b-4cb9-9bf2-0b3038b848b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:26:07.011610 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.011553    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e089ca1-e1ac-40be-862d-226a03cf9e25-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e089ca1-e1ac-40be-862d-226a03cf9e25" (UID: "2e089ca1-e1ac-40be-862d-226a03cf9e25"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:26:07.011724 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.011650    2548 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-plugins-config-volume\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:07.011724 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.011671    2548 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e089ca1-e1ac-40be-862d-226a03cf9e25-plugins-config-volume\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:07.011724 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.011685    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7976a66-d60e-4a8e-be81-ac885acd97fd-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:07.013234 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.013185    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d7976a66-d60e-4a8e-be81-ac885acd97fd" (UID: "d7976a66-d60e-4a8e-be81-ac885acd97fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:26:07.013333 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.013277    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-kube-api-access-6vrbl" (OuterVolumeSpecName: "kube-api-access-6vrbl") pod "ea8f3071-e84b-4cb9-9bf2-0b3038b848b5" (UID: "ea8f3071-e84b-4cb9-9bf2-0b3038b848b5"). InnerVolumeSpecName "kube-api-access-6vrbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:26:07.013464 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.013446    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7976a66-d60e-4a8e-be81-ac885acd97fd-kube-api-access-zw5q2" (OuterVolumeSpecName: "kube-api-access-zw5q2") pod "d7976a66-d60e-4a8e-be81-ac885acd97fd" (UID: "d7976a66-d60e-4a8e-be81-ac885acd97fd"). InnerVolumeSpecName "kube-api-access-zw5q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:26:07.013507 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.013455    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e089ca1-e1ac-40be-862d-226a03cf9e25-kube-api-access-dnmw9" (OuterVolumeSpecName: "kube-api-access-dnmw9") pod "2e089ca1-e1ac-40be-862d-226a03cf9e25" (UID: "2e089ca1-e1ac-40be-862d-226a03cf9e25"). InnerVolumeSpecName "kube-api-access-dnmw9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:26:07.113122 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.113083    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7976a66-d60e-4a8e-be81-ac885acd97fd-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:07.113122 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.113120    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vrbl\" (UniqueName: \"kubernetes.io/projected/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5-kube-api-access-6vrbl\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:07.113365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.113135    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw5q2\" (UniqueName: \"kubernetes.io/projected/d7976a66-d60e-4a8e-be81-ac885acd97fd-kube-api-access-zw5q2\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:07.113365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.113149    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnmw9\" (UniqueName: \"kubernetes.io/projected/2e089ca1-e1ac-40be-862d-226a03cf9e25-kube-api-access-dnmw9\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:07.488556 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.488524    2548 generic.go:356] "Generic (PLEG): container finished" podID="ea8f3071-e84b-4cb9-9bf2-0b3038b848b5" containerID="6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee" exitCode=0
Jul 26 18:26:07.488764 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.488575    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"
Jul 26 18:26:07.488764 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.488615    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w" event={"ID":"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5","Type":"ContainerDied","Data":"6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee"}
Jul 26 18:26:07.488764 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.488681    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w" event={"ID":"ea8f3071-e84b-4cb9-9bf2-0b3038b848b5","Type":"ContainerDied","Data":"0a3de2149915bc4813a5cfae96407b95b3e41000c578b405a269c3ed8c6df6f3"}
Jul 26 18:26:07.488764 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.488713    2548 scope.go:117] "RemoveContainer" containerID="6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee"
Jul 26 18:26:07.490068 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.490044    2548 generic.go:356] "Generic (PLEG): container finished" podID="2e089ca1-e1ac-40be-862d-226a03cf9e25" containerID="19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea" exitCode=0
Jul 26 18:26:07.490219 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.490080    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"
Jul 26 18:26:07.490219 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.490112    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67" event={"ID":"2e089ca1-e1ac-40be-862d-226a03cf9e25","Type":"ContainerDied","Data":"19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea"}
Jul 26 18:26:07.490219 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.490152    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67" event={"ID":"2e089ca1-e1ac-40be-862d-226a03cf9e25","Type":"ContainerDied","Data":"5d572c9ef8d6f961650950b05a0a47fa6e05d8f9595fb883470e444789801fbe"}
Jul 26 18:26:07.491542 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.491521    2548 generic.go:356] "Generic (PLEG): container finished" podID="d7976a66-d60e-4a8e-be81-ac885acd97fd" containerID="e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f" exitCode=0
Jul 26 18:26:07.491664 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.491575    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"
Jul 26 18:26:07.491664 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.491610    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp" event={"ID":"d7976a66-d60e-4a8e-be81-ac885acd97fd","Type":"ContainerDied","Data":"e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f"}
Jul 26 18:26:07.491810 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.491717    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp" event={"ID":"d7976a66-d60e-4a8e-be81-ac885acd97fd","Type":"ContainerDied","Data":"a93be618ef2d84a1dbae5e8991b3436a97e7e5644817023936ddcc8ef4ae71ec"}
Jul 26 18:26:07.498904 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.498887    2548 scope.go:117] "RemoveContainer" containerID="6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee"
Jul 26 18:26:07.499152 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:26:07.499132    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee\": container with ID starting with 6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee not found: ID does not exist" containerID="6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee"
Jul 26 18:26:07.499245 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.499159    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee"} err="failed to get container status \"6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee\": rpc error: code = NotFound desc = could not find container \"6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee\": container with ID starting with 6ca57790780c0f66b8a966ffa0f526e91f7ace6aae0ae819f00191527c6c6dee not found: ID does not exist"
Jul 26 18:26:07.499245 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.499176    2548 scope.go:117] "RemoveContainer" containerID="19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea"
Jul 26 18:26:07.506797 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.506781    2548 scope.go:117] "RemoveContainer" containerID="19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea"
Jul 26 18:26:07.507051 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:26:07.507033    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea\": container with ID starting with 19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea not found: ID does not exist" containerID="19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea"
Jul 26 18:26:07.507131 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.507062    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea"} err="failed to get container status \"19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea\": rpc error: code = NotFound desc = could not find container \"19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea\": container with ID starting with 19784c0becf66721b000bca94e5ac100855c0b2846a973366665e955f58592ea not found: ID does not exist"
Jul 26 18:26:07.507131 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.507084    2548 scope.go:117] "RemoveContainer" containerID="e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f"
Jul 26 18:26:07.511032 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.511011    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"]
Jul 26 18:26:07.514980 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.514960    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-c1daa682-cb6794874-vzqcp"]
Jul 26 18:26:07.515237 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.515220    2548 scope.go:117] "RemoveContainer" containerID="e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f"
Jul 26 18:26:07.515492 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:26:07.515473    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f\": container with ID starting with e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f not found: ID does not exist" containerID="e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f"
Jul 26 18:26:07.515555 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.515503    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f"} err="failed to get container status \"e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f\": rpc error: code = NotFound desc = could not find container \"e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f\": container with ID starting with e96e92d0421702cecd9ba42877495e4a5011d2c1fb7fea3d009cf4cf6f11bd2f not found: ID does not exist"
Jul 26 18:26:07.525309 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.525287    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"]
Jul 26 18:26:07.529083 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.529063    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-c1daa682-8f584cd8-6698w"]
Jul 26 18:26:07.538693 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.538671    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"]
Jul 26 18:26:07.541318 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:07.541297    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-c1daa682-c6dbb5544-2gr67"]
Jul 26 18:26:09.413909 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:09.413875    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e089ca1-e1ac-40be-862d-226a03cf9e25" path="/var/lib/kubelet/pods/2e089ca1-e1ac-40be-862d-226a03cf9e25/volumes"
Jul 26 18:26:09.414342 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:09.414327    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7976a66-d60e-4a8e-be81-ac885acd97fd" path="/var/lib/kubelet/pods/d7976a66-d60e-4a8e-be81-ac885acd97fd/volumes"
Jul 26 18:26:09.414653 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:09.414640    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea8f3071-e84b-4cb9-9bf2-0b3038b848b5" path="/var/lib/kubelet/pods/ea8f3071-e84b-4cb9-9bf2-0b3038b848b5/volumes"
Jul 26 18:26:11.365551 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:11.365509    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"]
Jul 26 18:26:11.366047 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:11.365779    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy" containerID="cri-o://34c8a699821881586be2c579633c5b9d317eeb665428e687f8460e39ca0a439d" gracePeriod=30
Jul 26 18:26:12.366078 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.366042    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"]
Jul 26 18:26:12.366674 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.366654    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea8f3071-e84b-4cb9-9bf2-0b3038b848b5" containerName="payload-pre-processing"
Jul 26 18:26:12.366741 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.366677    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea8f3071-e84b-4cb9-9bf2-0b3038b848b5" containerName="payload-pre-processing"
Jul 26 18:26:12.366741 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.366706    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7976a66-d60e-4a8e-be81-ac885acd97fd" containerName="maas-api"
Jul 26 18:26:12.366741 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.366715    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7976a66-d60e-4a8e-be81-ac885acd97fd" containerName="maas-api"
Jul 26 18:26:12.366741 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.366733    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e089ca1-e1ac-40be-862d-226a03cf9e25" containerName="payload-processing"
Jul 26 18:26:12.366937 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.366743    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e089ca1-e1ac-40be-862d-226a03cf9e25" containerName="payload-processing"
Jul 26 18:26:12.366937 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.366841    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea8f3071-e84b-4cb9-9bf2-0b3038b848b5" containerName="payload-pre-processing"
Jul 26 18:26:12.366937 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.366853    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e089ca1-e1ac-40be-862d-226a03cf9e25" containerName="payload-processing"
Jul 26 18:26:12.366937 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.366864    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7976a66-d60e-4a8e-be81-ac885acd97fd" containerName="maas-api"
Jul 26 18:26:12.371919 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.371901    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.374859 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.374833    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b6610536-gw-openshift-default-dockercfg-gq8wx\""
Jul 26 18:26:12.382852 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.382823    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"]
Jul 26 18:26:12.466371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.466325    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-podinfo\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.466676 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.466652    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-token\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.466925 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.466907    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-credential-socket\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.467165 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.467143    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istiod-ca-cert\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.468096 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.468068    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzpsl\" (UniqueName: \"kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-kube-api-access-rzpsl\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.468365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.468345    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-data\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.468548 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.468531    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-socket\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.468797 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.468768    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-certs\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.469088 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.469066    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-envoy\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.570638 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.570602    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istiod-ca-cert\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.570884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.570654    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzpsl\" (UniqueName: \"kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-kube-api-access-rzpsl\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.570884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.570692    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-data\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.570884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.570716    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-socket\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.570884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.570839    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-certs\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.571170 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.570966    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-envoy\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.571170 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.571009    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-podinfo\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.571170 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.571044    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-token\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.571170 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.571083    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-credential-socket\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.571170 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.571106    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-socket\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.571467 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.571442    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istiod-ca-cert\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.571540 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.571516    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-certs\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.571595 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.571526    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-data\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.571595 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.571567    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-credential-socket\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.573261 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.573234    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-envoy\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.573658 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.573641    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-podinfo\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.579378 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.579353    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-token\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.579759 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.579744    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzpsl\" (UniqueName: \"kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-kube-api-access-rzpsl\") pod \"e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") " pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.684001 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.683903    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:12.827044 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.827013    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"]
Jul 26 18:26:12.828622 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:26:12.828590    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b2fd2a0_5d6e_497c_aaf9_b6c5fb6239ff.slice/crio-f4863679a5e600f7e4850b30a05863e9d638d8d658c1f856353f3ebe295731a5 WatchSource:0}: Error finding container f4863679a5e600f7e4850b30a05863e9d638d8d658c1f856353f3ebe295731a5: Status 404 returned error can't find the container with id f4863679a5e600f7e4850b30a05863e9d638d8d658c1f856353f3ebe295731a5
Jul 26 18:26:12.833525 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.833488    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:26:12.833632 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.833572    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:26:12.833632 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:12.833615    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:26:13.525820 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:13.525781    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" event={"ID":"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff","Type":"ContainerStarted","Data":"a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe"}
Jul 26 18:26:13.526251 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:13.525847    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" event={"ID":"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff","Type":"ContainerStarted","Data":"f4863679a5e600f7e4850b30a05863e9d638d8d658c1f856353f3ebe295731a5"}
Jul 26 18:26:13.548418 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:13.548365    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" podStartSLOduration=1.5483502630000001 podStartE2EDuration="1.548350263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:26:13.545883379 +0000 UTC m=+1730.646136296" watchObservedRunningTime="2026-07-26 18:26:13.548350263 +0000 UTC m=+1730.648603149"
Jul 26 18:26:13.684540 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:13.684509    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:13.689650 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:13.689627    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:14.530455 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:14.530424    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:14.531291 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:14.531273    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:15.079536 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.079507    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"]
Jul 26 18:26:15.083248 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.083225    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.085639 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.085616    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-b6610536-serving-cert\""
Jul 26 18:26:15.095995 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.095970    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"]
Jul 26 18:26:15.197275 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.197235    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0122a98f-b900-481a-b466-4b0769ffca4e-openshift-service-ca\") pod \"maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.197476 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.197317    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0122a98f-b900-481a-b466-4b0769ffca4e-maas-api-tls\") pod \"maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.197476 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.197352    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7dnq\" (UniqueName: \"kubernetes.io/projected/0122a98f-b900-481a-b466-4b0769ffca4e-kube-api-access-v7dnq\") pod \"maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.298688 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.298647    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0122a98f-b900-481a-b466-4b0769ffca4e-maas-api-tls\") pod \"maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.298892 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.298706    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7dnq\" (UniqueName: \"kubernetes.io/projected/0122a98f-b900-481a-b466-4b0769ffca4e-kube-api-access-v7dnq\") pod \"maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.298892 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.298839    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0122a98f-b900-481a-b466-4b0769ffca4e-openshift-service-ca\") pod \"maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.299449 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.299428    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0122a98f-b900-481a-b466-4b0769ffca4e-openshift-service-ca\") pod \"maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.301204 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.301167    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0122a98f-b900-481a-b466-4b0769ffca4e-maas-api-tls\") pod \"maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.306666 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.306645    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7dnq\" (UniqueName: \"kubernetes.io/projected/0122a98f-b900-481a-b466-4b0769ffca4e-kube-api-access-v7dnq\") pod \"maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.397973 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.397936    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:15.548094 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.548067    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"]
Jul 26 18:26:15.549694 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:26:15.549667    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0122a98f_b900_481a_b466_4b0769ffca4e.slice/crio-3ccdbfe0c1d7ab4a8650feb63dd9a3633ff81fcb46c5b76028b1424de0c37a27 WatchSource:0}: Error finding container 3ccdbfe0c1d7ab4a8650feb63dd9a3633ff81fcb46c5b76028b1424de0c37a27: Status 404 returned error can't find the container with id 3ccdbfe0c1d7ab4a8650feb63dd9a3633ff81fcb46c5b76028b1424de0c37a27
Jul 26 18:26:15.855655 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.855562    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"]
Jul 26 18:26:15.860423 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.860399    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:15.863031 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.863002    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-b6610536\""
Jul 26 18:26:15.863246 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.863225    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-b6610536-dockercfg-ns4jk\""
Jul 26 18:26:15.869521 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:15.869497    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"]
Jul 26 18:26:16.007667 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.007625    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abf28be2-f7fd-4ebb-a065-fc76beb099da-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf\" (UID: \"abf28be2-f7fd-4ebb-a065-fc76beb099da\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:16.007869 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.007728    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmflq\" (UniqueName: \"kubernetes.io/projected/abf28be2-f7fd-4ebb-a065-fc76beb099da-kube-api-access-gmflq\") pod \"payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf\" (UID: \"abf28be2-f7fd-4ebb-a065-fc76beb099da\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:16.109049 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.108947    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abf28be2-f7fd-4ebb-a065-fc76beb099da-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf\" (UID: \"abf28be2-f7fd-4ebb-a065-fc76beb099da\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:16.109049 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.109018    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmflq\" (UniqueName: \"kubernetes.io/projected/abf28be2-f7fd-4ebb-a065-fc76beb099da-kube-api-access-gmflq\") pod \"payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf\" (UID: \"abf28be2-f7fd-4ebb-a065-fc76beb099da\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:16.109748 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.109725    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abf28be2-f7fd-4ebb-a065-fc76beb099da-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf\" (UID: \"abf28be2-f7fd-4ebb-a065-fc76beb099da\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:16.117868 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.117842    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmflq\" (UniqueName: \"kubernetes.io/projected/abf28be2-f7fd-4ebb-a065-fc76beb099da-kube-api-access-gmflq\") pod \"payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf\" (UID: \"abf28be2-f7fd-4ebb-a065-fc76beb099da\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:16.173605 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.173326    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:16.316276 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.316246    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"]
Jul 26 18:26:16.318360 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:26:16.318330    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf28be2_f7fd_4ebb_a065_fc76beb099da.slice/crio-e2dd4eb2b4925dd5f92e9d2d7b04ebe7a91847178e9de3897fb71fe9ccf8eff7 WatchSource:0}: Error finding container e2dd4eb2b4925dd5f92e9d2d7b04ebe7a91847178e9de3897fb71fe9ccf8eff7: Status 404 returned error can't find the container with id e2dd4eb2b4925dd5f92e9d2d7b04ebe7a91847178e9de3897fb71fe9ccf8eff7
Jul 26 18:26:16.551460 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.551422    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7" event={"ID":"0122a98f-b900-481a-b466-4b0769ffca4e","Type":"ContainerStarted","Data":"5f410cc22d61c17d98f2aada1a50a8399a4dd813c2c693b68c2516e28bd16b9d"}
Jul 26 18:26:16.551882 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.551493    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:16.551882 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.551517    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7" event={"ID":"0122a98f-b900-481a-b466-4b0769ffca4e","Type":"ContainerStarted","Data":"3ccdbfe0c1d7ab4a8650feb63dd9a3633ff81fcb46c5b76028b1424de0c37a27"}
Jul 26 18:26:16.553672 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.553645    2548 generic.go:356] "Generic (PLEG): container finished" podID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerID="34c8a699821881586be2c579633c5b9d317eeb665428e687f8460e39ca0a439d" exitCode=0
Jul 26 18:26:16.553808 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.553689    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" event={"ID":"458f63f5-5e95-4836-93aa-92d3526ccca8","Type":"ContainerDied","Data":"34c8a699821881586be2c579633c5b9d317eeb665428e687f8460e39ca0a439d"}
Jul 26 18:26:16.553808 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.553750    2548 scope.go:117] "RemoveContainer" containerID="1c1b097ddba46fdf2052b978dde4444e6f943c2287d5b522f975be20178639bf"
Jul 26 18:26:16.557259 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.555375    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf" event={"ID":"abf28be2-f7fd-4ebb-a065-fc76beb099da","Type":"ContainerStarted","Data":"b922ad08af74d5ae323ca0f9e41497354a8771dd72225228f5691fc88366e644"}
Jul 26 18:26:16.557259 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.555424    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf" event={"ID":"abf28be2-f7fd-4ebb-a065-fc76beb099da","Type":"ContainerStarted","Data":"e2dd4eb2b4925dd5f92e9d2d7b04ebe7a91847178e9de3897fb71fe9ccf8eff7"}
Jul 26 18:26:16.571796 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.571613    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7" podStartSLOduration=1.215854107 podStartE2EDuration="1.571592331s" totalImagesPullingTime="355.738224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:26:16.56842825 +0000 UTC m=+1733.668681360" watchObservedRunningTime="2026-07-26 18:26:16.571592331 +0000 UTC m=+1733.671845219"
Jul 26 18:26:16.586603 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.586556    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf" podStartSLOduration=1.586539621 podStartE2EDuration="1.586539621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:26:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:26:16.586074689 +0000 UTC m=+1733.686327593" watchObservedRunningTime="2026-07-26 18:26:16.586539621 +0000 UTC m=+1733.686792514"
Jul 26 18:26:16.627715 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.627658    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:26:16.715650 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.715618    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zw2z\" (UniqueName: \"kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-kube-api-access-5zw2z\") pod \"458f63f5-5e95-4836-93aa-92d3526ccca8\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") "
Jul 26 18:26:16.715822 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.715672    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-envoy\") pod \"458f63f5-5e95-4836-93aa-92d3526ccca8\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") "
Jul 26 18:26:16.715822 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.715786    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-certs\") pod \"458f63f5-5e95-4836-93aa-92d3526ccca8\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") "
Jul 26 18:26:16.715910 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.715822    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-credential-socket\") pod \"458f63f5-5e95-4836-93aa-92d3526ccca8\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") "
Jul 26 18:26:16.715910 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.715895    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-data\") pod \"458f63f5-5e95-4836-93aa-92d3526ccca8\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") "
Jul 26 18:26:16.716020 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.715928    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-podinfo\") pod \"458f63f5-5e95-4836-93aa-92d3526ccca8\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") "
Jul 26 18:26:16.716020 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.715967    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-token\") pod \"458f63f5-5e95-4836-93aa-92d3526ccca8\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") "
Jul 26 18:26:16.716020 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.715995    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/458f63f5-5e95-4836-93aa-92d3526ccca8-istiod-ca-cert\") pod \"458f63f5-5e95-4836-93aa-92d3526ccca8\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") "
Jul 26 18:26:16.716169 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.716015    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "458f63f5-5e95-4836-93aa-92d3526ccca8" (UID: "458f63f5-5e95-4836-93aa-92d3526ccca8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:26:16.716169 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.716043    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-socket\") pod \"458f63f5-5e95-4836-93aa-92d3526ccca8\" (UID: \"458f63f5-5e95-4836-93aa-92d3526ccca8\") "
Jul 26 18:26:16.716169 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.716117    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "458f63f5-5e95-4836-93aa-92d3526ccca8" (UID: "458f63f5-5e95-4836-93aa-92d3526ccca8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:26:16.716598 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.716571    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "458f63f5-5e95-4836-93aa-92d3526ccca8" (UID: "458f63f5-5e95-4836-93aa-92d3526ccca8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:26:16.716680 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.716595    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/458f63f5-5e95-4836-93aa-92d3526ccca8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "458f63f5-5e95-4836-93aa-92d3526ccca8" (UID: "458f63f5-5e95-4836-93aa-92d3526ccca8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:26:16.716680 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.716636    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-data" (OuterVolumeSpecName: "istio-data") pod "458f63f5-5e95-4836-93aa-92d3526ccca8" (UID: "458f63f5-5e95-4836-93aa-92d3526ccca8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:26:16.716935 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.716917    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:16.717218 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.717179    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:16.717309 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.717223    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/458f63f5-5e95-4836-93aa-92d3526ccca8-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:16.717309 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.717240    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:16.718127 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.718101    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "458f63f5-5e95-4836-93aa-92d3526ccca8" (UID: "458f63f5-5e95-4836-93aa-92d3526ccca8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:26:16.718266 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.718221    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-kube-api-access-5zw2z" (OuterVolumeSpecName: "kube-api-access-5zw2z") pod "458f63f5-5e95-4836-93aa-92d3526ccca8" (UID: "458f63f5-5e95-4836-93aa-92d3526ccca8"). InnerVolumeSpecName "kube-api-access-5zw2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:26:16.718390 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.718375    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-token" (OuterVolumeSpecName: "istio-token") pod "458f63f5-5e95-4836-93aa-92d3526ccca8" (UID: "458f63f5-5e95-4836-93aa-92d3526ccca8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:26:16.718925 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.718909    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "458f63f5-5e95-4836-93aa-92d3526ccca8" (UID: "458f63f5-5e95-4836-93aa-92d3526ccca8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:26:16.818087 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.818052    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:16.818087 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.818079    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:16.818087 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.818088    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:16.818087 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.818098    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zw2z\" (UniqueName: \"kubernetes.io/projected/458f63f5-5e95-4836-93aa-92d3526ccca8-kube-api-access-5zw2z\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:16.818445 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:16.818107    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/458f63f5-5e95-4836-93aa-92d3526ccca8-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:17.564180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:17.564091    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"
Jul 26 18:26:17.564180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:17.564119    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55" event={"ID":"458f63f5-5e95-4836-93aa-92d3526ccca8","Type":"ContainerDied","Data":"9937de7aa331bd758ce087c5f0ffc6efb71a23c8bb2dfc39b5c0f4ab740d336b"}
Jul 26 18:26:17.564710 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:17.564182    2548 scope.go:117] "RemoveContainer" containerID="34c8a699821881586be2c579633c5b9d317eeb665428e687f8460e39ca0a439d"
Jul 26 18:26:17.564710 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:17.564698    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:17.583005 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:17.582975    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"]
Jul 26 18:26:17.585018 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:17.584994    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c1daa682-openshift-default-f996fb48-s4c55"]
Jul 26 18:26:19.414187 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:19.414152    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" path="/var/lib/kubelet/pods/458f63f5-5e95-4836-93aa-92d3526ccca8/volumes"
Jul 26 18:26:22.581134 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:22.581102    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:28.574048 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:28.574012    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:29.531889 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:29.531853    2548 patch_prober.go:28] interesting pod/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 26 18:26:29.532104 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:29.531918    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 26 18:26:29.634279 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:29.634248    2548 generic.go:356] "Generic (PLEG): container finished" podID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerID="a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe" exitCode=0
Jul 26 18:26:29.634667 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:29.634322    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" event={"ID":"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff","Type":"ContainerDied","Data":"a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe"}
Jul 26 18:26:29.634736 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:29.634722    2548 scope.go:117] "RemoveContainer" containerID="a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe"
Jul 26 18:26:29.635760 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:29.635733    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:26:29.635814 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:29.635804    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:26:29.635852 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:29.635836    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:26:30.640855 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:30.640819    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" event={"ID":"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff","Type":"ContainerStarted","Data":"76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f"}
Jul 26 18:26:30.684466 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:30.684422    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:30.684843 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:30.684814    2548 patch_prober.go:28] interesting pod/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 26 18:26:30.684989 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:30.684877    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 26 18:26:31.685409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:31.685364    2548 patch_prober.go:28] interesting pod/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 26 18:26:31.685916 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:31.685428    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 26 18:26:32.684758 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:32.684718    2548 patch_prober.go:28] interesting pod/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 26 18:26:32.684947 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:32.684779    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 26 18:26:33.684861 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:33.684823    2548 patch_prober.go:28] interesting pod/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 26 18:26:33.685272 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:33.684880    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 26 18:26:34.688359 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:34.688328    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:34.688750 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:34.688663    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:34.689286 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:34.689266    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:26:50.399943 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.399901    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"]
Jul 26 18:26:50.400544 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.400177    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7" podUID="0122a98f-b900-481a-b466-4b0769ffca4e" containerName="maas-api" containerID="cri-o://5f410cc22d61c17d98f2aada1a50a8399a4dd813c2c693b68c2516e28bd16b9d" gracePeriod=30
Jul 26 18:26:50.470933 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.470899    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"]
Jul 26 18:26:50.471207 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.471143    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf" podUID="abf28be2-f7fd-4ebb-a065-fc76beb099da" containerName="payload-pre-processing" containerID="cri-o://b922ad08af74d5ae323ca0f9e41497354a8771dd72225228f5691fc88366e644" gracePeriod=30
Jul 26 18:26:50.736671 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.736634    2548 generic.go:356] "Generic (PLEG): container finished" podID="abf28be2-f7fd-4ebb-a065-fc76beb099da" containerID="b922ad08af74d5ae323ca0f9e41497354a8771dd72225228f5691fc88366e644" exitCode=0
Jul 26 18:26:50.736839 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.736760    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf" event={"ID":"abf28be2-f7fd-4ebb-a065-fc76beb099da","Type":"ContainerDied","Data":"b922ad08af74d5ae323ca0f9e41497354a8771dd72225228f5691fc88366e644"}
Jul 26 18:26:50.738393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.738265    2548 generic.go:356] "Generic (PLEG): container finished" podID="0122a98f-b900-481a-b466-4b0769ffca4e" containerID="5f410cc22d61c17d98f2aada1a50a8399a4dd813c2c693b68c2516e28bd16b9d" exitCode=0
Jul 26 18:26:50.738393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.738331    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7" event={"ID":"0122a98f-b900-481a-b466-4b0769ffca4e","Type":"ContainerDied","Data":"5f410cc22d61c17d98f2aada1a50a8399a4dd813c2c693b68c2516e28bd16b9d"}
Jul 26 18:26:50.764154 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.764125    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:50.767408 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.767386    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:50.854810 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.854778    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0122a98f-b900-481a-b466-4b0769ffca4e-openshift-service-ca\") pod \"0122a98f-b900-481a-b466-4b0769ffca4e\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") "
Jul 26 18:26:50.854992 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.854864    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abf28be2-f7fd-4ebb-a065-fc76beb099da-plugins-config-volume\") pod \"abf28be2-f7fd-4ebb-a065-fc76beb099da\" (UID: \"abf28be2-f7fd-4ebb-a065-fc76beb099da\") "
Jul 26 18:26:50.854992 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.854911    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmflq\" (UniqueName: \"kubernetes.io/projected/abf28be2-f7fd-4ebb-a065-fc76beb099da-kube-api-access-gmflq\") pod \"abf28be2-f7fd-4ebb-a065-fc76beb099da\" (UID: \"abf28be2-f7fd-4ebb-a065-fc76beb099da\") "
Jul 26 18:26:50.854992 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.854939    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0122a98f-b900-481a-b466-4b0769ffca4e-maas-api-tls\") pod \"0122a98f-b900-481a-b466-4b0769ffca4e\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") "
Jul 26 18:26:50.855166 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.855013    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7dnq\" (UniqueName: \"kubernetes.io/projected/0122a98f-b900-481a-b466-4b0769ffca4e-kube-api-access-v7dnq\") pod \"0122a98f-b900-481a-b466-4b0769ffca4e\" (UID: \"0122a98f-b900-481a-b466-4b0769ffca4e\") "
Jul 26 18:26:50.855263 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.855176    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0122a98f-b900-481a-b466-4b0769ffca4e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0122a98f-b900-481a-b466-4b0769ffca4e" (UID: "0122a98f-b900-481a-b466-4b0769ffca4e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:26:50.855331 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.855271    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abf28be2-f7fd-4ebb-a065-fc76beb099da-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "abf28be2-f7fd-4ebb-a065-fc76beb099da" (UID: "abf28be2-f7fd-4ebb-a065-fc76beb099da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:26:50.857126 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.857094    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0122a98f-b900-481a-b466-4b0769ffca4e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0122a98f-b900-481a-b466-4b0769ffca4e" (UID: "0122a98f-b900-481a-b466-4b0769ffca4e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:26:50.857278 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.857153    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0122a98f-b900-481a-b466-4b0769ffca4e-kube-api-access-v7dnq" (OuterVolumeSpecName: "kube-api-access-v7dnq") pod "0122a98f-b900-481a-b466-4b0769ffca4e" (UID: "0122a98f-b900-481a-b466-4b0769ffca4e"). InnerVolumeSpecName "kube-api-access-v7dnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:26:50.857278 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.857206    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abf28be2-f7fd-4ebb-a065-fc76beb099da-kube-api-access-gmflq" (OuterVolumeSpecName: "kube-api-access-gmflq") pod "abf28be2-f7fd-4ebb-a065-fc76beb099da" (UID: "abf28be2-f7fd-4ebb-a065-fc76beb099da"). InnerVolumeSpecName "kube-api-access-gmflq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:26:50.956066 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.955976    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7dnq\" (UniqueName: \"kubernetes.io/projected/0122a98f-b900-481a-b466-4b0769ffca4e-kube-api-access-v7dnq\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:50.956066 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.956013    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0122a98f-b900-481a-b466-4b0769ffca4e-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:50.956066 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.956022    2548 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/abf28be2-f7fd-4ebb-a065-fc76beb099da-plugins-config-volume\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:50.956066 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.956031    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmflq\" (UniqueName: \"kubernetes.io/projected/abf28be2-f7fd-4ebb-a065-fc76beb099da-kube-api-access-gmflq\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:50.956066 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:50.956042    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0122a98f-b900-481a-b466-4b0769ffca4e-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:26:51.745180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:51.745092    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"
Jul 26 18:26:51.745180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:51.745100    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf" event={"ID":"abf28be2-f7fd-4ebb-a065-fc76beb099da","Type":"ContainerDied","Data":"e2dd4eb2b4925dd5f92e9d2d7b04ebe7a91847178e9de3897fb71fe9ccf8eff7"}
Jul 26 18:26:51.745180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:51.745172    2548 scope.go:117] "RemoveContainer" containerID="b922ad08af74d5ae323ca0f9e41497354a8771dd72225228f5691fc88366e644"
Jul 26 18:26:51.746669 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:51.746561    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7" event={"ID":"0122a98f-b900-481a-b466-4b0769ffca4e","Type":"ContainerDied","Data":"3ccdbfe0c1d7ab4a8650feb63dd9a3633ff81fcb46c5b76028b1424de0c37a27"}
Jul 26 18:26:51.746669 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:51.746583    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"
Jul 26 18:26:51.754096 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:51.754080    2548 scope.go:117] "RemoveContainer" containerID="5f410cc22d61c17d98f2aada1a50a8399a4dd813c2c693b68c2516e28bd16b9d"
Jul 26 18:26:51.765078 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:51.765056    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"]
Jul 26 18:26:51.769150 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:51.769124    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b6610536-55b99749b8-tmkq7"]
Jul 26 18:26:51.779524 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:51.779504    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"]
Jul 26 18:26:51.783049 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:51.783028    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-b6610536-5c8966f796-ftjgf"]
Jul 26 18:26:53.415085 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:53.415051    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0122a98f-b900-481a-b466-4b0769ffca4e" path="/var/lib/kubelet/pods/0122a98f-b900-481a-b466-4b0769ffca4e/volumes"
Jul 26 18:26:53.415488 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:53.415448    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abf28be2-f7fd-4ebb-a065-fc76beb099da" path="/var/lib/kubelet/pods/abf28be2-f7fd-4ebb-a065-fc76beb099da/volumes"
Jul 26 18:26:55.178303 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.178270    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"]
Jul 26 18:26:55.178755 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.178557    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy" containerID="cri-o://76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f" gracePeriod=30
Jul 26 18:26:55.957250 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.957215    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"]
Jul 26 18:26:55.957612 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.957599    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy"
Jul 26 18:26:55.957661 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.957613    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy"
Jul 26 18:26:55.957661 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.957627    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0122a98f-b900-481a-b466-4b0769ffca4e" containerName="maas-api"
Jul 26 18:26:55.957661 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.957632    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="0122a98f-b900-481a-b466-4b0769ffca4e" containerName="maas-api"
Jul 26 18:26:55.957661 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.957649    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf28be2-f7fd-4ebb-a065-fc76beb099da" containerName="payload-pre-processing"
Jul 26 18:26:55.957661 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.957654    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf28be2-f7fd-4ebb-a065-fc76beb099da" containerName="payload-pre-processing"
Jul 26 18:26:55.957895 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.957716    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy"
Jul 26 18:26:55.957895 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.957723    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="abf28be2-f7fd-4ebb-a065-fc76beb099da" containerName="payload-pre-processing"
Jul 26 18:26:55.957895 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.957730    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="0122a98f-b900-481a-b466-4b0769ffca4e" containerName="maas-api"
Jul 26 18:26:55.961143 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.961126    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:55.963720 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.963701    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-60637c1e-openshift-default-dockercfg-k6hqz\""
Jul 26 18:26:55.973619 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:55.973584    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"]
Jul 26 18:26:56.119382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.113488    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-token\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.119382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.113550    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-certs\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.119382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.113584    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-data\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.119382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.113651    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-envoy\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.119382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.113742    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-socket\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.119382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.113776    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-credential-socket\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.119382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.113831    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-podinfo\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.119382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.113867    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9t9f\" (UniqueName: \"kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-kube-api-access-m9t9f\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.119382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.113901    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istiod-ca-cert\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.214863 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.214762    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-socket\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.214863 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.214805    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-credential-socket\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215394 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.214913    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-podinfo\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215394 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.214934    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9t9f\" (UniqueName: \"kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-kube-api-access-m9t9f\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215394 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.214959    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istiod-ca-cert\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215394 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.215264    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-socket\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215394 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.215314    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-token\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215394 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.215320    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-credential-socket\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215394 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.215350    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-certs\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215394 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.215369    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-data\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215811 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.215423    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-envoy\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215811 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.215637    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-certs\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215811 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.215727    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istiod-ca-cert\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.215811 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.215755    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-data\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.217555 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.217537    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-envoy\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.217631 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.217589    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-podinfo\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.223392 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.223374    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9t9f\" (UniqueName: \"kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-kube-api-access-m9t9f\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.227445 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.227426    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-token\") pod \"e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") " pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.275735 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.275704    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:56.419898 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.419868    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"]
Jul 26 18:26:56.421980 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:26:56.421948    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506cd376_a4af_4d60_ba63_e7ef087d6aaa.slice/crio-f17f0b65385971cd096c18509800fa1f0d0a05df27c2b09c65c0d8809c5f3486 WatchSource:0}: Error finding container f17f0b65385971cd096c18509800fa1f0d0a05df27c2b09c65c0d8809c5f3486: Status 404 returned error can't find the container with id f17f0b65385971cd096c18509800fa1f0d0a05df27c2b09c65c0d8809c5f3486
Jul 26 18:26:56.424026 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.423996    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:26:56.424104 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.424060    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:26:56.424104 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.424089    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:26:56.776817 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.776731    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" event={"ID":"506cd376-a4af-4d60-ba63-e7ef087d6aaa","Type":"ContainerStarted","Data":"8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f"}
Jul 26 18:26:56.776817 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.776791    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" event={"ID":"506cd376-a4af-4d60-ba63-e7ef087d6aaa","Type":"ContainerStarted","Data":"f17f0b65385971cd096c18509800fa1f0d0a05df27c2b09c65c0d8809c5f3486"}
Jul 26 18:26:56.797690 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:56.797635    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" podStartSLOduration=1.797615244 podStartE2EDuration="1.797615244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:26:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:26:56.796422117 +0000 UTC m=+1773.896675024" watchObservedRunningTime="2026-07-26 18:26:56.797615244 +0000 UTC m=+1773.897868204"
Jul 26 18:26:57.276515 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:57.276478    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:57.281658 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:57.281630    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:57.782505 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:57.782469    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:57.783531 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:57.783512    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:26:58.319518 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.319476    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"]
Jul 26 18:26:58.320095 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.320076    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy"
Jul 26 18:26:58.320095 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.320096    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy"
Jul 26 18:26:58.320270 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.320217    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="458f63f5-5e95-4836-93aa-92d3526ccca8" containerName="istio-proxy"
Jul 26 18:26:58.323839 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.323815    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:58.326562 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.326529    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-60637c1e-serving-cert\""
Jul 26 18:26:58.333595 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.333568    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"]
Jul 26 18:26:58.438916 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.438873    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7mj\" (UniqueName: \"kubernetes.io/projected/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-kube-api-access-wj7mj\") pod \"maas-api-e2e-ait-60637c1e-6b46685685-kk5w8\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:58.439130 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.438968    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-maas-api-tls\") pod \"maas-api-e2e-ait-60637c1e-6b46685685-kk5w8\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:58.439130 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.438998    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-openshift-service-ca\") pod \"maas-api-e2e-ait-60637c1e-6b46685685-kk5w8\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:58.540276 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.540229    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-maas-api-tls\") pod \"maas-api-e2e-ait-60637c1e-6b46685685-kk5w8\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:58.540276 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.540282    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-openshift-service-ca\") pod \"maas-api-e2e-ait-60637c1e-6b46685685-kk5w8\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:58.540555 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:26:58.540399    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-serving-cert: secret "maas-api-e2e-ait-60637c1e-serving-cert" not found
Jul 26 18:26:58.540555 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:26:58.540479    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-maas-api-tls podName:e02c27c1-acd1-4ebd-90fb-49bb29aed28f nodeName:}" failed. No retries permitted until 2026-07-26 18:26:59.040458642 +0000 UTC m=+1776.140711508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-maas-api-tls") pod "maas-api-e2e-ait-60637c1e-6b46685685-kk5w8" (UID: "e02c27c1-acd1-4ebd-90fb-49bb29aed28f") : secret "maas-api-e2e-ait-60637c1e-serving-cert" not found
Jul 26 18:26:58.540555 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.540517    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7mj\" (UniqueName: \"kubernetes.io/projected/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-kube-api-access-wj7mj\") pod \"maas-api-e2e-ait-60637c1e-6b46685685-kk5w8\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:58.541027 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.541005    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-openshift-service-ca\") pod \"maas-api-e2e-ait-60637c1e-6b46685685-kk5w8\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:58.558305 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:58.558269    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7mj\" (UniqueName: \"kubernetes.io/projected/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-kube-api-access-wj7mj\") pod \"maas-api-e2e-ait-60637c1e-6b46685685-kk5w8\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:59.046827 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:59.046785    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-maas-api-tls\") pod \"maas-api-e2e-ait-60637c1e-6b46685685-kk5w8\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:59.049327 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:59.049290    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-maas-api-tls\") pod \"maas-api-e2e-ait-60637c1e-6b46685685-kk5w8\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:59.237893 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:59.237853    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:26:59.589418 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:59.589395    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"]
Jul 26 18:26:59.591000 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:26:59.590973    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02c27c1_acd1_4ebd_90fb_49bb29aed28f.slice/crio-26de0af214476917dd19ba21071bacf7aaab586cd5ce429eaecdf0824e00d2e2 WatchSource:0}: Error finding container 26de0af214476917dd19ba21071bacf7aaab586cd5ce429eaecdf0824e00d2e2: Status 404 returned error can't find the container with id 26de0af214476917dd19ba21071bacf7aaab586cd5ce429eaecdf0824e00d2e2
Jul 26 18:26:59.793182 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:26:59.793121    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8" event={"ID":"e02c27c1-acd1-4ebd-90fb-49bb29aed28f","Type":"ContainerStarted","Data":"26de0af214476917dd19ba21071bacf7aaab586cd5ce429eaecdf0824e00d2e2"}
Jul 26 18:27:00.444154 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.444125    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:27:00.561119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561023    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzpsl\" (UniqueName: \"kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-kube-api-access-rzpsl\") pod \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") "
Jul 26 18:27:00.561303 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561135    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-certs\") pod \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") "
Jul 26 18:27:00.561303 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561167    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-envoy\") pod \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") "
Jul 26 18:27:00.561303 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561246    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-socket\") pod \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") "
Jul 26 18:27:00.561303 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561299    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-podinfo\") pod \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") "
Jul 26 18:27:00.561518 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561326    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-credential-socket\") pod \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") "
Jul 26 18:27:00.561518 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561350    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-data\") pod \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") "
Jul 26 18:27:00.561518 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561390    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istiod-ca-cert\") pod \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") "
Jul 26 18:27:00.561518 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561436    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-token\") pod \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\" (UID: \"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff\") "
Jul 26 18:27:00.561716 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561493    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" (UID: "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:27:00.561716 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561687    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" (UID: "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:27:00.561853 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561826    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:00.561917 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561852    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:00.561917 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.561875    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" (UID: "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:27:00.562214 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.562171    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" (UID: "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:27:00.562587 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.562562    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" (UID: "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:27:00.563593 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.563565    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-kube-api-access-rzpsl" (OuterVolumeSpecName: "kube-api-access-rzpsl") pod "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" (UID: "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff"). InnerVolumeSpecName "kube-api-access-rzpsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:27:00.563914 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.563889    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" (UID: "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:27:00.564232 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.564185    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" (UID: "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:27:00.564360 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.564340    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" (UID: "6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:27:00.663186 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.663144    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:00.663626 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.663179    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:00.663626 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.663239    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:00.663626 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.663250    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:00.663626 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.663261    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzpsl\" (UniqueName: \"kubernetes.io/projected/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-kube-api-access-rzpsl\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:00.663626 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.663276    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:00.663626 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.663288    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:00.799753 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.799709    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8" event={"ID":"e02c27c1-acd1-4ebd-90fb-49bb29aed28f","Type":"ContainerStarted","Data":"f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70"}
Jul 26 18:27:00.799933 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.799814    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:27:00.801337 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.801309    2548 generic.go:356] "Generic (PLEG): container finished" podID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerID="76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f" exitCode=0
Jul 26 18:27:00.801463 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.801355    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"
Jul 26 18:27:00.801463 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.801369    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" event={"ID":"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff","Type":"ContainerDied","Data":"76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f"}
Jul 26 18:27:00.801463 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.801404    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx" event={"ID":"6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff","Type":"ContainerDied","Data":"f4863679a5e600f7e4850b30a05863e9d638d8d658c1f856353f3ebe295731a5"}
Jul 26 18:27:00.801463 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.801425    2548 scope.go:117] "RemoveContainer" containerID="76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f"
Jul 26 18:27:00.810481 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.810464    2548 scope.go:117] "RemoveContainer" containerID="a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe"
Jul 26 18:27:00.818957 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.818939    2548 scope.go:117] "RemoveContainer" containerID="76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f"
Jul 26 18:27:00.819242 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:27:00.819220    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f\": container with ID starting with 76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f not found: ID does not exist" containerID="76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f"
Jul 26 18:27:00.819325 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.819251    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f"} err="failed to get container status \"76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f\": rpc error: code = NotFound desc = could not find container \"76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f\": container with ID starting with 76691e17ba1147a08f11237bb4df3a89c185bdf6f0610e24e21b6853173ac44f not found: ID does not exist"
Jul 26 18:27:00.819325 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.819269    2548 scope.go:117] "RemoveContainer" containerID="a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe"
Jul 26 18:27:00.819512 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:27:00.819490    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe\": container with ID starting with a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe not found: ID does not exist" containerID="a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe"
Jul 26 18:27:00.819566 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.819521    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe"} err="failed to get container status \"a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe\": rpc error: code = NotFound desc = could not find container \"a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe\": container with ID starting with a0043f7d33c9d706bf4e886d4d3f5185319f2697c0391341f5d65a213b5b4dfe not found: ID does not exist"
Jul 26 18:27:00.871279 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.871222    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8" podStartSLOduration=2.5041905890000002 podStartE2EDuration="2.871185539s" totalImagesPullingTime="366.99495ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:27:00.855727936 +0000 UTC m=+1777.955980823" watchObservedRunningTime="2026-07-26 18:27:00.871185539 +0000 UTC m=+1777.971438423"
Jul 26 18:27:00.891693 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.891660    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"]
Jul 26 18:27:00.898157 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:00.898119    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b6610536-gw-openshift-default-6899bfb9f6-lznnx"]
Jul 26 18:27:01.414133 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:01.414100    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" path="/var/lib/kubelet/pods/6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff/volumes"
Jul 26 18:27:06.813592 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:06.813556    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:27:12.817222 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:12.815836    2548 patch_prober.go:28] interesting pod/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:50552->10.133.0.52:15021: read: connection reset by peer" start-of-body=
Jul 26 18:27:12.817222 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:12.815920    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": read tcp 10.133.0.2:50552->10.133.0.52:15021: read: connection reset by peer"
Jul 26 18:27:12.862961 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:12.862925    2548 generic.go:356] "Generic (PLEG): container finished" podID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerID="8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f" exitCode=0
Jul 26 18:27:12.863111 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:12.862992    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" event={"ID":"506cd376-a4af-4d60-ba63-e7ef087d6aaa","Type":"ContainerDied","Data":"8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f"}
Jul 26 18:27:12.863479 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:12.863465    2548 scope.go:117] "RemoveContainer" containerID="8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f"
Jul 26 18:27:12.864573 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:12.864545    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:27:12.864689 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:12.864608    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:27:12.864689 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:12.864640    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:27:13.877550 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:13.877505    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" event={"ID":"506cd376-a4af-4d60-ba63-e7ef087d6aaa","Type":"ContainerStarted","Data":"94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880"}
Jul 26 18:27:14.276149 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:14.276039    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:27:14.276486 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:14.276462    2548 patch_prober.go:28] interesting pod/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 26 18:27:14.276710 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:14.276670    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 26 18:27:15.276833 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:15.276271    2548 patch_prober.go:28] interesting pod/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 26 18:27:15.276833 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:15.276363    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 26 18:27:16.277625 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:16.277148    2548 patch_prober.go:28] interesting pod/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 26 18:27:16.277625 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:16.277234    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 26 18:27:17.276399 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:17.276358    2548 patch_prober.go:28] interesting pod/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 26 18:27:17.276624 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:17.276430    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 26 18:27:18.280426 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:18.280391    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:27:18.280820 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:18.280664    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:27:18.281387 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:18.281370    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:27:34.270930 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.270893    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"]
Jul 26 18:27:34.271449 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.271107    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8" podUID="e02c27c1-acd1-4ebd-90fb-49bb29aed28f" containerName="maas-api" containerID="cri-o://f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70" gracePeriod=30
Jul 26 18:27:34.519537 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.519512    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:27:34.586304 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.586188    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-maas-api-tls\") pod \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") "
Jul 26 18:27:34.586458 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.586302    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj7mj\" (UniqueName: \"kubernetes.io/projected/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-kube-api-access-wj7mj\") pod \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") "
Jul 26 18:27:34.586458 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.586410    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-openshift-service-ca\") pod \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\" (UID: \"e02c27c1-acd1-4ebd-90fb-49bb29aed28f\") "
Jul 26 18:27:34.586780 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.586756    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e02c27c1-acd1-4ebd-90fb-49bb29aed28f" (UID: "e02c27c1-acd1-4ebd-90fb-49bb29aed28f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:27:34.588501 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.588474    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e02c27c1-acd1-4ebd-90fb-49bb29aed28f" (UID: "e02c27c1-acd1-4ebd-90fb-49bb29aed28f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:27:34.588593 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.588507    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-kube-api-access-wj7mj" (OuterVolumeSpecName: "kube-api-access-wj7mj") pod "e02c27c1-acd1-4ebd-90fb-49bb29aed28f" (UID: "e02c27c1-acd1-4ebd-90fb-49bb29aed28f"). InnerVolumeSpecName "kube-api-access-wj7mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:27:34.687427 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.687392    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:34.687427 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.687423    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:34.687427 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.687433    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj7mj\" (UniqueName: \"kubernetes.io/projected/e02c27c1-acd1-4ebd-90fb-49bb29aed28f-kube-api-access-wj7mj\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:34.985506 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.985467    2548 generic.go:356] "Generic (PLEG): container finished" podID="e02c27c1-acd1-4ebd-90fb-49bb29aed28f" containerID="f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70" exitCode=0
Jul 26 18:27:34.985707 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.985528    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"
Jul 26 18:27:34.985707 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.985546    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8" event={"ID":"e02c27c1-acd1-4ebd-90fb-49bb29aed28f","Type":"ContainerDied","Data":"f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70"}
Jul 26 18:27:34.985707 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.985601    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8" event={"ID":"e02c27c1-acd1-4ebd-90fb-49bb29aed28f","Type":"ContainerDied","Data":"26de0af214476917dd19ba21071bacf7aaab586cd5ce429eaecdf0824e00d2e2"}
Jul 26 18:27:34.985707 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.985630    2548 scope.go:117] "RemoveContainer" containerID="f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70"
Jul 26 18:27:34.995290 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.995252    2548 scope.go:117] "RemoveContainer" containerID="f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70"
Jul 26 18:27:34.995685 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:27:34.995555    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70\": container with ID starting with f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70 not found: ID does not exist" containerID="f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70"
Jul 26 18:27:34.995685 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:34.995586    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70"} err="failed to get container status \"f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70\": rpc error: code = NotFound desc = could not find container \"f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70\": container with ID starting with f7bfbb4ab83ccea56ff2468055360c5e850223751bd3f81b38aadd6d24571b70 not found: ID does not exist"
Jul 26 18:27:35.008687 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:35.008653    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"]
Jul 26 18:27:35.012507 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:35.012483    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-60637c1e-6b46685685-kk5w8"]
Jul 26 18:27:35.415079 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:35.415045    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e02c27c1-acd1-4ebd-90fb-49bb29aed28f" path="/var/lib/kubelet/pods/e02c27c1-acd1-4ebd-90fb-49bb29aed28f/volumes"
Jul 26 18:27:40.150324 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.150291    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"]
Jul 26 18:27:40.150728 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.150502    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy" containerID="cri-o://94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880" gracePeriod=30
Jul 26 18:27:40.842906 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.842874    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"]
Jul 26 18:27:40.843390 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.843372    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy"
Jul 26 18:27:40.843484 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.843392    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy"
Jul 26 18:27:40.843484 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.843401    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy"
Jul 26 18:27:40.843484 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.843406    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy"
Jul 26 18:27:40.843484 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.843416    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e02c27c1-acd1-4ebd-90fb-49bb29aed28f" containerName="maas-api"
Jul 26 18:27:40.843484 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.843423    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="e02c27c1-acd1-4ebd-90fb-49bb29aed28f" containerName="maas-api"
Jul 26 18:27:40.843741 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.843496    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy"
Jul 26 18:27:40.843741 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.843505    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="e02c27c1-acd1-4ebd-90fb-49bb29aed28f" containerName="maas-api"
Jul 26 18:27:40.847832 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.847807    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:40.850160 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.850138    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ded9d893-openshift-default-dockercfg-shkld\""
Jul 26 18:27:40.859068 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.859049    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"]
Jul 26 18:27:40.949745 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.949661    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-data\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:40.950078 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.950051    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwf6r\" (UniqueName: \"kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-kube-api-access-zwf6r\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:40.950280 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.950261    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-envoy\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:40.950425 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.950405    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-token\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:40.950553 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.950530    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-certs\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:40.950752 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.950601    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-podinfo\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:40.950752 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.950628    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-credential-socket\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:40.950752 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.950662    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istiod-ca-cert\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:40.950752 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:40.950713    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-socket\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.051886 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.051854    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-data\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052074 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.051909    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwf6r\" (UniqueName: \"kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-kube-api-access-zwf6r\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052074 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.051957    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-envoy\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052074 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.051989    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-token\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052074 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.052016    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-certs\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052074 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.052067    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-podinfo\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052401 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.052093    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-credential-socket\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052401 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.052124    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istiod-ca-cert\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052401 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.052158    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-socket\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052401 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.052346    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-data\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052621 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.052598    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-socket\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052723 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.052700    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-certs\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.052783 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.052742    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-credential-socket\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.053111 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.053078    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istiod-ca-cert\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.054461 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.054436    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-envoy\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.054664 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.054645    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-podinfo\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.060570 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.060536    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwf6r\" (UniqueName: \"kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-kube-api-access-zwf6r\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.060695 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.060627    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-token\") pod \"e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") " pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.159427 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.159389    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:41.311607 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.311581    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"]
Jul 26 18:27:41.313148 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:27:41.313119    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ca69e2_956c_48eb_8d3a_6562f2a96dae.slice/crio-ace1b1d4be65fb138a23e8a8d3738dbfc2d1e13383c9e8ee0a777b5a0653f15c WatchSource:0}: Error finding container ace1b1d4be65fb138a23e8a8d3738dbfc2d1e13383c9e8ee0a777b5a0653f15c: Status 404 returned error can't find the container with id ace1b1d4be65fb138a23e8a8d3738dbfc2d1e13383c9e8ee0a777b5a0653f15c
Jul 26 18:27:41.315262 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.315229    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:27:41.315364 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.315305    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:27:41.315364 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:41.315334    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:27:42.021639 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:42.021597    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" event={"ID":"e2ca69e2-956c-48eb-8d3a-6562f2a96dae","Type":"ContainerStarted","Data":"0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d"}
Jul 26 18:27:42.021849 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:42.021655    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" event={"ID":"e2ca69e2-956c-48eb-8d3a-6562f2a96dae","Type":"ContainerStarted","Data":"ace1b1d4be65fb138a23e8a8d3738dbfc2d1e13383c9e8ee0a777b5a0653f15c"}
Jul 26 18:27:42.043536 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:42.043486    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" podStartSLOduration=2.043470181 podStartE2EDuration="2.043470181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:27:42.042161671 +0000 UTC m=+1819.142414576" watchObservedRunningTime="2026-07-26 18:27:42.043470181 +0000 UTC m=+1819.143723068"
Jul 26 18:27:42.160257 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:42.160226    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:42.168021 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:42.167982    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:43.027155 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.027125    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:43.028183 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.028161    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:43.624839 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.624808    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"]
Jul 26 18:27:43.625330 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.625314    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b2fd2a0-5d6e-497c-aaf9-b6c5fb6239ff" containerName="istio-proxy"
Jul 26 18:27:43.628548 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.628532    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:43.630985 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.630960    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ded9d893-serving-cert\""
Jul 26 18:27:43.638890 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.638865    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"]
Jul 26 18:27:43.779635 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.779601    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50b765d1-e352-4a0e-8b54-f4dfff48dd04-maas-api-tls\") pod \"maas-api-e2e-derive-ded9d893-69c9576557-2xfgc\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:43.779635 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.779634    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50b765d1-e352-4a0e-8b54-f4dfff48dd04-openshift-service-ca\") pod \"maas-api-e2e-derive-ded9d893-69c9576557-2xfgc\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:43.779846 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.779769    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2668t\" (UniqueName: \"kubernetes.io/projected/50b765d1-e352-4a0e-8b54-f4dfff48dd04-kube-api-access-2668t\") pod \"maas-api-e2e-derive-ded9d893-69c9576557-2xfgc\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:43.881064 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.880951    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50b765d1-e352-4a0e-8b54-f4dfff48dd04-maas-api-tls\") pod \"maas-api-e2e-derive-ded9d893-69c9576557-2xfgc\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:43.881064 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.880991    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50b765d1-e352-4a0e-8b54-f4dfff48dd04-openshift-service-ca\") pod \"maas-api-e2e-derive-ded9d893-69c9576557-2xfgc\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:43.881064 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.881057    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2668t\" (UniqueName: \"kubernetes.io/projected/50b765d1-e352-4a0e-8b54-f4dfff48dd04-kube-api-access-2668t\") pod \"maas-api-e2e-derive-ded9d893-69c9576557-2xfgc\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:43.881794 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.881770    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50b765d1-e352-4a0e-8b54-f4dfff48dd04-openshift-service-ca\") pod \"maas-api-e2e-derive-ded9d893-69c9576557-2xfgc\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:43.883487 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.883466    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50b765d1-e352-4a0e-8b54-f4dfff48dd04-maas-api-tls\") pod \"maas-api-e2e-derive-ded9d893-69c9576557-2xfgc\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:43.889046 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.889021    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2668t\" (UniqueName: \"kubernetes.io/projected/50b765d1-e352-4a0e-8b54-f4dfff48dd04-kube-api-access-2668t\") pod \"maas-api-e2e-derive-ded9d893-69c9576557-2xfgc\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:43.944990 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:43.944955    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:44.297927 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:44.297747    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"]
Jul 26 18:27:44.301244 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:27:44.301173    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b765d1_e352_4a0e_8b54_f4dfff48dd04.slice/crio-f75215170022e465cbaa028538787a8e2b2668e82911f2ba5b4477f9e19336e3 WatchSource:0}: Error finding container f75215170022e465cbaa028538787a8e2b2668e82911f2ba5b4477f9e19336e3: Status 404 returned error can't find the container with id f75215170022e465cbaa028538787a8e2b2668e82911f2ba5b4477f9e19336e3
Jul 26 18:27:45.040265 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.040153    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc" event={"ID":"50b765d1-e352-4a0e-8b54-f4dfff48dd04","Type":"ContainerStarted","Data":"a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791"}
Jul 26 18:27:45.040265 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.040241    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc" event={"ID":"50b765d1-e352-4a0e-8b54-f4dfff48dd04","Type":"ContainerStarted","Data":"f75215170022e465cbaa028538787a8e2b2668e82911f2ba5b4477f9e19336e3"}
Jul 26 18:27:45.040697 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.040383    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:45.060808 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.060754    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc" podStartSLOduration=1.6912629959999999 podStartE2EDuration="2.060736903s" totalImagesPullingTime="369.473907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:27:45.059763013 +0000 UTC m=+1822.160015907" watchObservedRunningTime="2026-07-26 18:27:45.060736903 +0000 UTC m=+1822.160989789"
Jul 26 18:27:45.426691 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.426664    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:27:45.496765 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.496725    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-certs\") pod \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") "
Jul 26 18:27:45.496765 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.496766    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istiod-ca-cert\") pod \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") "
Jul 26 18:27:45.497022 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.496810    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-data\") pod \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") "
Jul 26 18:27:45.497022 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.496836    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-credential-socket\") pod \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") "
Jul 26 18:27:45.497022 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.496882    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-envoy\") pod \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") "
Jul 26 18:27:45.497022 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.496935    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9t9f\" (UniqueName: \"kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-kube-api-access-m9t9f\") pod \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") "
Jul 26 18:27:45.497022 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.496985    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-socket\") pod \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") "
Jul 26 18:27:45.497373 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.497051    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-podinfo\") pod \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") "
Jul 26 18:27:45.497373 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.497075    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-token\") pod \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\" (UID: \"506cd376-a4af-4d60-ba63-e7ef087d6aaa\") "
Jul 26 18:27:45.497373 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.497140    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "506cd376-a4af-4d60-ba63-e7ef087d6aaa" (UID: "506cd376-a4af-4d60-ba63-e7ef087d6aaa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:27:45.497373 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.497267    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "506cd376-a4af-4d60-ba63-e7ef087d6aaa" (UID: "506cd376-a4af-4d60-ba63-e7ef087d6aaa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:27:45.497585 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.497424    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "506cd376-a4af-4d60-ba63-e7ef087d6aaa" (UID: "506cd376-a4af-4d60-ba63-e7ef087d6aaa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:27:45.497585 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.497450    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:45.497585 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.497469    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:45.497731 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.497709    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "506cd376-a4af-4d60-ba63-e7ef087d6aaa" (UID: "506cd376-a4af-4d60-ba63-e7ef087d6aaa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:27:45.497956 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.497936    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-data" (OuterVolumeSpecName: "istio-data") pod "506cd376-a4af-4d60-ba63-e7ef087d6aaa" (UID: "506cd376-a4af-4d60-ba63-e7ef087d6aaa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:27:45.499391 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.499360    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "506cd376-a4af-4d60-ba63-e7ef087d6aaa" (UID: "506cd376-a4af-4d60-ba63-e7ef087d6aaa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:27:45.499505 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.499489    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-token" (OuterVolumeSpecName: "istio-token") pod "506cd376-a4af-4d60-ba63-e7ef087d6aaa" (UID: "506cd376-a4af-4d60-ba63-e7ef087d6aaa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:27:45.499568 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.499495    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-kube-api-access-m9t9f" (OuterVolumeSpecName: "kube-api-access-m9t9f") pod "506cd376-a4af-4d60-ba63-e7ef087d6aaa" (UID: "506cd376-a4af-4d60-ba63-e7ef087d6aaa"). InnerVolumeSpecName "kube-api-access-m9t9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:27:45.499630 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.499569    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "506cd376-a4af-4d60-ba63-e7ef087d6aaa" (UID: "506cd376-a4af-4d60-ba63-e7ef087d6aaa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:27:45.598345 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.598242    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:45.598345 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.598283    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9t9f\" (UniqueName: \"kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-kube-api-access-m9t9f\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:45.598345 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.598300    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:45.598345 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.598313    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:45.598345 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.598326    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:45.598345 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.598337    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:45.598345 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:45.598349    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/506cd376-a4af-4d60-ba63-e7ef087d6aaa-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:27:46.047296 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.047258    2548 generic.go:356] "Generic (PLEG): container finished" podID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerID="94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880" exitCode=0
Jul 26 18:27:46.047728 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.047315    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"
Jul 26 18:27:46.047728 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.047340    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" event={"ID":"506cd376-a4af-4d60-ba63-e7ef087d6aaa","Type":"ContainerDied","Data":"94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880"}
Jul 26 18:27:46.047728 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.047395    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr" event={"ID":"506cd376-a4af-4d60-ba63-e7ef087d6aaa","Type":"ContainerDied","Data":"f17f0b65385971cd096c18509800fa1f0d0a05df27c2b09c65c0d8809c5f3486"}
Jul 26 18:27:46.047728 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.047417    2548 scope.go:117] "RemoveContainer" containerID="94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880"
Jul 26 18:27:46.057168 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.057146    2548 scope.go:117] "RemoveContainer" containerID="8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f"
Jul 26 18:27:46.065279 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.065261    2548 scope.go:117] "RemoveContainer" containerID="94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880"
Jul 26 18:27:46.065551 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:27:46.065531    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880\": container with ID starting with 94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880 not found: ID does not exist" containerID="94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880"
Jul 26 18:27:46.065602 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.065561    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880"} err="failed to get container status \"94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880\": rpc error: code = NotFound desc = could not find container \"94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880\": container with ID starting with 94a567be4127ea39ebb9ae7f85f700dce3ed2d14669681b36fb25ac991b12880 not found: ID does not exist"
Jul 26 18:27:46.065602 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.065578    2548 scope.go:117] "RemoveContainer" containerID="8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f"
Jul 26 18:27:46.065815 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:27:46.065797    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f\": container with ID starting with 8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f not found: ID does not exist" containerID="8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f"
Jul 26 18:27:46.065876 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.065825    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f"} err="failed to get container status \"8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f\": rpc error: code = NotFound desc = could not find container \"8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f\": container with ID starting with 8023c2fc42c2324c9152241aa6a414edc0fad4fc467110ca5b5e785d3ffd522f not found: ID does not exist"
Jul 26 18:27:46.069611 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.069587    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"]
Jul 26 18:27:46.076098 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:46.076077    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-60637c1e-openshift-default-74c6fc7798-89kkr"]
Jul 26 18:27:47.414011 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:47.413971    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" path="/var/lib/kubelet/pods/506cd376-a4af-4d60-ba63-e7ef087d6aaa/volumes"
Jul 26 18:27:51.053241 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:51.053183    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:27:57.114393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:57.114360    2548 generic.go:356] "Generic (PLEG): container finished" podID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerID="0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d" exitCode=0
Jul 26 18:27:57.114393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:57.114397    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" event={"ID":"e2ca69e2-956c-48eb-8d3a-6562f2a96dae","Type":"ContainerDied","Data":"0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d"}
Jul 26 18:27:57.114883 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:57.114752    2548 scope.go:117] "RemoveContainer" containerID="0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d"
Jul 26 18:27:57.115805 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:57.115777    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:27:57.115876 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:57.115844    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:27:57.115914 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:57.115877    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:27:58.027687 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:58.027650    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:58.121005 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:58.120964    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" event={"ID":"e2ca69e2-956c-48eb-8d3a-6562f2a96dae","Type":"ContainerStarted","Data":"9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c"}
Jul 26 18:27:58.159679 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:58.159648    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:27:58.161122 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:58.161096    2548 patch_prober.go:28] interesting pod/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 26 18:27:58.161365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:58.161325    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 26 18:27:59.159999 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:59.159966    2548 patch_prober.go:28] interesting pod/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 26 18:27:59.160641 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:27:59.160602    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 26 18:28:00.160367 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:00.160332    2548 patch_prober.go:28] interesting pod/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 26 18:28:00.160958 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:00.160927    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 26 18:28:01.160152 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:01.160114    2548 patch_prober.go:28] interesting pod/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 26 18:28:01.160369 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:01.160185    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 26 18:28:02.163363 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:02.163334    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:28:02.163784 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:02.163572    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:28:02.164293 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:02.164273    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:28:18.640740 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:18.640707    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"]
Jul 26 18:28:18.641261 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:18.641222    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc" podUID="50b765d1-e352-4a0e-8b54-f4dfff48dd04" containerName="maas-api" containerID="cri-o://a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791" gracePeriod=30
Jul 26 18:28:18.904355 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:18.904297    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:28:19.001144 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.001108    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2668t\" (UniqueName: \"kubernetes.io/projected/50b765d1-e352-4a0e-8b54-f4dfff48dd04-kube-api-access-2668t\") pod \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") "
Jul 26 18:28:19.001144 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.001142    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50b765d1-e352-4a0e-8b54-f4dfff48dd04-openshift-service-ca\") pod \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") "
Jul 26 18:28:19.001395 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.001169    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50b765d1-e352-4a0e-8b54-f4dfff48dd04-maas-api-tls\") pod \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\" (UID: \"50b765d1-e352-4a0e-8b54-f4dfff48dd04\") "
Jul 26 18:28:19.001584 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.001558    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50b765d1-e352-4a0e-8b54-f4dfff48dd04-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "50b765d1-e352-4a0e-8b54-f4dfff48dd04" (UID: "50b765d1-e352-4a0e-8b54-f4dfff48dd04"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:28:19.003235 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.003209    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50b765d1-e352-4a0e-8b54-f4dfff48dd04-kube-api-access-2668t" (OuterVolumeSpecName: "kube-api-access-2668t") pod "50b765d1-e352-4a0e-8b54-f4dfff48dd04" (UID: "50b765d1-e352-4a0e-8b54-f4dfff48dd04"). InnerVolumeSpecName "kube-api-access-2668t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:28:19.003351 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.003272    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50b765d1-e352-4a0e-8b54-f4dfff48dd04-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "50b765d1-e352-4a0e-8b54-f4dfff48dd04" (UID: "50b765d1-e352-4a0e-8b54-f4dfff48dd04"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:28:19.102119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.102090    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2668t\" (UniqueName: \"kubernetes.io/projected/50b765d1-e352-4a0e-8b54-f4dfff48dd04-kube-api-access-2668t\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:19.102119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.102115    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/50b765d1-e352-4a0e-8b54-f4dfff48dd04-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:19.102319 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.102127    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/50b765d1-e352-4a0e-8b54-f4dfff48dd04-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:19.225204 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.225123    2548 generic.go:356] "Generic (PLEG): container finished" podID="50b765d1-e352-4a0e-8b54-f4dfff48dd04" containerID="a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791" exitCode=0
Jul 26 18:28:19.225204 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.225166    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"
Jul 26 18:28:19.225352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.225222    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc" event={"ID":"50b765d1-e352-4a0e-8b54-f4dfff48dd04","Type":"ContainerDied","Data":"a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791"}
Jul 26 18:28:19.225352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.225277    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc" event={"ID":"50b765d1-e352-4a0e-8b54-f4dfff48dd04","Type":"ContainerDied","Data":"f75215170022e465cbaa028538787a8e2b2668e82911f2ba5b4477f9e19336e3"}
Jul 26 18:28:19.225352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.225309    2548 scope.go:117] "RemoveContainer" containerID="a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791"
Jul 26 18:28:19.234379 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.234362    2548 scope.go:117] "RemoveContainer" containerID="a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791"
Jul 26 18:28:19.234618 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:28:19.234598    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791\": container with ID starting with a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791 not found: ID does not exist" containerID="a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791"
Jul 26 18:28:19.234664 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.234627    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791"} err="failed to get container status \"a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791\": rpc error: code = NotFound desc = could not find container \"a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791\": container with ID starting with a2e68fb81b91935c57580e1260922d6259ba00fe2563b2e31dc5c95667312791 not found: ID does not exist"
Jul 26 18:28:19.247668 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.247638    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"]
Jul 26 18:28:19.249981 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.249961    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ded9d893-69c9576557-2xfgc"]
Jul 26 18:28:19.413552 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:19.413521    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50b765d1-e352-4a0e-8b54-f4dfff48dd04" path="/var/lib/kubelet/pods/50b765d1-e352-4a0e-8b54-f4dfff48dd04/volumes"
Jul 26 18:28:23.437001 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:23.436965    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"]
Jul 26 18:28:23.437452 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:23.437180    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy" containerID="cri-o://9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c" gracePeriod=30
Jul 26 18:28:28.695775 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.695748    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:28:28.887097 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887066    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-socket\") pod \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") "
Jul 26 18:28:28.887303 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887101    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-envoy\") pod \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") "
Jul 26 18:28:28.887303 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887131    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istiod-ca-cert\") pod \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") "
Jul 26 18:28:28.887303 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887161    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwf6r\" (UniqueName: \"kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-kube-api-access-zwf6r\") pod \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") "
Jul 26 18:28:28.887303 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887258    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-token\") pod \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") "
Jul 26 18:28:28.887535 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887328    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-podinfo\") pod \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") "
Jul 26 18:28:28.887535 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887372    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-certs\") pod \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") "
Jul 26 18:28:28.887535 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887381    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2ca69e2-956c-48eb-8d3a-6562f2a96dae" (UID: "e2ca69e2-956c-48eb-8d3a-6562f2a96dae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:28:28.887535 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887394    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-credential-socket\") pod \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") "
Jul 26 18:28:28.887535 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887423    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-data\") pod \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\" (UID: \"e2ca69e2-956c-48eb-8d3a-6562f2a96dae\") "
Jul 26 18:28:28.887785 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887584    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2ca69e2-956c-48eb-8d3a-6562f2a96dae" (UID: "e2ca69e2-956c-48eb-8d3a-6562f2a96dae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:28:28.887785 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887601    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2ca69e2-956c-48eb-8d3a-6562f2a96dae" (UID: "e2ca69e2-956c-48eb-8d3a-6562f2a96dae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:28:28.887785 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887718    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2ca69e2-956c-48eb-8d3a-6562f2a96dae" (UID: "e2ca69e2-956c-48eb-8d3a-6562f2a96dae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:28:28.887946 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887843    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:28.887946 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887865    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:28.887946 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887880    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:28.887946 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.887893    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:28.888400 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.888379    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2ca69e2-956c-48eb-8d3a-6562f2a96dae" (UID: "e2ca69e2-956c-48eb-8d3a-6562f2a96dae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:28:28.889406 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.889385    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2ca69e2-956c-48eb-8d3a-6562f2a96dae" (UID: "e2ca69e2-956c-48eb-8d3a-6562f2a96dae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:28:28.889406 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.889400    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2ca69e2-956c-48eb-8d3a-6562f2a96dae" (UID: "e2ca69e2-956c-48eb-8d3a-6562f2a96dae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:28:28.889682 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.889662    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-kube-api-access-zwf6r" (OuterVolumeSpecName: "kube-api-access-zwf6r") pod "e2ca69e2-956c-48eb-8d3a-6562f2a96dae" (UID: "e2ca69e2-956c-48eb-8d3a-6562f2a96dae"). InnerVolumeSpecName "kube-api-access-zwf6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:28:28.889748 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.889661    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2ca69e2-956c-48eb-8d3a-6562f2a96dae" (UID: "e2ca69e2-956c-48eb-8d3a-6562f2a96dae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:28:28.988504 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.988476    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:28.988504 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.988500    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:28.988663 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.988512    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:28.988663 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.988525    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwf6r\" (UniqueName: \"kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-kube-api-access-zwf6r\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:28.988663 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:28.988538    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2ca69e2-956c-48eb-8d3a-6562f2a96dae-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:28:29.274571 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.274480    2548 generic.go:356] "Generic (PLEG): container finished" podID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerID="9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c" exitCode=0
Jul 26 18:28:29.274571 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.274530    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" event={"ID":"e2ca69e2-956c-48eb-8d3a-6562f2a96dae","Type":"ContainerDied","Data":"9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c"}
Jul 26 18:28:29.274571 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.274538    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"
Jul 26 18:28:29.274571 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.274570    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs" event={"ID":"e2ca69e2-956c-48eb-8d3a-6562f2a96dae","Type":"ContainerDied","Data":"ace1b1d4be65fb138a23e8a8d3738dbfc2d1e13383c9e8ee0a777b5a0653f15c"}
Jul 26 18:28:29.274894 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.274592    2548 scope.go:117] "RemoveContainer" containerID="9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c"
Jul 26 18:28:29.283333 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.283316    2548 scope.go:117] "RemoveContainer" containerID="0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d"
Jul 26 18:28:29.290705 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.290686    2548 scope.go:117] "RemoveContainer" containerID="9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c"
Jul 26 18:28:29.290936 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:28:29.290917    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c\": container with ID starting with 9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c not found: ID does not exist" containerID="9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c"
Jul 26 18:28:29.290989 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.290945    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c"} err="failed to get container status \"9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c\": rpc error: code = NotFound desc = could not find container \"9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c\": container with ID starting with 9ee0bc5d1c624b733989f43f1cd2e731e1aadc38a21372f32e94113c973ea09c not found: ID does not exist"
Jul 26 18:28:29.290989 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.290961    2548 scope.go:117] "RemoveContainer" containerID="0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d"
Jul 26 18:28:29.291243 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:28:29.291221    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d\": container with ID starting with 0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d not found: ID does not exist" containerID="0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d"
Jul 26 18:28:29.291306 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.291247    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d"} err="failed to get container status \"0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d\": rpc error: code = NotFound desc = could not find container \"0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d\": container with ID starting with 0e47aa474b714924335405e1be74f0adfe53ca455ad8a2b6a5f3009282c2865d not found: ID does not exist"
Jul 26 18:28:29.295505 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.295485    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"]
Jul 26 18:28:29.299403 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.299382    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ded9d893-openshift-default-5574d857f6-5b4hs"]
Jul 26 18:28:29.413854 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:28:29.413827    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" path="/var/lib/kubelet/pods/e2ca69e2-956c-48eb-8d3a-6562f2a96dae/volumes"
Jul 26 18:30:00.354634 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.354600    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"]
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.354965    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.354976    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.354984    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.354990    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.355000    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.355005    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.355024    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50b765d1-e352-4a0e-8b54-f4dfff48dd04" containerName="maas-api"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.355029    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="50b765d1-e352-4a0e-8b54-f4dfff48dd04" containerName="maas-api"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.355082    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.355089    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.355096    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="506cd376-a4af-4d60-ba63-e7ef087d6aaa" containerName="istio-proxy"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.355101    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="50b765d1-e352-4a0e-8b54-f4dfff48dd04" containerName="maas-api"
Jul 26 18:30:00.355116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.355107    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy"
Jul 26 18:30:00.358583 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.358557    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.361116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.361086    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2ef7c258-openshift-default-dockercfg-hprlx\""
Jul 26 18:30:00.377796 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.377767    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"]
Jul 26 18:30:00.428307 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.428262    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-data\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.428484 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.428329    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-podinfo\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.428484 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.428385    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-certs\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.428570 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.428484    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-credential-socket\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.428570 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.428520    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2qpn\" (UniqueName: \"kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-kube-api-access-w2qpn\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.428655 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.428578    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-socket\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.428655 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.428610    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istiod-ca-cert\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.428730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.428654    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-token\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.428730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.428676    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-envoy\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.529697 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.529659    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-data\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.529697 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.529702    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-podinfo\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.529977 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.529731    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-certs\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.529977 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.529780    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-credential-socket\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.529977 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.529817    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qpn\" (UniqueName: \"kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-kube-api-access-w2qpn\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.529977 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.529929    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-socket\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.529977 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.529971    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istiod-ca-cert\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.530290 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.530015    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-token\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.530290 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.530043    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-envoy\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.530290 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.530074    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-data\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.530290 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.530156    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-credential-socket\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.530509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.530419    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-certs\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.530509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.530488    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-socket\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.530732 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.530708    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istiod-ca-cert\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.532616 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.532586    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-podinfo\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.532732 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.532699    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-envoy\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.542468 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.542444    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2qpn\" (UniqueName: \"kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-kube-api-access-w2qpn\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.542651 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.542634    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-token\") pod \"e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") " pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.669927 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.669885    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:00.832527 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.832501    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"]
Jul 26 18:30:00.834569 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:30:00.834535    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad26c9a_484f_4b66_88eb_7307498a0bfe.slice/crio-31c490b78daeb70ca78ea73fcf3d7b59d4a1a2fc468634f8627f73c99724016d WatchSource:0}: Error finding container 31c490b78daeb70ca78ea73fcf3d7b59d4a1a2fc468634f8627f73c99724016d: Status 404 returned error can't find the container with id 31c490b78daeb70ca78ea73fcf3d7b59d4a1a2fc468634f8627f73c99724016d
Jul 26 18:30:00.836825 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.836796    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:30:00.836914 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.836862    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:30:00.836914 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:00.836891    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:30:01.707055 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:01.707016    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" event={"ID":"4ad26c9a-484f-4b66-88eb-7307498a0bfe","Type":"ContainerStarted","Data":"3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f"}
Jul 26 18:30:01.707495 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:01.707073    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" event={"ID":"4ad26c9a-484f-4b66-88eb-7307498a0bfe","Type":"ContainerStarted","Data":"31c490b78daeb70ca78ea73fcf3d7b59d4a1a2fc468634f8627f73c99724016d"}
Jul 26 18:30:01.734040 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:01.733975    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" podStartSLOduration=1.733959122 podStartE2EDuration="1.733959122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:30:01.731490516 +0000 UTC m=+1958.831743435" watchObservedRunningTime="2026-07-26 18:30:01.733959122 +0000 UTC m=+1958.834212007"
Jul 26 18:30:02.670969 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:02.670925    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:02.676171 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:02.676143    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:02.719801 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:02.719762    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:02.720888 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:02.720859    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:03.911425 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:03.911390    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"]
Jul 26 18:30:03.911993 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:03.911973    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy"
Jul 26 18:30:03.912069 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:03.911996    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2ca69e2-956c-48eb-8d3a-6562f2a96dae" containerName="istio-proxy"
Jul 26 18:30:03.915780 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:03.915755    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:03.918274 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:03.918254    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2ef7c258-serving-cert\""
Jul 26 18:30:03.928026 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:03.928002    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"]
Jul 26 18:30:03.966021 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:03.965986    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qks\" (UniqueName: \"kubernetes.io/projected/b3aea27e-469a-4cee-8398-916c8fe70498-kube-api-access-n7qks\") pod \"maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:03.966239 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:03.966033    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3aea27e-469a-4cee-8398-916c8fe70498-openshift-service-ca\") pod \"maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:03.966239 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:03.966118    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3aea27e-469a-4cee-8398-916c8fe70498-maas-api-tls\") pod \"maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:04.067619 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:04.067584    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qks\" (UniqueName: \"kubernetes.io/projected/b3aea27e-469a-4cee-8398-916c8fe70498-kube-api-access-n7qks\") pod \"maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:04.067819 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:04.067633    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3aea27e-469a-4cee-8398-916c8fe70498-openshift-service-ca\") pod \"maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:04.067819 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:04.067675    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3aea27e-469a-4cee-8398-916c8fe70498-maas-api-tls\") pod \"maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:04.067819 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:30:04.067814    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-serving-cert: secret "maas-api-e2e-mt-2ef7c258-serving-cert" not found
Jul 26 18:30:04.067953 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:30:04.067869    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3aea27e-469a-4cee-8398-916c8fe70498-maas-api-tls podName:b3aea27e-469a-4cee-8398-916c8fe70498 nodeName:}" failed. No retries permitted until 2026-07-26 18:30:04.56785162 +0000 UTC m=+1961.668104501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b3aea27e-469a-4cee-8398-916c8fe70498-maas-api-tls") pod "maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf" (UID: "b3aea27e-469a-4cee-8398-916c8fe70498") : secret "maas-api-e2e-mt-2ef7c258-serving-cert" not found
Jul 26 18:30:04.068496 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:04.068474    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3aea27e-469a-4cee-8398-916c8fe70498-openshift-service-ca\") pod \"maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:04.079839 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:04.079805    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7qks\" (UniqueName: \"kubernetes.io/projected/b3aea27e-469a-4cee-8398-916c8fe70498-kube-api-access-n7qks\") pod \"maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:04.573387 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:04.573343    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3aea27e-469a-4cee-8398-916c8fe70498-maas-api-tls\") pod \"maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:04.576155 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:04.576124    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3aea27e-469a-4cee-8398-916c8fe70498-maas-api-tls\") pod \"maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:04.827776 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:04.827682    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:04.987322 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:04.987289    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"]
Jul 26 18:30:04.990888 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:30:04.989873    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3aea27e_469a_4cee_8398_916c8fe70498.slice/crio-a5123c2e913e2a6aaa5980a9a28c0494d20a40ddd904dab0e2ed6ccbd94f1afc WatchSource:0}: Error finding container a5123c2e913e2a6aaa5980a9a28c0494d20a40ddd904dab0e2ed6ccbd94f1afc: Status 404 returned error can't find the container with id a5123c2e913e2a6aaa5980a9a28c0494d20a40ddd904dab0e2ed6ccbd94f1afc
Jul 26 18:30:05.738245 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:05.738185    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf" event={"ID":"b3aea27e-469a-4cee-8398-916c8fe70498","Type":"ContainerStarted","Data":"a5123c2e913e2a6aaa5980a9a28c0494d20a40ddd904dab0e2ed6ccbd94f1afc"}
Jul 26 18:30:06.744711 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:06.744673    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf" event={"ID":"b3aea27e-469a-4cee-8398-916c8fe70498","Type":"ContainerStarted","Data":"faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce"}
Jul 26 18:30:06.745238 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:06.745120    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:06.765467 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:06.765411    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf" podStartSLOduration=2.9259630359999997 podStartE2EDuration="3.765371764s" totalImagesPullingTime="839.408728ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:30:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:30:06.764684765 +0000 UTC m=+1963.864937653" watchObservedRunningTime="2026-07-26 18:30:06.765371764 +0000 UTC m=+1963.865624649"
Jul 26 18:30:12.755342 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:12.755247    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:17.990931 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:17.989919    2548 patch_prober.go:28] interesting pod/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:39684->10.133.0.56:15021: read: connection reset by peer" start-of-body=
Jul 26 18:30:17.990931 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:17.990007    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:39684->10.133.0.56:15021: read: connection reset by peer"
Jul 26 18:30:18.812411 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:18.812373    2548 generic.go:356] "Generic (PLEG): container finished" podID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerID="3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f" exitCode=0
Jul 26 18:30:18.812597 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:18.812448    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" event={"ID":"4ad26c9a-484f-4b66-88eb-7307498a0bfe","Type":"ContainerDied","Data":"3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f"}
Jul 26 18:30:18.812943 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:18.812926    2548 scope.go:117] "RemoveContainer" containerID="3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f"
Jul 26 18:30:18.814018 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:18.813990    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:30:18.814096 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:18.814076    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:30:18.814158 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:18.814124    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:30:19.819653 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:19.819618    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" event={"ID":"4ad26c9a-484f-4b66-88eb-7307498a0bfe","Type":"ContainerStarted","Data":"d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f"}
Jul 26 18:30:20.670866 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:20.670824    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:20.671318 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:20.671227    2548 patch_prober.go:28] interesting pod/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 26 18:30:20.671515 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:20.671489    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 26 18:30:21.671136 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:21.671096    2548 patch_prober.go:28] interesting pod/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 26 18:30:21.671762 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:21.671723    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 26 18:30:22.670814 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:22.670772    2548 patch_prober.go:28] interesting pod/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 26 18:30:22.671143 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:22.671109    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 26 18:30:23.670742 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:23.670696    2548 patch_prober.go:28] interesting pod/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 26 18:30:23.671164 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:23.670794    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 26 18:30:24.674365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:24.674335    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:24.674797 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:24.674694    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:24.675535 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:24.675515    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:25.467855 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.467818    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"]
Jul 26 18:30:25.468051 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.468030    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf" podUID="b3aea27e-469a-4cee-8398-916c8fe70498" containerName="maas-api" containerID="cri-o://faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce" gracePeriod=30
Jul 26 18:30:25.726713 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.726584    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:25.851356 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.851315    2548 generic.go:356] "Generic (PLEG): container finished" podID="b3aea27e-469a-4cee-8398-916c8fe70498" containerID="faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce" exitCode=0
Jul 26 18:30:25.851528 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.851380    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"
Jul 26 18:30:25.851528 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.851399    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf" event={"ID":"b3aea27e-469a-4cee-8398-916c8fe70498","Type":"ContainerDied","Data":"faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce"}
Jul 26 18:30:25.851528 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.851456    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf" event={"ID":"b3aea27e-469a-4cee-8398-916c8fe70498","Type":"ContainerDied","Data":"a5123c2e913e2a6aaa5980a9a28c0494d20a40ddd904dab0e2ed6ccbd94f1afc"}
Jul 26 18:30:25.851528 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.851484    2548 scope.go:117] "RemoveContainer" containerID="faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce"
Jul 26 18:30:25.861619 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.861593    2548 scope.go:117] "RemoveContainer" containerID="faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce"
Jul 26 18:30:25.861982 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:30:25.861955    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce\": container with ID starting with faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce not found: ID does not exist" containerID="faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce"
Jul 26 18:30:25.862076 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.861996    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce"} err="failed to get container status \"faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce\": rpc error: code = NotFound desc = could not find container \"faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce\": container with ID starting with faa1b0dc0ffc8572d6afd05bac0eed5d00ab39713b5a18e67b019cf84d8311ce not found: ID does not exist"
Jul 26 18:30:25.899492 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.899461    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3aea27e-469a-4cee-8398-916c8fe70498-maas-api-tls\") pod \"b3aea27e-469a-4cee-8398-916c8fe70498\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") "
Jul 26 18:30:25.899657 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.899548    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7qks\" (UniqueName: \"kubernetes.io/projected/b3aea27e-469a-4cee-8398-916c8fe70498-kube-api-access-n7qks\") pod \"b3aea27e-469a-4cee-8398-916c8fe70498\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") "
Jul 26 18:30:25.899657 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.899578    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3aea27e-469a-4cee-8398-916c8fe70498-openshift-service-ca\") pod \"b3aea27e-469a-4cee-8398-916c8fe70498\" (UID: \"b3aea27e-469a-4cee-8398-916c8fe70498\") "
Jul 26 18:30:25.899993 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.899968    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3aea27e-469a-4cee-8398-916c8fe70498-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b3aea27e-469a-4cee-8398-916c8fe70498" (UID: "b3aea27e-469a-4cee-8398-916c8fe70498"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:30:25.901521 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.901499    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3aea27e-469a-4cee-8398-916c8fe70498-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b3aea27e-469a-4cee-8398-916c8fe70498" (UID: "b3aea27e-469a-4cee-8398-916c8fe70498"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:30:25.901630 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:25.901603    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3aea27e-469a-4cee-8398-916c8fe70498-kube-api-access-n7qks" (OuterVolumeSpecName: "kube-api-access-n7qks") pod "b3aea27e-469a-4cee-8398-916c8fe70498" (UID: "b3aea27e-469a-4cee-8398-916c8fe70498"). InnerVolumeSpecName "kube-api-access-n7qks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:30:26.000627 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:26.000505    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7qks\" (UniqueName: \"kubernetes.io/projected/b3aea27e-469a-4cee-8398-916c8fe70498-kube-api-access-n7qks\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:26.000627 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:26.000544    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3aea27e-469a-4cee-8398-916c8fe70498-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:26.000627 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:26.000561    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b3aea27e-469a-4cee-8398-916c8fe70498-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:26.176937 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:26.176898    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"]
Jul 26 18:30:26.182792 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:26.182752    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2ef7c258-59d6db7677-mfjkf"]
Jul 26 18:30:27.414429 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:27.414392    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3aea27e-469a-4cee-8398-916c8fe70498" path="/var/lib/kubelet/pods/b3aea27e-469a-4cee-8398-916c8fe70498/volumes"
Jul 26 18:30:37.002448 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:37.002412    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"]
Jul 26 18:30:37.002988 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:37.002631    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy" containerID="cri-o://d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f" gracePeriod=30
Jul 26 18:30:39.677861 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:39.677823    2548 patch_prober.go:28] interesting pod/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 18:30:39.678278 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:39.677897    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 18:30:42.272306 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.272237    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:42.352057 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352023    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-podinfo\") pod \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") "
Jul 26 18:30:42.352057 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352064    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-socket\") pod \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") "
Jul 26 18:30:42.352341 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352088    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-data\") pod \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") "
Jul 26 18:30:42.352341 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352131    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istiod-ca-cert\") pod \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") "
Jul 26 18:30:42.352341 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352154    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-certs\") pod \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") "
Jul 26 18:30:42.352341 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352228    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-credential-socket\") pod \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") "
Jul 26 18:30:42.352341 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352278    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-envoy\") pod \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") "
Jul 26 18:30:42.352341 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352306    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-token\") pod \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") "
Jul 26 18:30:42.352341 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352332    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2qpn\" (UniqueName: \"kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-kube-api-access-w2qpn\") pod \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\" (UID: \"4ad26c9a-484f-4b66-88eb-7307498a0bfe\") "
Jul 26 18:30:42.352714 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352459    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ad26c9a-484f-4b66-88eb-7307498a0bfe" (UID: "4ad26c9a-484f-4b66-88eb-7307498a0bfe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:30:42.352714 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352554    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ad26c9a-484f-4b66-88eb-7307498a0bfe" (UID: "4ad26c9a-484f-4b66-88eb-7307498a0bfe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:30:42.352714 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352634    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ad26c9a-484f-4b66-88eb-7307498a0bfe" (UID: "4ad26c9a-484f-4b66-88eb-7307498a0bfe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:30:42.352714 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352650    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ad26c9a-484f-4b66-88eb-7307498a0bfe" (UID: "4ad26c9a-484f-4b66-88eb-7307498a0bfe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:30:42.352923 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352824    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:42.352923 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352844    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:42.352923 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352860    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:42.352923 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.352873    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:42.353215 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.353171    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ad26c9a-484f-4b66-88eb-7307498a0bfe" (UID: "4ad26c9a-484f-4b66-88eb-7307498a0bfe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:30:42.354420 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.354397    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ad26c9a-484f-4b66-88eb-7307498a0bfe" (UID: "4ad26c9a-484f-4b66-88eb-7307498a0bfe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:30:42.354628 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.354591    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ad26c9a-484f-4b66-88eb-7307498a0bfe" (UID: "4ad26c9a-484f-4b66-88eb-7307498a0bfe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:30:42.354730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.354673    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ad26c9a-484f-4b66-88eb-7307498a0bfe" (UID: "4ad26c9a-484f-4b66-88eb-7307498a0bfe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:30:42.354730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.354694    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-kube-api-access-w2qpn" (OuterVolumeSpecName: "kube-api-access-w2qpn") pod "4ad26c9a-484f-4b66-88eb-7307498a0bfe" (UID: "4ad26c9a-484f-4b66-88eb-7307498a0bfe"). InnerVolumeSpecName "kube-api-access-w2qpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:30:42.454381 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.454339    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:42.454381 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.454371    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:42.454381 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.454384    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2qpn\" (UniqueName: \"kubernetes.io/projected/4ad26c9a-484f-4b66-88eb-7307498a0bfe-kube-api-access-w2qpn\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:42.454630 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.454396    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:42.454630 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.454408    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad26c9a-484f-4b66-88eb-7307498a0bfe-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:30:42.943467 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.943429    2548 generic.go:356] "Generic (PLEG): container finished" podID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerID="d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f" exitCode=0
Jul 26 18:30:42.943643 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.943480    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"
Jul 26 18:30:42.943643 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.943496    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" event={"ID":"4ad26c9a-484f-4b66-88eb-7307498a0bfe","Type":"ContainerDied","Data":"d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f"}
Jul 26 18:30:42.943643 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.943539    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl" event={"ID":"4ad26c9a-484f-4b66-88eb-7307498a0bfe","Type":"ContainerDied","Data":"31c490b78daeb70ca78ea73fcf3d7b59d4a1a2fc468634f8627f73c99724016d"}
Jul 26 18:30:42.943643 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.943562    2548 scope.go:117] "RemoveContainer" containerID="d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f"
Jul 26 18:30:42.952482 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.952462    2548 scope.go:117] "RemoveContainer" containerID="3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f"
Jul 26 18:30:42.960463 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.960445    2548 scope.go:117] "RemoveContainer" containerID="d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f"
Jul 26 18:30:42.960730 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:30:42.960709    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f\": container with ID starting with d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f not found: ID does not exist" containerID="d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f"
Jul 26 18:30:42.960775 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.960739    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f"} err="failed to get container status \"d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f\": rpc error: code = NotFound desc = could not find container \"d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f\": container with ID starting with d4e4a3bb56005732dffae741998e039fbbc9a692a6b05c15c5b06ec7fb9aab1f not found: ID does not exist"
Jul 26 18:30:42.960775 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.960756    2548 scope.go:117] "RemoveContainer" containerID="3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f"
Jul 26 18:30:42.961003 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:30:42.960986    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f\": container with ID starting with 3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f not found: ID does not exist" containerID="3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f"
Jul 26 18:30:42.961040 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.961011    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f"} err="failed to get container status \"3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f\": rpc error: code = NotFound desc = could not find container \"3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f\": container with ID starting with 3204739178c7d988e4c311a487a0cfba5330f1a7ad7b39e55c14080648c7203f not found: ID does not exist"
Jul 26 18:30:42.966229 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.966206    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"]
Jul 26 18:30:42.969679 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:42.969655    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2ef7c258-openshift-default-67cdb4778d-7l5tl"]
Jul 26 18:30:43.414660 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:43.414627    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" path="/var/lib/kubelet/pods/4ad26c9a-484f-4b66-88eb-7307498a0bfe/volumes"
Jul 26 18:30:57.099637 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.099598    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"]
Jul 26 18:30:57.100043 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.100009    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy"
Jul 26 18:30:57.100043 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.100021    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy"
Jul 26 18:30:57.100043 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.100033    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3aea27e-469a-4cee-8398-916c8fe70498" containerName="maas-api"
Jul 26 18:30:57.100043 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.100039    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3aea27e-469a-4cee-8398-916c8fe70498" containerName="maas-api"
Jul 26 18:30:57.100180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.100120    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy"
Jul 26 18:30:57.100180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.100128    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3aea27e-469a-4cee-8398-916c8fe70498" containerName="maas-api"
Jul 26 18:30:57.100180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.100134    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy"
Jul 26 18:30:57.103421 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.103401    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.106668 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.106639    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3a0f87c2-openshift-default-dockercfg-7vjrs\""
Jul 26 18:30:57.128581 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.128547    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"]
Jul 26 18:30:57.205783 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.205726    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-certs\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.205993 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.205808    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-socket\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.205993 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.205841    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-credential-socket\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.205993 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.205904    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxlkh\" (UniqueName: \"kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-kube-api-access-vxlkh\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.206137 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.206009    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73898758-f57f-4ed0-bb93-cefc66621742-istio-podinfo\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.206137 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.206111    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-envoy\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.206238 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.206157    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-istio-token\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.206238 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.206212    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-data\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.206344 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.206278    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73898758-f57f-4ed0-bb93-cefc66621742-istiod-ca-cert\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307150 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307103    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-istio-token\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307158    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-data\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307187    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73898758-f57f-4ed0-bb93-cefc66621742-istiod-ca-cert\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307231    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-certs\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307271    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-socket\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307296    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-credential-socket\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307325    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxlkh\" (UniqueName: \"kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-kube-api-access-vxlkh\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307373    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73898758-f57f-4ed0-bb93-cefc66621742-istio-podinfo\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307769 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307449    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-envoy\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307769 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307615    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-data\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307769 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307641    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-socket\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307769 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307736    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-certs\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.307976 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.307871    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-credential-socket\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.308086 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.308045    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73898758-f57f-4ed0-bb93-cefc66621742-istiod-ca-cert\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.309937 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.309907    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-envoy\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.310081 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.310065    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73898758-f57f-4ed0-bb93-cefc66621742-istio-podinfo\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.315753 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.315714    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-istio-token\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.315896 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.315772    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxlkh\" (UniqueName: \"kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-kube-api-access-vxlkh\") pod \"e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") " pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.414164 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.414129    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:57.574709 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.574680    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"]
Jul 26 18:30:57.576472 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:30:57.576442    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73898758_f57f_4ed0_bb93_cefc66621742.slice/crio-97b844f4fc638c260067f2dfb9fcdb1e8a21a2a48eb6adac6f441a390b72d552 WatchSource:0}: Error finding container 97b844f4fc638c260067f2dfb9fcdb1e8a21a2a48eb6adac6f441a390b72d552: Status 404 returned error can't find the container with id 97b844f4fc638c260067f2dfb9fcdb1e8a21a2a48eb6adac6f441a390b72d552
Jul 26 18:30:57.578643 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.578610    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:30:57.578725 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.578681    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:30:57.578725 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:57.578713    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:30:58.029530 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:58.029483    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" event={"ID":"73898758-f57f-4ed0-bb93-cefc66621742","Type":"ContainerStarted","Data":"d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb"}
Jul 26 18:30:58.029723 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:58.029563    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" event={"ID":"73898758-f57f-4ed0-bb93-cefc66621742","Type":"ContainerStarted","Data":"97b844f4fc638c260067f2dfb9fcdb1e8a21a2a48eb6adac6f441a390b72d552"}
Jul 26 18:30:58.054096 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:58.054039    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" podStartSLOduration=1.054023481 podStartE2EDuration="1.054023481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:30:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:30:58.052326814 +0000 UTC m=+2015.152579724" watchObservedRunningTime="2026-07-26 18:30:58.054023481 +0000 UTC m=+2015.154276367"
Jul 26 18:30:58.414581 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:58.414535    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:58.419636 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:58.419606    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:59.034410 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:59.034376    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:30:59.035685 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:30:59.035657    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:31:00.047058 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.047015    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"]
Jul 26 18:31:00.047583 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.047540    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy"
Jul 26 18:31:00.047583 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.047560    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad26c9a-484f-4b66-88eb-7307498a0bfe" containerName="istio-proxy"
Jul 26 18:31:00.050762 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.050739    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.053173 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.053144    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3a0f87c2-serving-cert\""
Jul 26 18:31:00.061981 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.061948    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"]
Jul 26 18:31:00.138666 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.138621    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/931533ab-3466-4bd2-a990-87c275a98eb1-maas-api-tls\") pod \"maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.138901 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.138722    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/931533ab-3466-4bd2-a990-87c275a98eb1-openshift-service-ca\") pod \"maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.138901 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.138745    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86fgx\" (UniqueName: \"kubernetes.io/projected/931533ab-3466-4bd2-a990-87c275a98eb1-kube-api-access-86fgx\") pod \"maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.239527 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.239482    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86fgx\" (UniqueName: \"kubernetes.io/projected/931533ab-3466-4bd2-a990-87c275a98eb1-kube-api-access-86fgx\") pod \"maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.239710 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.239587    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/931533ab-3466-4bd2-a990-87c275a98eb1-maas-api-tls\") pod \"maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.239710 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.239683    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/931533ab-3466-4bd2-a990-87c275a98eb1-openshift-service-ca\") pod \"maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.239857 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:31:00.239729    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-serving-cert: secret "maas-api-e2e-mt-3a0f87c2-serving-cert" not found
Jul 26 18:31:00.239857 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:31:00.239797    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/931533ab-3466-4bd2-a990-87c275a98eb1-maas-api-tls podName:931533ab-3466-4bd2-a990-87c275a98eb1 nodeName:}" failed. No retries permitted until 2026-07-26 18:31:00.739781817 +0000 UTC m=+2017.840034684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/931533ab-3466-4bd2-a990-87c275a98eb1-maas-api-tls") pod "maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs" (UID: "931533ab-3466-4bd2-a990-87c275a98eb1") : secret "maas-api-e2e-mt-3a0f87c2-serving-cert" not found
Jul 26 18:31:00.240459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.240439    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/931533ab-3466-4bd2-a990-87c275a98eb1-openshift-service-ca\") pod \"maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.248491 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.248446    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86fgx\" (UniqueName: \"kubernetes.io/projected/931533ab-3466-4bd2-a990-87c275a98eb1-kube-api-access-86fgx\") pod \"maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.746096 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.746052    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/931533ab-3466-4bd2-a990-87c275a98eb1-maas-api-tls\") pod \"maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.749151 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.749123    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/931533ab-3466-4bd2-a990-87c275a98eb1-maas-api-tls\") pod \"maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:00.965926 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:00.965888    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:01.120250 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:01.120216    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"]
Jul 26 18:31:01.123948 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:31:01.123917    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931533ab_3466_4bd2_a990_87c275a98eb1.slice/crio-0442c37ac448234a2dfb9c8caecb4c3d7d758c75a5b7ba4b3da1d7e1dfb51202 WatchSource:0}: Error finding container 0442c37ac448234a2dfb9c8caecb4c3d7d758c75a5b7ba4b3da1d7e1dfb51202: Status 404 returned error can't find the container with id 0442c37ac448234a2dfb9c8caecb4c3d7d758c75a5b7ba4b3da1d7e1dfb51202
Jul 26 18:31:01.125489 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:01.125472    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 18:31:02.054431 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:02.054391    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs" event={"ID":"931533ab-3466-4bd2-a990-87c275a98eb1","Type":"ContainerStarted","Data":"82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0"}
Jul 26 18:31:02.054634 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:02.054458    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs" event={"ID":"931533ab-3466-4bd2-a990-87c275a98eb1","Type":"ContainerStarted","Data":"0442c37ac448234a2dfb9c8caecb4c3d7d758c75a5b7ba4b3da1d7e1dfb51202"}
Jul 26 18:31:02.054634 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:02.054486    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:02.075764 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:02.075695    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs" podStartSLOduration=1.5931348779999999 podStartE2EDuration="2.075666583s" totalImagesPullingTime="482.531705ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:31:02.072643484 +0000 UTC m=+2019.172896394" watchObservedRunningTime="2026-07-26 18:31:02.075666583 +0000 UTC m=+2019.175919471"
Jul 26 18:31:08.071928 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:08.071883    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:31:14.036696 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:14.036650    2548 patch_prober.go:28] interesting pod/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 26 18:31:14.037137 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:14.036720    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 26 18:31:14.127821 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:14.127783    2548 generic.go:356] "Generic (PLEG): container finished" podID="73898758-f57f-4ed0-bb93-cefc66621742" containerID="d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb" exitCode=0
Jul 26 18:31:14.128026 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:14.127856    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" event={"ID":"73898758-f57f-4ed0-bb93-cefc66621742","Type":"ContainerDied","Data":"d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb"}
Jul 26 18:31:14.128383 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:14.128366    2548 scope.go:117] "RemoveContainer" containerID="d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb"
Jul 26 18:31:14.129468 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:14.129440    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:31:14.129535 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:14.129513    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:31:14.129573 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:14.129548    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:31:15.134850 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:15.134814    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" event={"ID":"73898758-f57f-4ed0-bb93-cefc66621742","Type":"ContainerStarted","Data":"bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d"}
Jul 26 18:31:15.414666 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:15.414580    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:31:15.414819 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:15.414767    2548 patch_prober.go:28] interesting pod/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 26 18:31:15.414862 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:15.414811    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 26 18:31:16.415086 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:16.415051    2548 patch_prober.go:28] interesting pod/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 26 18:31:16.415545 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:16.415107    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 26 18:31:17.414557 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:17.414517    2548 patch_prober.go:28] interesting pod/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 26 18:31:17.414753 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:17.414586    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 26 18:31:18.415033 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:18.414993    2548 patch_prober.go:28] interesting pod/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 26 18:31:18.415491 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:18.415053    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 26 18:31:19.418601 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:19.418569    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:31:19.419061 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:19.418834    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:31:19.419580 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:31:19.419561    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:32:14.832726 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:14.832691    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"]
Jul 26 18:32:14.833299 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:14.833022    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs" podUID="931533ab-3466-4bd2-a990-87c275a98eb1" containerName="maas-api" containerID="cri-o://82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0" gracePeriod=30
Jul 26 18:32:15.100548 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.100478    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:32:15.170293 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.170248    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/931533ab-3466-4bd2-a990-87c275a98eb1-openshift-service-ca\") pod \"931533ab-3466-4bd2-a990-87c275a98eb1\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") "
Jul 26 18:32:15.170481 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.170328    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/931533ab-3466-4bd2-a990-87c275a98eb1-maas-api-tls\") pod \"931533ab-3466-4bd2-a990-87c275a98eb1\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") "
Jul 26 18:32:15.170481 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.170366    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86fgx\" (UniqueName: \"kubernetes.io/projected/931533ab-3466-4bd2-a990-87c275a98eb1-kube-api-access-86fgx\") pod \"931533ab-3466-4bd2-a990-87c275a98eb1\" (UID: \"931533ab-3466-4bd2-a990-87c275a98eb1\") "
Jul 26 18:32:15.170672 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.170648    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/931533ab-3466-4bd2-a990-87c275a98eb1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "931533ab-3466-4bd2-a990-87c275a98eb1" (UID: "931533ab-3466-4bd2-a990-87c275a98eb1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:32:15.172400 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.172374    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/931533ab-3466-4bd2-a990-87c275a98eb1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "931533ab-3466-4bd2-a990-87c275a98eb1" (UID: "931533ab-3466-4bd2-a990-87c275a98eb1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:32:15.172548 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.172522    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/931533ab-3466-4bd2-a990-87c275a98eb1-kube-api-access-86fgx" (OuterVolumeSpecName: "kube-api-access-86fgx") pod "931533ab-3466-4bd2-a990-87c275a98eb1" (UID: "931533ab-3466-4bd2-a990-87c275a98eb1"). InnerVolumeSpecName "kube-api-access-86fgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:32:15.271881 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.271841    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/931533ab-3466-4bd2-a990-87c275a98eb1-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:32:15.271881 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.271880    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/931533ab-3466-4bd2-a990-87c275a98eb1-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:32:15.272122 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.271896    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86fgx\" (UniqueName: \"kubernetes.io/projected/931533ab-3466-4bd2-a990-87c275a98eb1-kube-api-access-86fgx\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:32:15.444574 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.444536    2548 generic.go:356] "Generic (PLEG): container finished" podID="931533ab-3466-4bd2-a990-87c275a98eb1" containerID="82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0" exitCode=0
Jul 26 18:32:15.444776 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.444606    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"
Jul 26 18:32:15.444776 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.444615    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs" event={"ID":"931533ab-3466-4bd2-a990-87c275a98eb1","Type":"ContainerDied","Data":"82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0"}
Jul 26 18:32:15.444776 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.444703    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs" event={"ID":"931533ab-3466-4bd2-a990-87c275a98eb1","Type":"ContainerDied","Data":"0442c37ac448234a2dfb9c8caecb4c3d7d758c75a5b7ba4b3da1d7e1dfb51202"}
Jul 26 18:32:15.444776 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.444726    2548 scope.go:117] "RemoveContainer" containerID="82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0"
Jul 26 18:32:15.453254 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.453236    2548 scope.go:117] "RemoveContainer" containerID="82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0"
Jul 26 18:32:15.453524 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:32:15.453505    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0\": container with ID starting with 82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0 not found: ID does not exist" containerID="82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0"
Jul 26 18:32:15.453573 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.453531    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0"} err="failed to get container status \"82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0\": rpc error: code = NotFound desc = could not find container \"82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0\": container with ID starting with 82e3df94c0d95b638e6fba96fa94266c1c6838c27560589dd5e47ae5e88ec3b0 not found: ID does not exist"
Jul 26 18:32:15.460665 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.460636    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"]
Jul 26 18:32:15.464757 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:15.464731    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3a0f87c2-db5d7db85-2j6cs"]
Jul 26 18:32:17.414024 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:32:17.413986    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="931533ab-3466-4bd2-a990-87c275a98eb1" path="/var/lib/kubelet/pods/931533ab-3466-4bd2-a990-87c275a98eb1/volumes"
Jul 26 18:33:16.822173 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:16.822086    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"]
Jul 26 18:33:16.822684 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:16.822344    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy" containerID="cri-o://bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d" gracePeriod=30
Jul 26 18:33:19.421608 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:19.421571    2548 patch_prober.go:28] interesting pod/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 18:33:19.421979 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:19.421645    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 18:33:22.081911 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.081853    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:33:22.204813 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.204782    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-envoy\") pod \"73898758-f57f-4ed0-bb93-cefc66621742\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") "
Jul 26 18:33:22.205002 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.204848    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-certs\") pod \"73898758-f57f-4ed0-bb93-cefc66621742\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") "
Jul 26 18:33:22.205002 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.204871    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-data\") pod \"73898758-f57f-4ed0-bb93-cefc66621742\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") "
Jul 26 18:33:22.205002 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.204903    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73898758-f57f-4ed0-bb93-cefc66621742-istio-podinfo\") pod \"73898758-f57f-4ed0-bb93-cefc66621742\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") "
Jul 26 18:33:22.205002 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.204925    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-credential-socket\") pod \"73898758-f57f-4ed0-bb93-cefc66621742\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") "
Jul 26 18:33:22.205002 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.204977    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-socket\") pod \"73898758-f57f-4ed0-bb93-cefc66621742\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") "
Jul 26 18:33:22.205002 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.205002    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-istio-token\") pod \"73898758-f57f-4ed0-bb93-cefc66621742\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") "
Jul 26 18:33:22.205371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.205050    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxlkh\" (UniqueName: \"kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-kube-api-access-vxlkh\") pod \"73898758-f57f-4ed0-bb93-cefc66621742\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") "
Jul 26 18:33:22.205371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.205083    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73898758-f57f-4ed0-bb93-cefc66621742-istiod-ca-cert\") pod \"73898758-f57f-4ed0-bb93-cefc66621742\" (UID: \"73898758-f57f-4ed0-bb93-cefc66621742\") "
Jul 26 18:33:22.205371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.205108    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73898758-f57f-4ed0-bb93-cefc66621742" (UID: "73898758-f57f-4ed0-bb93-cefc66621742"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:33:22.205371 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.205307    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73898758-f57f-4ed0-bb93-cefc66621742" (UID: "73898758-f57f-4ed0-bb93-cefc66621742"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:33:22.205590 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.205404    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:33:22.205590 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.205425    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:33:22.205700 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.205608    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73898758-f57f-4ed0-bb93-cefc66621742" (UID: "73898758-f57f-4ed0-bb93-cefc66621742"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:33:22.205700 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.205620    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73898758-f57f-4ed0-bb93-cefc66621742-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73898758-f57f-4ed0-bb93-cefc66621742" (UID: "73898758-f57f-4ed0-bb93-cefc66621742"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:33:22.205964 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.205935    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-data" (OuterVolumeSpecName: "istio-data") pod "73898758-f57f-4ed0-bb93-cefc66621742" (UID: "73898758-f57f-4ed0-bb93-cefc66621742"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:33:22.207212 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.207171    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73898758-f57f-4ed0-bb93-cefc66621742" (UID: "73898758-f57f-4ed0-bb93-cefc66621742"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:33:22.207319 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.207186    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73898758-f57f-4ed0-bb93-cefc66621742-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73898758-f57f-4ed0-bb93-cefc66621742" (UID: "73898758-f57f-4ed0-bb93-cefc66621742"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:33:22.207319 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.207184    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-istio-token" (OuterVolumeSpecName: "istio-token") pod "73898758-f57f-4ed0-bb93-cefc66621742" (UID: "73898758-f57f-4ed0-bb93-cefc66621742"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:33:22.207319 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.207235    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-kube-api-access-vxlkh" (OuterVolumeSpecName: "kube-api-access-vxlkh") pod "73898758-f57f-4ed0-bb93-cefc66621742" (UID: "73898758-f57f-4ed0-bb93-cefc66621742"). InnerVolumeSpecName "kube-api-access-vxlkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:33:22.306579 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.306552    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:33:22.306579 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.306574    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:33:22.306579 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.306583    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxlkh\" (UniqueName: \"kubernetes.io/projected/73898758-f57f-4ed0-bb93-cefc66621742-kube-api-access-vxlkh\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:33:22.306771 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.306592    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73898758-f57f-4ed0-bb93-cefc66621742-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:33:22.306771 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.306601    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:33:22.306771 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.306608    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73898758-f57f-4ed0-bb93-cefc66621742-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:33:22.306771 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.306615    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73898758-f57f-4ed0-bb93-cefc66621742-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:33:22.781413 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.781373    2548 generic.go:356] "Generic (PLEG): container finished" podID="73898758-f57f-4ed0-bb93-cefc66621742" containerID="bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d" exitCode=0
Jul 26 18:33:22.781413 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.781400    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" event={"ID":"73898758-f57f-4ed0-bb93-cefc66621742","Type":"ContainerDied","Data":"bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d"}
Jul 26 18:33:22.781654 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.781423    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"
Jul 26 18:33:22.781654 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.781460    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n" event={"ID":"73898758-f57f-4ed0-bb93-cefc66621742","Type":"ContainerDied","Data":"97b844f4fc638c260067f2dfb9fcdb1e8a21a2a48eb6adac6f441a390b72d552"}
Jul 26 18:33:22.781654 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.781484    2548 scope.go:117] "RemoveContainer" containerID="bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d"
Jul 26 18:33:22.791284 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.791265    2548 scope.go:117] "RemoveContainer" containerID="d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb"
Jul 26 18:33:22.798898 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.798880    2548 scope.go:117] "RemoveContainer" containerID="bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d"
Jul 26 18:33:22.799124 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:33:22.799107    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d\": container with ID starting with bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d not found: ID does not exist" containerID="bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d"
Jul 26 18:33:22.799172 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.799132    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d"} err="failed to get container status \"bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d\": rpc error: code = NotFound desc = could not find container \"bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d\": container with ID starting with bcd3715f89bfd0598070f5f8e6ea1508ea73e00519cbd3a212e13096a0134b5d not found: ID does not exist"
Jul 26 18:33:22.799172 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.799150    2548 scope.go:117] "RemoveContainer" containerID="d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb"
Jul 26 18:33:22.799445 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:33:22.799424    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb\": container with ID starting with d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb not found: ID does not exist" containerID="d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb"
Jul 26 18:33:22.799509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.799451    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb"} err="failed to get container status \"d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb\": rpc error: code = NotFound desc = could not find container \"d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb\": container with ID starting with d50dd4df07a02e37f1a638cd0c691856ac580ee60f1593d8d3ca4901431412cb not found: ID does not exist"
Jul 26 18:33:22.806597 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.806575    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"]
Jul 26 18:33:22.810124 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:22.810100    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3a0f87c2-openshift-default-774cd6985b-8nw5n"]
Jul 26 18:33:23.414884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:33:23.414851    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73898758-f57f-4ed0-bb93-cefc66621742" path="/var/lib/kubelet/pods/73898758-f57f-4ed0-bb93-cefc66621742/volumes"
Jul 26 18:34:12.518698 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.518659    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"]
Jul 26 18:34:12.519261 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.519246    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy"
Jul 26 18:34:12.519321 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.519264    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy"
Jul 26 18:34:12.519321 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.519299    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="931533ab-3466-4bd2-a990-87c275a98eb1" containerName="maas-api"
Jul 26 18:34:12.519321 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.519307    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="931533ab-3466-4bd2-a990-87c275a98eb1" containerName="maas-api"
Jul 26 18:34:12.519433 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.519394    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy"
Jul 26 18:34:12.519433 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.519408    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy"
Jul 26 18:34:12.519433 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.519418    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="931533ab-3466-4bd2-a990-87c275a98eb1" containerName="maas-api"
Jul 26 18:34:12.523005 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.522985    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.525729 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.525699    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-872031-openshift-default-dockercfg-qzff5\""
Jul 26 18:34:12.534899 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.534869    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"]
Jul 26 18:34:12.573148 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.573103    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-certs\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.573148 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.573153    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dd519c1-2f61-46f7-bff8-8723004e22ba-istiod-ca-cert\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.573459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.573182    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-envoy\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.573459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.573318    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krxkv\" (UniqueName: \"kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-kube-api-access-krxkv\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.573459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.573377    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-socket\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.573459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.573408    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-credential-socket\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.573459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.573437    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-podinfo\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.573675 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.573464    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-token\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.573675 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.573497    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-data\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.674474 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.674425    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-certs\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.674474 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.674478    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dd519c1-2f61-46f7-bff8-8723004e22ba-istiod-ca-cert\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.674721 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.674500    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-envoy\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.674721 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.674615    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krxkv\" (UniqueName: \"kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-kube-api-access-krxkv\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.674721 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.674659    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-socket\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.674721 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.674689    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-credential-socket\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.674940 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.674734    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-podinfo\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.674940 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.674907    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-certs\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.675053 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.674943    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-token\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.675053 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.675017    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-data\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.675053 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.675017    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-socket\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.675322 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.675299    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dd519c1-2f61-46f7-bff8-8723004e22ba-istiod-ca-cert\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.675406 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.675345    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-data\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.675446 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.675423    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-credential-socket\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.676983 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.676958    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-envoy\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.677383 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.677365    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-podinfo\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.696102 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.696066    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-token\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.696302 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.696178    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krxkv\" (UniqueName: \"kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-kube-api-access-krxkv\") pod \"e2e-inf-a-872031-openshift-default-c77d87b56-r968w\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") " pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.834921 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.834808    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:12.999329 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:12.999291    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"]
Jul 26 18:34:13.002427 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:34:13.002403    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd519c1_2f61_46f7_bff8_8723004e22ba.slice/crio-1220fd84c11b831dbc1e872ff328c5672ce0bab0ce286eb60fad1a6d2a3e88c0 WatchSource:0}: Error finding container 1220fd84c11b831dbc1e872ff328c5672ce0bab0ce286eb60fad1a6d2a3e88c0: Status 404 returned error can't find the container with id 1220fd84c11b831dbc1e872ff328c5672ce0bab0ce286eb60fad1a6d2a3e88c0
Jul 26 18:34:13.004591 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:13.004555    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:13.004688 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:13.004634    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:13.004688 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:13.004667    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:13.026828 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:13.026789    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" event={"ID":"0dd519c1-2f61-46f7-bff8-8723004e22ba","Type":"ContainerStarted","Data":"1220fd84c11b831dbc1e872ff328c5672ce0bab0ce286eb60fad1a6d2a3e88c0"}
Jul 26 18:34:14.033610 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:14.033562    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" event={"ID":"0dd519c1-2f61-46f7-bff8-8723004e22ba","Type":"ContainerStarted","Data":"6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965"}
Jul 26 18:34:14.054121 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:14.054057    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" podStartSLOduration=2.054037348 podStartE2EDuration="2.054037348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:34:14.052876477 +0000 UTC m=+2211.153129368" watchObservedRunningTime="2026-07-26 18:34:14.054037348 +0000 UTC m=+2211.154290234"
Jul 26 18:34:14.835869 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:14.835833    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:14.841261 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:14.841231    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:15.037985 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:15.037952    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:15.039058 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:15.039040    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:16.042820 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.042787    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"]
Jul 26 18:34:16.044401 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.044374    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy"
Jul 26 18:34:16.044598 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.044585    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="73898758-f57f-4ed0-bb93-cefc66621742" containerName="istio-proxy"
Jul 26 18:34:16.048742 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.048715    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.053575 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.053541    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-872031-serving-cert\""
Jul 26 18:34:16.067578 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.067535    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"]
Jul 26 18:34:16.111292 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.111245    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91a87492-d387-4560-8e21-f0075adfff14-openshift-service-ca\") pod \"maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.111509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.111306    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgqq5\" (UniqueName: \"kubernetes.io/projected/91a87492-d387-4560-8e21-f0075adfff14-kube-api-access-vgqq5\") pod \"maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.111509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.111494    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a87492-d387-4560-8e21-f0075adfff14-maas-api-tls\") pod \"maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.212168 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.212126    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91a87492-d387-4560-8e21-f0075adfff14-openshift-service-ca\") pod \"maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.212168 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.212200    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgqq5\" (UniqueName: \"kubernetes.io/projected/91a87492-d387-4560-8e21-f0075adfff14-kube-api-access-vgqq5\") pod \"maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.212451 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.212264    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a87492-d387-4560-8e21-f0075adfff14-maas-api-tls\") pod \"maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.212451 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:34:16.212378    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-serving-cert: secret "maas-api-e2e-inf-a-872031-serving-cert" not found
Jul 26 18:34:16.212543 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:34:16.212470    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91a87492-d387-4560-8e21-f0075adfff14-maas-api-tls podName:91a87492-d387-4560-8e21-f0075adfff14 nodeName:}" failed. No retries permitted until 2026-07-26 18:34:16.712451145 +0000 UTC m=+2213.812704011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91a87492-d387-4560-8e21-f0075adfff14-maas-api-tls") pod "maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t" (UID: "91a87492-d387-4560-8e21-f0075adfff14") : secret "maas-api-e2e-inf-a-872031-serving-cert" not found
Jul 26 18:34:16.212866 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.212846    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91a87492-d387-4560-8e21-f0075adfff14-openshift-service-ca\") pod \"maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.221638 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.221610    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgqq5\" (UniqueName: \"kubernetes.io/projected/91a87492-d387-4560-8e21-f0075adfff14-kube-api-access-vgqq5\") pod \"maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.718612 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.718574    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a87492-d387-4560-8e21-f0075adfff14-maas-api-tls\") pod \"maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.721157 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.721129    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a87492-d387-4560-8e21-f0075adfff14-maas-api-tls\") pod \"maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:16.961822 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:16.961775    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:17.121412 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:17.121357    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"]
Jul 26 18:34:17.123604 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:34:17.123571    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a87492_d387_4560_8e21_f0075adfff14.slice/crio-c1e17189adbcdc044086395e55c810eb32bbf012a64e5550ea9cb8d1328e4cf2 WatchSource:0}: Error finding container c1e17189adbcdc044086395e55c810eb32bbf012a64e5550ea9cb8d1328e4cf2: Status 404 returned error can't find the container with id c1e17189adbcdc044086395e55c810eb32bbf012a64e5550ea9cb8d1328e4cf2
Jul 26 18:34:18.059365 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:18.059329    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t" event={"ID":"91a87492-d387-4560-8e21-f0075adfff14","Type":"ContainerStarted","Data":"5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e"}
Jul 26 18:34:18.059574 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:18.059391    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t" event={"ID":"91a87492-d387-4560-8e21-f0075adfff14","Type":"ContainerStarted","Data":"c1e17189adbcdc044086395e55c810eb32bbf012a64e5550ea9cb8d1328e4cf2"}
Jul 26 18:34:18.059574 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:18.059434    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:18.075987 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:18.075941    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t" podStartSLOduration=1.66324597 podStartE2EDuration="2.075924669s" totalImagesPullingTime="412.678699ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:34:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:34:18.074876035 +0000 UTC m=+2215.175128921" watchObservedRunningTime="2026-07-26 18:34:18.075924669 +0000 UTC m=+2215.176177555"
Jul 26 18:34:21.008953 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.008905    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"]
Jul 26 18:34:21.013443 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.013077    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.015884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.015858    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-7d6ab3-openshift-default-dockercfg-wnpqt\""
Jul 26 18:34:21.024758 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.024728    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"]
Jul 26 18:34:21.170326 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.170277    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-data\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.170519 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.170349    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-socket\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.170519 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.170428    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-istio-token\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.170519 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.170488    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-credential-socket\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.170519 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.170508    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-envoy\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.170773 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.170563    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-certs\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.170773 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.170640    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/658c26e8-7e8a-4e48-a937-1e4258110325-istio-podinfo\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.170773 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.170678    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/658c26e8-7e8a-4e48-a937-1e4258110325-istiod-ca-cert\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.170773 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.170732    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tkj5\" (UniqueName: \"kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-kube-api-access-4tkj5\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.271770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.271665    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/658c26e8-7e8a-4e48-a937-1e4258110325-istio-podinfo\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.271770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.271709    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/658c26e8-7e8a-4e48-a937-1e4258110325-istiod-ca-cert\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.271770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.271741    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tkj5\" (UniqueName: \"kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-kube-api-access-4tkj5\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.271770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.271767    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-data\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.272158 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.271804    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-socket\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.272158 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.271824    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-istio-token\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.272158 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.271864    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-credential-socket\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.272158 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.271889    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-envoy\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.272158 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.271949    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-certs\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.272492 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.272350    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-data\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.272492 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.272415    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-credential-socket\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.272632 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.272599    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-certs\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.272770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.272599    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/658c26e8-7e8a-4e48-a937-1e4258110325-istiod-ca-cert\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.272770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.272654    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-socket\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.274539 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.274516    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/658c26e8-7e8a-4e48-a937-1e4258110325-istio-podinfo\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.274763 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.274742    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-envoy\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.281521 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.281491    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-istio-token\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.281672 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.281602    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tkj5\" (UniqueName: \"kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-kube-api-access-4tkj5\") pod \"e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") " pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.326900 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.326866    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:21.480963 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.480936    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"]
Jul 26 18:34:21.482744 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:34:21.482718    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658c26e8_7e8a_4e48_a937_1e4258110325.slice/crio-fe9c130b99e425775303b067264b460e42eae302b8eadb9a5e57192e178d5eee WatchSource:0}: Error finding container fe9c130b99e425775303b067264b460e42eae302b8eadb9a5e57192e178d5eee: Status 404 returned error can't find the container with id fe9c130b99e425775303b067264b460e42eae302b8eadb9a5e57192e178d5eee
Jul 26 18:34:21.487995 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.487960    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:21.488093 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.488031    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:21.488093 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:21.488058    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:22.081531 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:22.081493    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" event={"ID":"658c26e8-7e8a-4e48-a937-1e4258110325","Type":"ContainerStarted","Data":"8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2"}
Jul 26 18:34:22.081944 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:22.081551    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" event={"ID":"658c26e8-7e8a-4e48-a937-1e4258110325","Type":"ContainerStarted","Data":"fe9c130b99e425775303b067264b460e42eae302b8eadb9a5e57192e178d5eee"}
Jul 26 18:34:22.106596 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:22.106546    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" podStartSLOduration=2.106528654 podStartE2EDuration="2.106528654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:34:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:34:22.104791719 +0000 UTC m=+2219.205044625" watchObservedRunningTime="2026-07-26 18:34:22.106528654 +0000 UTC m=+2219.206781539"
Jul 26 18:34:22.327482 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:22.327438    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:22.332595 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:22.332523    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:23.086818 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:23.086784    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:23.087969 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:23.087948    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:24.064781 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.064746    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"]
Jul 26 18:34:24.068989 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.068961    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.069798 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.069773    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:34:24.071391 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.071368    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7d6ab3-serving-cert\""
Jul 26 18:34:24.078384 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.078356    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"]
Jul 26 18:34:24.201183 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.201135    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b92f4e04-8acf-4645-8404-70ec8e819a31-maas-api-tls\") pod \"maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.201881 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.201847    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8st8j\" (UniqueName: \"kubernetes.io/projected/b92f4e04-8acf-4645-8404-70ec8e819a31-kube-api-access-8st8j\") pod \"maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.202031 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.201950    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b92f4e04-8acf-4645-8404-70ec8e819a31-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.303510 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.303471    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b92f4e04-8acf-4645-8404-70ec8e819a31-maas-api-tls\") pod \"maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.303727 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.303566    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8st8j\" (UniqueName: \"kubernetes.io/projected/b92f4e04-8acf-4645-8404-70ec8e819a31-kube-api-access-8st8j\") pod \"maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.303727 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.303609    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b92f4e04-8acf-4645-8404-70ec8e819a31-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.303727 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:34:24.303653    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-serving-cert: secret "maas-api-e2e-inf-b-7d6ab3-serving-cert" not found
Jul 26 18:34:24.303911 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:34:24.303754    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92f4e04-8acf-4645-8404-70ec8e819a31-maas-api-tls podName:b92f4e04-8acf-4645-8404-70ec8e819a31 nodeName:}" failed. No retries permitted until 2026-07-26 18:34:24.803730803 +0000 UTC m=+2221.903983669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b92f4e04-8acf-4645-8404-70ec8e819a31-maas-api-tls") pod "maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr" (UID: "b92f4e04-8acf-4645-8404-70ec8e819a31") : secret "maas-api-e2e-inf-b-7d6ab3-serving-cert" not found
Jul 26 18:34:24.304274 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.304257    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b92f4e04-8acf-4645-8404-70ec8e819a31-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.312673 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.312639    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8st8j\" (UniqueName: \"kubernetes.io/projected/b92f4e04-8acf-4645-8404-70ec8e819a31-kube-api-access-8st8j\") pod \"maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.810146 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.810107    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b92f4e04-8acf-4645-8404-70ec8e819a31-maas-api-tls\") pod \"maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.812896 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.812875    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b92f4e04-8acf-4645-8404-70ec8e819a31-maas-api-tls\") pod \"maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:24.981348 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:24.981308    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:25.214800 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:25.214769    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"]
Jul 26 18:34:25.216575 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:34:25.216547    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92f4e04_8acf_4645_8404_70ec8e819a31.slice/crio-91e230989ba462c518aced3fcea9613204f111d00f8576b597cdd88ab0506cd8 WatchSource:0}: Error finding container 91e230989ba462c518aced3fcea9613204f111d00f8576b597cdd88ab0506cd8: Status 404 returned error can't find the container with id 91e230989ba462c518aced3fcea9613204f111d00f8576b597cdd88ab0506cd8
Jul 26 18:34:26.109405 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:26.109353    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr" event={"ID":"b92f4e04-8acf-4645-8404-70ec8e819a31","Type":"ContainerStarted","Data":"97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8"}
Jul 26 18:34:26.109586 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:26.109540    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:26.109677 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:26.109588    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr" event={"ID":"b92f4e04-8acf-4645-8404-70ec8e819a31","Type":"ContainerStarted","Data":"91e230989ba462c518aced3fcea9613204f111d00f8576b597cdd88ab0506cd8"}
Jul 26 18:34:26.128209 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:26.128139    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr" podStartSLOduration=1.7607515519999999 podStartE2EDuration="2.128120349s" totalImagesPullingTime="367.368797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:34:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:34:26.126336814 +0000 UTC m=+2223.226589724" watchObservedRunningTime="2026-07-26 18:34:26.128120349 +0000 UTC m=+2223.228373235"
Jul 26 18:34:31.080406 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:31.080365    2548 patch_prober.go:28] interesting pod/e2e-inf-a-872031-openshift-default-c77d87b56-r968w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 18:34:31.080873 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:31.080432    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 26 18:34:32.119533 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:32.119498    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:34:32.142865 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:32.142826    2548 generic.go:356] "Generic (PLEG): container finished" podID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerID="6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965" exitCode=0
Jul 26 18:34:32.143078 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:32.142906    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" event={"ID":"0dd519c1-2f61-46f7-bff8-8723004e22ba","Type":"ContainerDied","Data":"6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965"}
Jul 26 18:34:32.143417 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:32.143399    2548 scope.go:117] "RemoveContainer" containerID="6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965"
Jul 26 18:34:32.144804 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:32.144765    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:32.144919 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:32.144859    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:32.144919 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:32.144911    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:33.153703 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:33.153666    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" event={"ID":"0dd519c1-2f61-46f7-bff8-8723004e22ba","Type":"ContainerStarted","Data":"3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61"}
Jul 26 18:34:33.835409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:33.835362    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:33.835657 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:33.835633    2548 patch_prober.go:28] interesting pod/e2e-inf-a-872031-openshift-default-c77d87b56-r968w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 26 18:34:33.835711 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:33.835696    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 26 18:34:34.836266 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:34.836222    2548 patch_prober.go:28] interesting pod/e2e-inf-a-872031-openshift-default-c77d87b56-r968w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 26 18:34:34.836679 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:34.836282    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 26 18:34:35.835357 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:35.835319    2548 patch_prober.go:28] interesting pod/e2e-inf-a-872031-openshift-default-c77d87b56-r968w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 26 18:34:35.835558 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:35.835380    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 26 18:34:36.835961 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:36.835916    2548 patch_prober.go:28] interesting pod/e2e-inf-a-872031-openshift-default-c77d87b56-r968w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 26 18:34:36.836409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:36.835979    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 26 18:34:37.839337 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:37.839258    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:37.839713 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:37.839546    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:37.840333 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:37.840312    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:34:39.128415 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:39.128373    2548 patch_prober.go:28] interesting pod/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 18:34:39.128833 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:39.128448    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 26 18:34:40.201712 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:40.201677    2548 generic.go:356] "Generic (PLEG): container finished" podID="658c26e8-7e8a-4e48-a937-1e4258110325" containerID="8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2" exitCode=0
Jul 26 18:34:40.202145 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:40.201748    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" event={"ID":"658c26e8-7e8a-4e48-a937-1e4258110325","Type":"ContainerDied","Data":"8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2"}
Jul 26 18:34:40.202229 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:40.202188    2548 scope.go:117] "RemoveContainer" containerID="8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2"
Jul 26 18:34:40.212296 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:40.204239    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:40.212296 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:40.204895    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:40.212296 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:40.205399    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:34:41.209311 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:41.209267    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" event={"ID":"658c26e8-7e8a-4e48-a937-1e4258110325","Type":"ContainerStarted","Data":"da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9"}
Jul 26 18:34:41.327690 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:41.327651    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:41.327982 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:41.327957    2548 patch_prober.go:28] interesting pod/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 26 18:34:41.328046 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:41.328025    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 26 18:34:42.327432 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:42.327389    2548 patch_prober.go:28] interesting pod/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 26 18:34:42.327843 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:42.327460    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 26 18:34:43.327592 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:43.327545    2548 patch_prober.go:28] interesting pod/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 26 18:34:43.328086 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:43.327618    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 26 18:34:44.327884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:44.327839    2548 patch_prober.go:28] interesting pod/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 26 18:34:44.328309 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:44.327909    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 26 18:34:45.330861 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:45.330773    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:45.331248 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:45.331139    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:34:45.331779 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:34:45.331762    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:35:39.023593 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.023552    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"]
Jul 26 18:35:39.024175 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.023853    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t" podUID="91a87492-d387-4560-8e21-f0075adfff14" containerName="maas-api" containerID="cri-o://5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e" gracePeriod=30
Jul 26 18:35:39.065755 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.065699    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t" podUID="91a87492-d387-4560-8e21-f0075adfff14" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.61:8443/health\": dial tcp 10.133.0.61:8443: connect: connection refused"
Jul 26 18:35:39.284599 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.284532    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:35:39.385630 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.385591    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgqq5\" (UniqueName: \"kubernetes.io/projected/91a87492-d387-4560-8e21-f0075adfff14-kube-api-access-vgqq5\") pod \"91a87492-d387-4560-8e21-f0075adfff14\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") "
Jul 26 18:35:39.385814 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.385643    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a87492-d387-4560-8e21-f0075adfff14-maas-api-tls\") pod \"91a87492-d387-4560-8e21-f0075adfff14\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") "
Jul 26 18:35:39.385814 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.385741    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91a87492-d387-4560-8e21-f0075adfff14-openshift-service-ca\") pod \"91a87492-d387-4560-8e21-f0075adfff14\" (UID: \"91a87492-d387-4560-8e21-f0075adfff14\") "
Jul 26 18:35:39.386106 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.386075    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a87492-d387-4560-8e21-f0075adfff14-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91a87492-d387-4560-8e21-f0075adfff14" (UID: "91a87492-d387-4560-8e21-f0075adfff14"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:35:39.387703 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.387676    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a87492-d387-4560-8e21-f0075adfff14-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91a87492-d387-4560-8e21-f0075adfff14" (UID: "91a87492-d387-4560-8e21-f0075adfff14"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:35:39.387703 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.387686    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a87492-d387-4560-8e21-f0075adfff14-kube-api-access-vgqq5" (OuterVolumeSpecName: "kube-api-access-vgqq5") pod "91a87492-d387-4560-8e21-f0075adfff14" (UID: "91a87492-d387-4560-8e21-f0075adfff14"). InnerVolumeSpecName "kube-api-access-vgqq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:35:39.487149 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.487111    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgqq5\" (UniqueName: \"kubernetes.io/projected/91a87492-d387-4560-8e21-f0075adfff14-kube-api-access-vgqq5\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:39.487149 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.487148    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91a87492-d387-4560-8e21-f0075adfff14-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:39.487390 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.487162    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91a87492-d387-4560-8e21-f0075adfff14-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:39.497565 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.497526    2548 generic.go:356] "Generic (PLEG): container finished" podID="91a87492-d387-4560-8e21-f0075adfff14" containerID="5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e" exitCode=0
Jul 26 18:35:39.497761 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.497572    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t" event={"ID":"91a87492-d387-4560-8e21-f0075adfff14","Type":"ContainerDied","Data":"5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e"}
Jul 26 18:35:39.497761 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.497611    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t" event={"ID":"91a87492-d387-4560-8e21-f0075adfff14","Type":"ContainerDied","Data":"c1e17189adbcdc044086395e55c810eb32bbf012a64e5550ea9cb8d1328e4cf2"}
Jul 26 18:35:39.497761 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.497631    2548 scope.go:117] "RemoveContainer" containerID="5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e"
Jul 26 18:35:39.497761 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.497574    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"
Jul 26 18:35:39.506800 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.506780    2548 scope.go:117] "RemoveContainer" containerID="5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e"
Jul 26 18:35:39.507076 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:35:39.507056    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e\": container with ID starting with 5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e not found: ID does not exist" containerID="5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e"
Jul 26 18:35:39.507123 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.507086    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e"} err="failed to get container status \"5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e\": rpc error: code = NotFound desc = could not find container \"5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e\": container with ID starting with 5c88670cd66ce6365e20cc8a50e662effdd790b38aa07750a4e5659d1634228e not found: ID does not exist"
Jul 26 18:35:39.530820 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.530784    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"]
Jul 26 18:35:39.542558 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:39.542476    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-872031-6b8b6d4cd6-h4r6t"]
Jul 26 18:35:41.413916 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:41.413879    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91a87492-d387-4560-8e21-f0075adfff14" path="/var/lib/kubelet/pods/91a87492-d387-4560-8e21-f0075adfff14/volumes"
Jul 26 18:35:49.903298 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:49.903260    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"]
Jul 26 18:35:49.903774 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:49.903578    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy" containerID="cri-o://3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61" gracePeriod=30
Jul 26 18:35:52.841730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:52.841688    2548 patch_prober.go:28] interesting pod/e2e-inf-a-872031-openshift-default-c77d87b56-r968w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 18:35:52.842138 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:52.841755    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 18:35:55.188048 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.188019    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:35:55.235108 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235077    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-socket\") pod \"0dd519c1-2f61-46f7-bff8-8723004e22ba\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") "
Jul 26 18:35:55.235108 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235110    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-token\") pod \"0dd519c1-2f61-46f7-bff8-8723004e22ba\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") "
Jul 26 18:35:55.235409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235140    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-certs\") pod \"0dd519c1-2f61-46f7-bff8-8723004e22ba\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") "
Jul 26 18:35:55.235409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235180    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dd519c1-2f61-46f7-bff8-8723004e22ba-istiod-ca-cert\") pod \"0dd519c1-2f61-46f7-bff8-8723004e22ba\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") "
Jul 26 18:35:55.235409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235245    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krxkv\" (UniqueName: \"kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-kube-api-access-krxkv\") pod \"0dd519c1-2f61-46f7-bff8-8723004e22ba\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") "
Jul 26 18:35:55.235409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235286    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-podinfo\") pod \"0dd519c1-2f61-46f7-bff8-8723004e22ba\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") "
Jul 26 18:35:55.235409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235308    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-data\") pod \"0dd519c1-2f61-46f7-bff8-8723004e22ba\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") "
Jul 26 18:35:55.235409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235359    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-credential-socket\") pod \"0dd519c1-2f61-46f7-bff8-8723004e22ba\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") "
Jul 26 18:35:55.235409 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235404    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-envoy\") pod \"0dd519c1-2f61-46f7-bff8-8723004e22ba\" (UID: \"0dd519c1-2f61-46f7-bff8-8723004e22ba\") "
Jul 26 18:35:55.235742 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235421    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0dd519c1-2f61-46f7-bff8-8723004e22ba" (UID: "0dd519c1-2f61-46f7-bff8-8723004e22ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:35:55.235742 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235687    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dd519c1-2f61-46f7-bff8-8723004e22ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0dd519c1-2f61-46f7-bff8-8723004e22ba" (UID: "0dd519c1-2f61-46f7-bff8-8723004e22ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:35:55.235927 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235867    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:55.235927 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235901    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0dd519c1-2f61-46f7-bff8-8723004e22ba-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:55.235927 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235908    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0dd519c1-2f61-46f7-bff8-8723004e22ba" (UID: "0dd519c1-2f61-46f7-bff8-8723004e22ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:35:55.236127 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.235948    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0dd519c1-2f61-46f7-bff8-8723004e22ba" (UID: "0dd519c1-2f61-46f7-bff8-8723004e22ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:35:55.236354 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.236312    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "0dd519c1-2f61-46f7-bff8-8723004e22ba" (UID: "0dd519c1-2f61-46f7-bff8-8723004e22ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:35:55.237737 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.237711    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-kube-api-access-krxkv" (OuterVolumeSpecName: "kube-api-access-krxkv") pod "0dd519c1-2f61-46f7-bff8-8723004e22ba" (UID: "0dd519c1-2f61-46f7-bff8-8723004e22ba"). InnerVolumeSpecName "kube-api-access-krxkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:35:55.238011 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.237988    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "0dd519c1-2f61-46f7-bff8-8723004e22ba" (UID: "0dd519c1-2f61-46f7-bff8-8723004e22ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:35:55.238114 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.238051    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0dd519c1-2f61-46f7-bff8-8723004e22ba" (UID: "0dd519c1-2f61-46f7-bff8-8723004e22ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:35:55.238114 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.238073    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0dd519c1-2f61-46f7-bff8-8723004e22ba" (UID: "0dd519c1-2f61-46f7-bff8-8723004e22ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:35:55.336692 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.336650    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:55.336692 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.336689    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krxkv\" (UniqueName: \"kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-kube-api-access-krxkv\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:55.336692 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.336708    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:55.336956 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.336717    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:55.336956 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.336727    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:55.336956 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.336735    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:55.336956 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.336742    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0dd519c1-2f61-46f7-bff8-8723004e22ba-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:35:55.585912 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.585877    2548 generic.go:356] "Generic (PLEG): container finished" podID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerID="3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61" exitCode=0
Jul 26 18:35:55.586097 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.585928    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"
Jul 26 18:35:55.586097 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.585941    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" event={"ID":"0dd519c1-2f61-46f7-bff8-8723004e22ba","Type":"ContainerDied","Data":"3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61"}
Jul 26 18:35:55.586097 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.585984    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w" event={"ID":"0dd519c1-2f61-46f7-bff8-8723004e22ba","Type":"ContainerDied","Data":"1220fd84c11b831dbc1e872ff328c5672ce0bab0ce286eb60fad1a6d2a3e88c0"}
Jul 26 18:35:55.586097 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.586005    2548 scope.go:117] "RemoveContainer" containerID="3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61"
Jul 26 18:35:55.594829 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.594810    2548 scope.go:117] "RemoveContainer" containerID="6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965"
Jul 26 18:35:55.602861 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.602790    2548 scope.go:117] "RemoveContainer" containerID="3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61"
Jul 26 18:35:55.603122 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:35:55.603097    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61\": container with ID starting with 3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61 not found: ID does not exist" containerID="3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61"
Jul 26 18:35:55.603213 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.603134    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61"} err="failed to get container status \"3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61\": rpc error: code = NotFound desc = could not find container \"3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61\": container with ID starting with 3e4a03e0707107cc6e37af7e53d73068f960749722f55aaaef8229bf2b97ac61 not found: ID does not exist"
Jul 26 18:35:55.603213 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.603161    2548 scope.go:117] "RemoveContainer" containerID="6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965"
Jul 26 18:35:55.603493 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:35:55.603468    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965\": container with ID starting with 6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965 not found: ID does not exist" containerID="6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965"
Jul 26 18:35:55.603538 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.603503    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965"} err="failed to get container status \"6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965\": rpc error: code = NotFound desc = could not find container \"6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965\": container with ID starting with 6dc5d70920c668d27286075d75953b7100bdff1ce09591460a4bac532c9a1965 not found: ID does not exist"
Jul 26 18:35:55.605441 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.605416    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"]
Jul 26 18:35:55.608695 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:55.608673    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-872031-openshift-default-c77d87b56-r968w"]
Jul 26 18:35:57.414431 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:35:57.414390    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" path="/var/lib/kubelet/pods/0dd519c1-2f61-46f7-bff8-8723004e22ba/volumes"
Jul 26 18:36:00.719036 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:00.718997    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"]
Jul 26 18:36:00.719455 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:00.719273    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr" podUID="b92f4e04-8acf-4645-8404-70ec8e819a31" containerName="maas-api" containerID="cri-o://97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8" gracePeriod=30
Jul 26 18:36:00.987977 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:00.987950    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:36:01.097918 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.097879    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b92f4e04-8acf-4645-8404-70ec8e819a31-openshift-service-ca\") pod \"b92f4e04-8acf-4645-8404-70ec8e819a31\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") "
Jul 26 18:36:01.098119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.098002    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8st8j\" (UniqueName: \"kubernetes.io/projected/b92f4e04-8acf-4645-8404-70ec8e819a31-kube-api-access-8st8j\") pod \"b92f4e04-8acf-4645-8404-70ec8e819a31\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") "
Jul 26 18:36:01.098119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.098030    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b92f4e04-8acf-4645-8404-70ec8e819a31-maas-api-tls\") pod \"b92f4e04-8acf-4645-8404-70ec8e819a31\" (UID: \"b92f4e04-8acf-4645-8404-70ec8e819a31\") "
Jul 26 18:36:01.098353 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.098326    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b92f4e04-8acf-4645-8404-70ec8e819a31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b92f4e04-8acf-4645-8404-70ec8e819a31" (UID: "b92f4e04-8acf-4645-8404-70ec8e819a31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:36:01.100128 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.100102    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b92f4e04-8acf-4645-8404-70ec8e819a31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b92f4e04-8acf-4645-8404-70ec8e819a31" (UID: "b92f4e04-8acf-4645-8404-70ec8e819a31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:36:01.100265 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.100108    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b92f4e04-8acf-4645-8404-70ec8e819a31-kube-api-access-8st8j" (OuterVolumeSpecName: "kube-api-access-8st8j") pod "b92f4e04-8acf-4645-8404-70ec8e819a31" (UID: "b92f4e04-8acf-4645-8404-70ec8e819a31"). InnerVolumeSpecName "kube-api-access-8st8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:36:01.199613 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.199577    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8st8j\" (UniqueName: \"kubernetes.io/projected/b92f4e04-8acf-4645-8404-70ec8e819a31-kube-api-access-8st8j\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:01.199613 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.199609    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b92f4e04-8acf-4645-8404-70ec8e819a31-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:01.199613 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.199619    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b92f4e04-8acf-4645-8404-70ec8e819a31-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:01.620023 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.619986    2548 generic.go:356] "Generic (PLEG): container finished" podID="b92f4e04-8acf-4645-8404-70ec8e819a31" containerID="97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8" exitCode=0
Jul 26 18:36:01.620247 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.620035    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"
Jul 26 18:36:01.620247 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.620068    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr" event={"ID":"b92f4e04-8acf-4645-8404-70ec8e819a31","Type":"ContainerDied","Data":"97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8"}
Jul 26 18:36:01.620247 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.620123    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr" event={"ID":"b92f4e04-8acf-4645-8404-70ec8e819a31","Type":"ContainerDied","Data":"91e230989ba462c518aced3fcea9613204f111d00f8576b597cdd88ab0506cd8"}
Jul 26 18:36:01.620247 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.620147    2548 scope.go:117] "RemoveContainer" containerID="97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8"
Jul 26 18:36:01.628868 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.628849    2548 scope.go:117] "RemoveContainer" containerID="97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8"
Jul 26 18:36:01.629152 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:36:01.629131    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8\": container with ID starting with 97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8 not found: ID does not exist" containerID="97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8"
Jul 26 18:36:01.629214 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.629162    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8"} err="failed to get container status \"97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8\": rpc error: code = NotFound desc = could not find container \"97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8\": container with ID starting with 97440e70c743500dc8308b5df612dc6d5f9c61f31e6adf900ae1e1a43d902eb8 not found: ID does not exist"
Jul 26 18:36:01.636606 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.636577    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"]
Jul 26 18:36:01.638467 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:01.638445    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7d6ab3-6d89bd75f9-bj6fr"]
Jul 26 18:36:03.413960 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:03.413926    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b92f4e04-8acf-4645-8404-70ec8e819a31" path="/var/lib/kubelet/pods/b92f4e04-8acf-4645-8404-70ec8e819a31/volumes"
Jul 26 18:36:11.883863 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:11.883824    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"]
Jul 26 18:36:11.884318 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:11.884092    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy" containerID="cri-o://da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9" gracePeriod=30
Jul 26 18:36:12.723343 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.723305    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"]
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.723837    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92f4e04-8acf-4645-8404-70ec8e819a31" containerName="maas-api"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.723859    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92f4e04-8acf-4645-8404-70ec8e819a31" containerName="maas-api"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.723883    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a87492-d387-4560-8e21-f0075adfff14" containerName="maas-api"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.723901    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a87492-d387-4560-8e21-f0075adfff14" containerName="maas-api"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.723915    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.723923    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.723944    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.723953    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.724069    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92f4e04-8acf-4645-8404-70ec8e819a31" containerName="maas-api"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.724082    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.724091    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dd519c1-2f61-46f7-bff8-8723004e22ba" containerName="istio-proxy"
Jul 26 18:36:12.724269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.724101    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a87492-d387-4560-8e21-f0075adfff14" containerName="maas-api"
Jul 26 18:36:12.728598 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.728578    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.731242 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.731216    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-138d4e-openshift-default-dockercfg-nc2rj\""
Jul 26 18:36:12.739903 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.739877    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"]
Jul 26 18:36:12.818208 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.818151    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-envoy\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.818428 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.818224    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-podinfo\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.818428 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.818292    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-credential-socket\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.818428 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.818412    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-certs\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.818607 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.818445    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lldtf\" (UniqueName: \"kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-kube-api-access-lldtf\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.818607 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.818494    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-socket\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.818607 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.818531    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-data\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.818607 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.818554    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-token\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.818607 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.818575    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istiod-ca-cert\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.919692 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.919650    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-podinfo\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.919711    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-credential-socket\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.919830    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-certs\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.919870    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lldtf\" (UniqueName: \"kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-kube-api-access-lldtf\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.919919    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-socket\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.920001    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-data\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.920028    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-token\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.920061    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istiod-ca-cert\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.920083    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-envoy\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.920089    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-credential-socket\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.920150    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-certs\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920904 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.920474    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-data\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.920904 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.920533    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-socket\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.921016 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.920898    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istiod-ca-cert\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.922493 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.922463    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-envoy\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.922618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.922597    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-podinfo\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.935148 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.935117    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lldtf\" (UniqueName: \"kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-kube-api-access-lldtf\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:12.937715 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:12.937686    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-token\") pod \"e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") " pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:13.040941 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:13.040829    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:13.197977 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:13.197827    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"]
Jul 26 18:36:13.200415 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:36:13.200389    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe300bd8_25f4_4836_b2ed_6bd4f4b3fcf9.slice/crio-9b32c14b1267c036f7980851d728a2cf2386de84de1d2233e3254c363bf649e6 WatchSource:0}: Error finding container 9b32c14b1267c036f7980851d728a2cf2386de84de1d2233e3254c363bf649e6: Status 404 returned error can't find the container with id 9b32c14b1267c036f7980851d728a2cf2386de84de1d2233e3254c363bf649e6
Jul 26 18:36:13.202527 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:13.202491    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:13.202604 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:13.202556    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:13.202604 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:13.202582    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:13.683094 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:13.683057    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" event={"ID":"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9","Type":"ContainerStarted","Data":"d4fa169839996ab3b4504eb54631aec913f3dab8411de1f3977187b7b317bf82"}
Jul 26 18:36:13.683348 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:13.683128    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" event={"ID":"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9","Type":"ContainerStarted","Data":"9b32c14b1267c036f7980851d728a2cf2386de84de1d2233e3254c363bf649e6"}
Jul 26 18:36:13.708291 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:13.708229    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" podStartSLOduration=1.708206048 podStartE2EDuration="1.708206048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:36:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:36:13.705975061 +0000 UTC m=+2330.806227974" watchObservedRunningTime="2026-07-26 18:36:13.708206048 +0000 UTC m=+2330.808458925"
Jul 26 18:36:14.041795 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:14.041686    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:14.046883 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:14.046854    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:14.688862 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:14.688838    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:14.689939 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:14.689909    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:15.334299 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:15.334218    2548 patch_prober.go:28] interesting pod/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 18:36:15.334299 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:15.334279    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 18:36:15.925926 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:15.925888    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"]
Jul 26 18:36:15.930119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:15.930079    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:15.932616 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:15.932587    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-138d4e-serving-cert\""
Jul 26 18:36:15.942833 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:15.942802    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"]
Jul 26 18:36:16.052824 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.052777    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnzhq\" (UniqueName: \"kubernetes.io/projected/fc1217d2-f913-455c-adc1-10923fb13a93-kube-api-access-cnzhq\") pod \"maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:16.053016 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.052853    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1217d2-f913-455c-adc1-10923fb13a93-maas-api-tls\") pod \"maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:16.053016 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.052978    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1217d2-f913-455c-adc1-10923fb13a93-openshift-service-ca\") pod \"maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:16.154243 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.154184    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1217d2-f913-455c-adc1-10923fb13a93-openshift-service-ca\") pod \"maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:16.154448 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.154276    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnzhq\" (UniqueName: \"kubernetes.io/projected/fc1217d2-f913-455c-adc1-10923fb13a93-kube-api-access-cnzhq\") pod \"maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:16.154448 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.154312    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1217d2-f913-455c-adc1-10923fb13a93-maas-api-tls\") pod \"maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:16.154930 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.154906    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1217d2-f913-455c-adc1-10923fb13a93-openshift-service-ca\") pod \"maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:16.156877 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.156850    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1217d2-f913-455c-adc1-10923fb13a93-maas-api-tls\") pod \"maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:16.165748 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.165703    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnzhq\" (UniqueName: \"kubernetes.io/projected/fc1217d2-f913-455c-adc1-10923fb13a93-kube-api-access-cnzhq\") pod \"maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:16.243475 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.243371    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:16.406611 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.406569    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"]
Jul 26 18:36:16.408914 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:36:16.408864    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1217d2_f913_455c_adc1_10923fb13a93.slice/crio-d5be52f6af60a5ed1cd68d1460c57d2937f21f2dd3ac21d7912e932c23dcb15b WatchSource:0}: Error finding container d5be52f6af60a5ed1cd68d1460c57d2937f21f2dd3ac21d7912e932c23dcb15b: Status 404 returned error can't find the container with id d5be52f6af60a5ed1cd68d1460c57d2937f21f2dd3ac21d7912e932c23dcb15b
Jul 26 18:36:16.410459 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.410441    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 18:36:16.701396 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:16.701356    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq" event={"ID":"fc1217d2-f913-455c-adc1-10923fb13a93","Type":"ContainerStarted","Data":"d5be52f6af60a5ed1cd68d1460c57d2937f21f2dd3ac21d7912e932c23dcb15b"}
Jul 26 18:36:17.142106 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.142074    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:36:17.267613 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.267507    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tkj5\" (UniqueName: \"kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-kube-api-access-4tkj5\") pod \"658c26e8-7e8a-4e48-a937-1e4258110325\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") "
Jul 26 18:36:17.267613 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.267564    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-envoy\") pod \"658c26e8-7e8a-4e48-a937-1e4258110325\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") "
Jul 26 18:36:17.267876 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.267627    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-data\") pod \"658c26e8-7e8a-4e48-a937-1e4258110325\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") "
Jul 26 18:36:17.267876 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.267699    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/658c26e8-7e8a-4e48-a937-1e4258110325-istio-podinfo\") pod \"658c26e8-7e8a-4e48-a937-1e4258110325\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") "
Jul 26 18:36:17.267876 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.267785    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/658c26e8-7e8a-4e48-a937-1e4258110325-istiod-ca-cert\") pod \"658c26e8-7e8a-4e48-a937-1e4258110325\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") "
Jul 26 18:36:17.268052 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.267918    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-istio-token\") pod \"658c26e8-7e8a-4e48-a937-1e4258110325\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") "
Jul 26 18:36:17.268052 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.267972    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-socket\") pod \"658c26e8-7e8a-4e48-a937-1e4258110325\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") "
Jul 26 18:36:17.268052 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.268002    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-credential-socket\") pod \"658c26e8-7e8a-4e48-a937-1e4258110325\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") "
Jul 26 18:36:17.268052 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.268027    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-certs\") pod \"658c26e8-7e8a-4e48-a937-1e4258110325\" (UID: \"658c26e8-7e8a-4e48-a937-1e4258110325\") "
Jul 26 18:36:17.268697 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.268327    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/658c26e8-7e8a-4e48-a937-1e4258110325-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "658c26e8-7e8a-4e48-a937-1e4258110325" (UID: "658c26e8-7e8a-4e48-a937-1e4258110325"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:36:17.268697 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.268462    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/658c26e8-7e8a-4e48-a937-1e4258110325-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:17.268697 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.268542    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "658c26e8-7e8a-4e48-a937-1e4258110325" (UID: "658c26e8-7e8a-4e48-a937-1e4258110325"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:36:17.269067 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.268840    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "658c26e8-7e8a-4e48-a937-1e4258110325" (UID: "658c26e8-7e8a-4e48-a937-1e4258110325"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:36:17.269181 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.269080    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "658c26e8-7e8a-4e48-a937-1e4258110325" (UID: "658c26e8-7e8a-4e48-a937-1e4258110325"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:36:17.270170 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.270144    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-data" (OuterVolumeSpecName: "istio-data") pod "658c26e8-7e8a-4e48-a937-1e4258110325" (UID: "658c26e8-7e8a-4e48-a937-1e4258110325"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:36:17.270393 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.270374    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-kube-api-access-4tkj5" (OuterVolumeSpecName: "kube-api-access-4tkj5") pod "658c26e8-7e8a-4e48-a937-1e4258110325" (UID: "658c26e8-7e8a-4e48-a937-1e4258110325"). InnerVolumeSpecName "kube-api-access-4tkj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:36:17.270468 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.270446    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "658c26e8-7e8a-4e48-a937-1e4258110325" (UID: "658c26e8-7e8a-4e48-a937-1e4258110325"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:36:17.270688 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.270670    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-istio-token" (OuterVolumeSpecName: "istio-token") pod "658c26e8-7e8a-4e48-a937-1e4258110325" (UID: "658c26e8-7e8a-4e48-a937-1e4258110325"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:36:17.271239 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.271218    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/658c26e8-7e8a-4e48-a937-1e4258110325-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "658c26e8-7e8a-4e48-a937-1e4258110325" (UID: "658c26e8-7e8a-4e48-a937-1e4258110325"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:36:17.369383 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.369346    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tkj5\" (UniqueName: \"kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-kube-api-access-4tkj5\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:17.369383 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.369380    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:17.369383 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.369389    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:17.369737 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.369399    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/658c26e8-7e8a-4e48-a937-1e4258110325-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:17.369737 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.369406    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/658c26e8-7e8a-4e48-a937-1e4258110325-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:17.369737 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.369415    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:17.369737 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.369424    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:17.369737 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.369431    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/658c26e8-7e8a-4e48-a937-1e4258110325-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:17.707790 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.707750    2548 generic.go:356] "Generic (PLEG): container finished" podID="658c26e8-7e8a-4e48-a937-1e4258110325" containerID="da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9" exitCode=0
Jul 26 18:36:17.708288 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.707810    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"
Jul 26 18:36:17.708288 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.707844    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" event={"ID":"658c26e8-7e8a-4e48-a937-1e4258110325","Type":"ContainerDied","Data":"da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9"}
Jul 26 18:36:17.708288 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.707901    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw" event={"ID":"658c26e8-7e8a-4e48-a937-1e4258110325","Type":"ContainerDied","Data":"fe9c130b99e425775303b067264b460e42eae302b8eadb9a5e57192e178d5eee"}
Jul 26 18:36:17.708288 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.707931    2548 scope.go:117] "RemoveContainer" containerID="da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9"
Jul 26 18:36:17.709667 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.709637    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq" event={"ID":"fc1217d2-f913-455c-adc1-10923fb13a93","Type":"ContainerStarted","Data":"9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1"}
Jul 26 18:36:17.709795 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.709700    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:17.717042 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.717019    2548 scope.go:117] "RemoveContainer" containerID="8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2"
Jul 26 18:36:17.725340 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.725311    2548 scope.go:117] "RemoveContainer" containerID="da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9"
Jul 26 18:36:17.725851 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:36:17.725811    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9\": container with ID starting with da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9 not found: ID does not exist" containerID="da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9"
Jul 26 18:36:17.725951 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.725852    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9"} err="failed to get container status \"da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9\": rpc error: code = NotFound desc = could not find container \"da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9\": container with ID starting with da47166462d1bb5e8f585b5a73369204aa64e957df8dbe3726e438d65c1c57d9 not found: ID does not exist"
Jul 26 18:36:17.725951 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.725872    2548 scope.go:117] "RemoveContainer" containerID="8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2"
Jul 26 18:36:17.726177 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:36:17.726157    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2\": container with ID starting with 8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2 not found: ID does not exist" containerID="8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2"
Jul 26 18:36:17.726328 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.726184    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2"} err="failed to get container status \"8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2\": rpc error: code = NotFound desc = could not find container \"8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2\": container with ID starting with 8063865bd0f664cf1c9fc15dbd5560eb2b9b6f05048af143907742b2211c58e2 not found: ID does not exist"
Jul 26 18:36:17.728177 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.728157    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"]
Jul 26 18:36:17.733116 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.733085    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-7d6ab3-openshift-default-b667fb66-nlqkw"]
Jul 26 18:36:17.745575 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:17.745523    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq" podStartSLOduration=2.334584641 podStartE2EDuration="2.745506588s" totalImagesPullingTime="410.921947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:36:17.745185679 +0000 UTC m=+2334.845438594" watchObservedRunningTime="2026-07-26 18:36:17.745506588 +0000 UTC m=+2334.845759473"
Jul 26 18:36:19.414361 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:19.414324    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" path="/var/lib/kubelet/pods/658c26e8-7e8a-4e48-a937-1e4258110325/volumes"
Jul 26 18:36:20.796706 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.796668    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"]
Jul 26 18:36:20.797387 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.797365    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy"
Jul 26 18:36:20.797387 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.797389    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy"
Jul 26 18:36:20.797578 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.797405    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy"
Jul 26 18:36:20.797578 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.797414    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy"
Jul 26 18:36:20.797578 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.797507    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy"
Jul 26 18:36:20.802103 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.802078    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:20.804476 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.804454    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f349a2-openshift-default-dockercfg-zp88d\""
Jul 26 18:36:20.813708 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.813659    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"]
Jul 26 18:36:20.904274 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.904233    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-envoy\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:20.904498 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.904287    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-certs\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:20.904498 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.904336    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl2rm\" (UniqueName: \"kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-kube-api-access-bl2rm\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:20.904498 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.904409    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-podinfo\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:20.904498 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.904460    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-credential-socket\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:20.904498 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.904490    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-data\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:20.904770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.904517    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istiod-ca-cert\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:20.904770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.904558    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-token\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:20.904770 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:20.904611    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-socket\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.005774 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.005735    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-podinfo\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.005774 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.005786    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-credential-socket\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006060 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.005807    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-data\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006060 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.005827    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istiod-ca-cert\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006060 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.005853    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-token\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006060 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.005896    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-socket\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006060 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.005934    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-envoy\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006060 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.005964    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-certs\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006060 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.006004    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl2rm\" (UniqueName: \"kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-kube-api-access-bl2rm\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006462 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.006358    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-socket\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006516 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.006448    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-data\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006625 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.006588    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-credential-socket\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006769 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.006664    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-certs\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.006845 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.006784    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istiod-ca-cert\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.008372 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.008349    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-envoy\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.008713 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.008696    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-podinfo\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.014932 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.014907    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-token\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.015134 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.015113    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl2rm\" (UniqueName: \"kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-kube-api-access-bl2rm\") pod \"e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") " pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.115283 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.115247    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:21.275670 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.275642    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"]
Jul 26 18:36:21.277462 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:36:21.277434    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cbc19a_18f6_44df_9e2e_69fec40f50c6.slice/crio-b19def5f263e853b8787911fecabad8bf451c46cebd317a1326949226c882da1 WatchSource:0}: Error finding container b19def5f263e853b8787911fecabad8bf451c46cebd317a1326949226c882da1: Status 404 returned error can't find the container with id b19def5f263e853b8787911fecabad8bf451c46cebd317a1326949226c882da1
Jul 26 18:36:21.279838 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.279806    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:21.279935 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.279873    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:21.279935 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.279904    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:21.733668 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.733622    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" event={"ID":"a6cbc19a-18f6-44df-9e2e-69fec40f50c6","Type":"ContainerStarted","Data":"14ddbfb977e58e8001b95bfacdb5dac3c00262938283afdba4aac62839934405"}
Jul 26 18:36:21.733818 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.733703    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" event={"ID":"a6cbc19a-18f6-44df-9e2e-69fec40f50c6","Type":"ContainerStarted","Data":"b19def5f263e853b8787911fecabad8bf451c46cebd317a1326949226c882da1"}
Jul 26 18:36:21.764285 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:21.764227    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" podStartSLOduration=1.764180324 podStartE2EDuration="1.764180324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:36:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:36:21.76142977 +0000 UTC m=+2338.861682656" watchObservedRunningTime="2026-07-26 18:36:21.764180324 +0000 UTC m=+2338.864433209"
Jul 26 18:36:22.115948 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:22.115915    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:22.121227 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:22.121188    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:22.738776 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:22.738744    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:22.739695 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:22.739671    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:23.721478 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:23.721449    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:23.917588 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:23.917502    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"]
Jul 26 18:36:23.919005 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:23.918973    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="658c26e8-7e8a-4e48-a937-1e4258110325" containerName="istio-proxy"
Jul 26 18:36:23.924352 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:23.924313    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:23.926596 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:23.926567    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-f349a2-serving-cert\""
Jul 26 18:36:23.932913 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:23.932883    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"]
Jul 26 18:36:24.039489 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.039432    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a98fbc00-794d-44d9-b2b0-3efb754380c3-openshift-service-ca\") pod \"maas-api-e2e-api-b-f349a2-68cf46549b-w89d8\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.039489 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.039492    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djxsw\" (UniqueName: \"kubernetes.io/projected/a98fbc00-794d-44d9-b2b0-3efb754380c3-kube-api-access-djxsw\") pod \"maas-api-e2e-api-b-f349a2-68cf46549b-w89d8\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.039727 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.039623    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a98fbc00-794d-44d9-b2b0-3efb754380c3-maas-api-tls\") pod \"maas-api-e2e-api-b-f349a2-68cf46549b-w89d8\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.141112 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.141061    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a98fbc00-794d-44d9-b2b0-3efb754380c3-maas-api-tls\") pod \"maas-api-e2e-api-b-f349a2-68cf46549b-w89d8\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.141358 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.141180    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a98fbc00-794d-44d9-b2b0-3efb754380c3-openshift-service-ca\") pod \"maas-api-e2e-api-b-f349a2-68cf46549b-w89d8\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.141358 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.141242    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djxsw\" (UniqueName: \"kubernetes.io/projected/a98fbc00-794d-44d9-b2b0-3efb754380c3-kube-api-access-djxsw\") pod \"maas-api-e2e-api-b-f349a2-68cf46549b-w89d8\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.141358 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:36:24.141246    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-serving-cert: secret "maas-api-e2e-api-b-f349a2-serving-cert" not found
Jul 26 18:36:24.141539 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:36:24.141413    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a98fbc00-794d-44d9-b2b0-3efb754380c3-maas-api-tls podName:a98fbc00-794d-44d9-b2b0-3efb754380c3 nodeName:}" failed. No retries permitted until 2026-07-26 18:36:24.641392875 +0000 UTC m=+2341.741645739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a98fbc00-794d-44d9-b2b0-3efb754380c3-maas-api-tls") pod "maas-api-e2e-api-b-f349a2-68cf46549b-w89d8" (UID: "a98fbc00-794d-44d9-b2b0-3efb754380c3") : secret "maas-api-e2e-api-b-f349a2-serving-cert" not found
Jul 26 18:36:24.141922 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.141895    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a98fbc00-794d-44d9-b2b0-3efb754380c3-openshift-service-ca\") pod \"maas-api-e2e-api-b-f349a2-68cf46549b-w89d8\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.149549 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.149514    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djxsw\" (UniqueName: \"kubernetes.io/projected/a98fbc00-794d-44d9-b2b0-3efb754380c3-kube-api-access-djxsw\") pod \"maas-api-e2e-api-b-f349a2-68cf46549b-w89d8\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.646710 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.646666    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a98fbc00-794d-44d9-b2b0-3efb754380c3-maas-api-tls\") pod \"maas-api-e2e-api-b-f349a2-68cf46549b-w89d8\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.650074 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.650034    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a98fbc00-794d-44d9-b2b0-3efb754380c3-maas-api-tls\") pod \"maas-api-e2e-api-b-f349a2-68cf46549b-w89d8\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.840659 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.840621    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:24.993401 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:24.993365    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"]
Jul 26 18:36:24.995750 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:36:24.995711    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98fbc00_794d_44d9_b2b0_3efb754380c3.slice/crio-6cafb84abf9519cce73d92084eae8051b45d846c88ac718cce86958338a579d0 WatchSource:0}: Error finding container 6cafb84abf9519cce73d92084eae8051b45d846c88ac718cce86958338a579d0: Status 404 returned error can't find the container with id 6cafb84abf9519cce73d92084eae8051b45d846c88ac718cce86958338a579d0
Jul 26 18:36:25.755122 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:25.755028    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8" event={"ID":"a98fbc00-794d-44d9-b2b0-3efb754380c3","Type":"ContainerStarted","Data":"400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6"}
Jul 26 18:36:25.755344 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:25.755187    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:25.755344 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:25.755256    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8" event={"ID":"a98fbc00-794d-44d9-b2b0-3efb754380c3","Type":"ContainerStarted","Data":"6cafb84abf9519cce73d92084eae8051b45d846c88ac718cce86958338a579d0"}
Jul 26 18:36:25.774623 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:25.774552    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8" podStartSLOduration=2.393101319 podStartE2EDuration="2.77452916s" totalImagesPullingTime="381.427841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:36:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:36:25.772177601 +0000 UTC m=+2342.872430515" watchObservedRunningTime="2026-07-26 18:36:25.77452916 +0000 UTC m=+2342.874782052"
Jul 26 18:36:30.730408 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:30.730361    2548 patch_prober.go:28] interesting pod/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 18:36:30.730939 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:30.730430    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 26 18:36:31.770229 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:31.770160    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:36:32.799877 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:32.799843    2548 generic.go:356] "Generic (PLEG): container finished" podID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerID="d4fa169839996ab3b4504eb54631aec913f3dab8411de1f3977187b7b317bf82" exitCode=0
Jul 26 18:36:32.799877 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:32.799889    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" event={"ID":"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9","Type":"ContainerDied","Data":"d4fa169839996ab3b4504eb54631aec913f3dab8411de1f3977187b7b317bf82"}
Jul 26 18:36:32.800392 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:32.800305    2548 scope.go:117] "RemoveContainer" containerID="d4fa169839996ab3b4504eb54631aec913f3dab8411de1f3977187b7b317bf82"
Jul 26 18:36:32.801432 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:32.801391    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:32.801533 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:32.801460    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:32.801533 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:32.801494    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:33.806937 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:33.806902    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" event={"ID":"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9","Type":"ContainerStarted","Data":"0050c631c5e7c57547589010e70f71d1ccdf10f2ce160be3883a6eca784b8bda"}
Jul 26 18:36:34.041919 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:34.041881    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:34.042226 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:34.042175    2548 patch_prober.go:28] interesting pod/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 26 18:36:34.042349 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:34.042258    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 26 18:36:35.041522 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:35.041484    2548 patch_prober.go:28] interesting pod/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 26 18:36:35.041941 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:35.041544    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 26 18:36:36.041647 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:36.041530    2548 patch_prober.go:28] interesting pod/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 26 18:36:36.041647 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:36.041589    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 26 18:36:37.041872 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:37.041823    2548 patch_prober.go:28] interesting pod/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 26 18:36:37.042386 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:37.041888    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 26 18:36:38.045753 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:38.045717    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:38.046154 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:38.046089    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:38.046836 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:38.046820    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:36:41.851026 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:41.850938    2548 generic.go:356] "Generic (PLEG): container finished" podID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerID="14ddbfb977e58e8001b95bfacdb5dac3c00262938283afdba4aac62839934405" exitCode=0
Jul 26 18:36:41.851026 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:41.850987    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" event={"ID":"a6cbc19a-18f6-44df-9e2e-69fec40f50c6","Type":"ContainerDied","Data":"14ddbfb977e58e8001b95bfacdb5dac3c00262938283afdba4aac62839934405"}
Jul 26 18:36:41.851500 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:41.851448    2548 scope.go:117] "RemoveContainer" containerID="14ddbfb977e58e8001b95bfacdb5dac3c00262938283afdba4aac62839934405"
Jul 26 18:36:41.852622 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:41.852595    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:41.852687 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:41.852675    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:41.852727 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:41.852707    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:36:42.859916 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:42.859872    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" event={"ID":"a6cbc19a-18f6-44df-9e2e-69fec40f50c6","Type":"ContainerStarted","Data":"8331c9c91e0a784d08ced7ecb1096ef47e16904745443c3f18f670cf597f9841"}
Jul 26 18:36:43.115682 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:43.115652    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:43.115916 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:43.115894    2548 patch_prober.go:28] interesting pod/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 26 18:36:43.115979 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:43.115949    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 26 18:36:44.116328 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:44.116286    2548 patch_prober.go:28] interesting pod/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 26 18:36:44.116838 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:44.116368    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 26 18:36:45.116055 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:45.116016    2548 patch_prober.go:28] interesting pod/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 26 18:36:45.116281 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:45.116081    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 26 18:36:46.116397 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:46.116357    2548 patch_prober.go:28] interesting pod/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 26 18:36:46.116802 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:46.116429    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 26 18:36:47.119871 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:47.119838    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:47.120332 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:47.120113    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:47.120834 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:47.120817    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:36:52.451591 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.451554    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"]
Jul 26 18:36:52.452080 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.451850    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq" podUID="fc1217d2-f913-455c-adc1-10923fb13a93" containerName="maas-api" containerID="cri-o://9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1" gracePeriod=30
Jul 26 18:36:52.723317 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.723286    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:52.770598 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.770560    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1217d2-f913-455c-adc1-10923fb13a93-openshift-service-ca\") pod \"fc1217d2-f913-455c-adc1-10923fb13a93\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") "
Jul 26 18:36:52.770797 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.770650    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnzhq\" (UniqueName: \"kubernetes.io/projected/fc1217d2-f913-455c-adc1-10923fb13a93-kube-api-access-cnzhq\") pod \"fc1217d2-f913-455c-adc1-10923fb13a93\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") "
Jul 26 18:36:52.770797 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.770698    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1217d2-f913-455c-adc1-10923fb13a93-maas-api-tls\") pod \"fc1217d2-f913-455c-adc1-10923fb13a93\" (UID: \"fc1217d2-f913-455c-adc1-10923fb13a93\") "
Jul 26 18:36:52.770995 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.770966    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1217d2-f913-455c-adc1-10923fb13a93-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc1217d2-f913-455c-adc1-10923fb13a93" (UID: "fc1217d2-f913-455c-adc1-10923fb13a93"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:36:52.772952 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.772924    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc1217d2-f913-455c-adc1-10923fb13a93-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc1217d2-f913-455c-adc1-10923fb13a93" (UID: "fc1217d2-f913-455c-adc1-10923fb13a93"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:36:52.773074 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.773053    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1217d2-f913-455c-adc1-10923fb13a93-kube-api-access-cnzhq" (OuterVolumeSpecName: "kube-api-access-cnzhq") pod "fc1217d2-f913-455c-adc1-10923fb13a93" (UID: "fc1217d2-f913-455c-adc1-10923fb13a93"). InnerVolumeSpecName "kube-api-access-cnzhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:36:52.872178 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.872135    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc1217d2-f913-455c-adc1-10923fb13a93-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:52.872178 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.872169    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnzhq\" (UniqueName: \"kubernetes.io/projected/fc1217d2-f913-455c-adc1-10923fb13a93-kube-api-access-cnzhq\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:52.872178 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.872181    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc1217d2-f913-455c-adc1-10923fb13a93-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:36:52.922450 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.922416    2548 generic.go:356] "Generic (PLEG): container finished" podID="fc1217d2-f913-455c-adc1-10923fb13a93" containerID="9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1" exitCode=0
Jul 26 18:36:52.922616 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.922457    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"
Jul 26 18:36:52.922616 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.922481    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq" event={"ID":"fc1217d2-f913-455c-adc1-10923fb13a93","Type":"ContainerDied","Data":"9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1"}
Jul 26 18:36:52.922616 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.922527    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq" event={"ID":"fc1217d2-f913-455c-adc1-10923fb13a93","Type":"ContainerDied","Data":"d5be52f6af60a5ed1cd68d1460c57d2937f21f2dd3ac21d7912e932c23dcb15b"}
Jul 26 18:36:52.922616 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.922555    2548 scope.go:117] "RemoveContainer" containerID="9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1"
Jul 26 18:36:52.931722 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.931703    2548 scope.go:117] "RemoveContainer" containerID="9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1"
Jul 26 18:36:52.932014 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:36:52.931993    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1\": container with ID starting with 9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1 not found: ID does not exist" containerID="9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1"
Jul 26 18:36:52.932062 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.932023    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1"} err="failed to get container status \"9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1\": rpc error: code = NotFound desc = could not find container \"9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1\": container with ID starting with 9db2977898c6598ae37098010b3fa759f3aedac461286b147c5d5994189464a1 not found: ID does not exist"
Jul 26 18:36:52.944127 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.944101    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"]
Jul 26 18:36:52.947638 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:52.947616    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-138d4e-7656cc4999-hzjbq"]
Jul 26 18:36:53.414498 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:36:53.414465    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc1217d2-f913-455c-adc1-10923fb13a93" path="/var/lib/kubelet/pods/fc1217d2-f913-455c-adc1-10923fb13a93/volumes"
Jul 26 18:37:03.844812 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:03.844771    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"]
Jul 26 18:37:03.845267 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:03.844995    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy" containerID="cri-o://0050c631c5e7c57547589010e70f71d1ccdf10f2ce160be3883a6eca784b8bda" gracePeriod=30
Jul 26 18:37:08.049632 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:08.049583    2548 patch_prober.go:28] interesting pod/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 18:37:08.050124 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:08.049660    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 18:37:09.005686 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.005648    2548 generic.go:356] "Generic (PLEG): container finished" podID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerID="0050c631c5e7c57547589010e70f71d1ccdf10f2ce160be3883a6eca784b8bda" exitCode=0
Jul 26 18:37:09.005867 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.005707    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" event={"ID":"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9","Type":"ContainerDied","Data":"0050c631c5e7c57547589010e70f71d1ccdf10f2ce160be3883a6eca784b8bda"}
Jul 26 18:37:09.005867 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.005776    2548 scope.go:117] "RemoveContainer" containerID="d4fa169839996ab3b4504eb54631aec913f3dab8411de1f3977187b7b317bf82"
Jul 26 18:37:09.114228 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.114170    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:37:09.247366 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247324    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-podinfo\") pod \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") "
Jul 26 18:37:09.247366 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247375    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-data\") pod \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") "
Jul 26 18:37:09.247698 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247440    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-credential-socket\") pod \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") "
Jul 26 18:37:09.247698 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247476    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istiod-ca-cert\") pod \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") "
Jul 26 18:37:09.247698 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247553    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lldtf\" (UniqueName: \"kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-kube-api-access-lldtf\") pod \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") "
Jul 26 18:37:09.247698 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247607    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-socket\") pod \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") "
Jul 26 18:37:09.247698 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247639    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-envoy\") pod \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") "
Jul 26 18:37:09.247698 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247665    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-certs\") pod \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") "
Jul 26 18:37:09.248073 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247719    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-token\") pod \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\" (UID: \"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9\") "
Jul 26 18:37:09.248073 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247773    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" (UID: "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:37:09.248073 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247878    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" (UID: "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:37:09.248073 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.247957    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" (UID: "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:37:09.248073 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.248041    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" (UID: "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:37:09.248389 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.248133    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:09.248389 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.248155    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:09.248389 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.248164    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:09.248389 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.248174    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:09.248609 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.248439    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-data" (OuterVolumeSpecName: "istio-data") pod "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" (UID: "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:37:09.249826 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.249794    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-kube-api-access-lldtf" (OuterVolumeSpecName: "kube-api-access-lldtf") pod "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" (UID: "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9"). InnerVolumeSpecName "kube-api-access-lldtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:37:09.249967 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.249873    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" (UID: "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:37:09.250259 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.250238    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-token" (OuterVolumeSpecName: "istio-token") pod "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" (UID: "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:37:09.250259 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.250249    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" (UID: "be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:37:09.349674 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.349631    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lldtf\" (UniqueName: \"kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-kube-api-access-lldtf\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:09.349674 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.349664    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:09.349674 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.349674    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:09.349674 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.349682    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:09.349970 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:09.349691    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:10.012536 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:10.012497    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt" event={"ID":"be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9","Type":"ContainerDied","Data":"9b32c14b1267c036f7980851d728a2cf2386de84de1d2233e3254c363bf649e6"}
Jul 26 18:37:10.012536 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:10.012533    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"
Jul 26 18:37:10.012822 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:10.012572    2548 scope.go:117] "RemoveContainer" containerID="0050c631c5e7c57547589010e70f71d1ccdf10f2ce160be3883a6eca784b8bda"
Jul 26 18:37:10.031614 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:10.031581    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"]
Jul 26 18:37:10.037040 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:10.037015    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-138d4e-openshift-default-69fcb8d7c4-qg8bt"]
Jul 26 18:37:11.414150 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:11.414118    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" path="/var/lib/kubelet/pods/be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9/volumes"
Jul 26 18:37:19.801079 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:19.801028    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"]
Jul 26 18:37:19.801757 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:19.801299    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8" podUID="a98fbc00-794d-44d9-b2b0-3efb754380c3" containerName="maas-api" containerID="cri-o://400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6" gracePeriod=30
Jul 26 18:37:20.061348 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.061267    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:37:20.074162 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.074128    2548 generic.go:356] "Generic (PLEG): container finished" podID="a98fbc00-794d-44d9-b2b0-3efb754380c3" containerID="400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6" exitCode=0
Jul 26 18:37:20.074382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.074184    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"
Jul 26 18:37:20.074382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.074224    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8" event={"ID":"a98fbc00-794d-44d9-b2b0-3efb754380c3","Type":"ContainerDied","Data":"400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6"}
Jul 26 18:37:20.074382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.074287    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8" event={"ID":"a98fbc00-794d-44d9-b2b0-3efb754380c3","Type":"ContainerDied","Data":"6cafb84abf9519cce73d92084eae8051b45d846c88ac718cce86958338a579d0"}
Jul 26 18:37:20.074382 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.074315    2548 scope.go:117] "RemoveContainer" containerID="400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6"
Jul 26 18:37:20.085150 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.085126    2548 scope.go:117] "RemoveContainer" containerID="400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6"
Jul 26 18:37:20.085502 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:37:20.085479    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6\": container with ID starting with 400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6 not found: ID does not exist" containerID="400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6"
Jul 26 18:37:20.085611 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.085514    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6"} err="failed to get container status \"400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6\": rpc error: code = NotFound desc = could not find container \"400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6\": container with ID starting with 400419b8186d05fca69fa84479049daa4622b95b68876377bdd130735a158dd6 not found: ID does not exist"
Jul 26 18:37:20.157918 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.157878    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djxsw\" (UniqueName: \"kubernetes.io/projected/a98fbc00-794d-44d9-b2b0-3efb754380c3-kube-api-access-djxsw\") pod \"a98fbc00-794d-44d9-b2b0-3efb754380c3\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") "
Jul 26 18:37:20.158121 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.157936    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a98fbc00-794d-44d9-b2b0-3efb754380c3-openshift-service-ca\") pod \"a98fbc00-794d-44d9-b2b0-3efb754380c3\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") "
Jul 26 18:37:20.158121 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.158078    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a98fbc00-794d-44d9-b2b0-3efb754380c3-maas-api-tls\") pod \"a98fbc00-794d-44d9-b2b0-3efb754380c3\" (UID: \"a98fbc00-794d-44d9-b2b0-3efb754380c3\") "
Jul 26 18:37:20.158630 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.158543    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a98fbc00-794d-44d9-b2b0-3efb754380c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a98fbc00-794d-44d9-b2b0-3efb754380c3" (UID: "a98fbc00-794d-44d9-b2b0-3efb754380c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:37:20.160579 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.160556    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a98fbc00-794d-44d9-b2b0-3efb754380c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a98fbc00-794d-44d9-b2b0-3efb754380c3" (UID: "a98fbc00-794d-44d9-b2b0-3efb754380c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:37:20.160744 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.160722    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a98fbc00-794d-44d9-b2b0-3efb754380c3-kube-api-access-djxsw" (OuterVolumeSpecName: "kube-api-access-djxsw") pod "a98fbc00-794d-44d9-b2b0-3efb754380c3" (UID: "a98fbc00-794d-44d9-b2b0-3efb754380c3"). InnerVolumeSpecName "kube-api-access-djxsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:37:20.259463 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.259419    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djxsw\" (UniqueName: \"kubernetes.io/projected/a98fbc00-794d-44d9-b2b0-3efb754380c3-kube-api-access-djxsw\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:20.259463 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.259458    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a98fbc00-794d-44d9-b2b0-3efb754380c3-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:20.259673 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.259474    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a98fbc00-794d-44d9-b2b0-3efb754380c3-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:20.397939 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.397903    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"]
Jul 26 18:37:20.406035 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:20.406003    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-f349a2-68cf46549b-w89d8"]
Jul 26 18:37:21.414142 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:21.414106    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a98fbc00-794d-44d9-b2b0-3efb754380c3" path="/var/lib/kubelet/pods/a98fbc00-794d-44d9-b2b0-3efb754380c3/volumes"
Jul 26 18:37:31.007774 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.007735    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"]
Jul 26 18:37:31.008290 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.008004    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy" containerID="cri-o://8331c9c91e0a784d08ced7ecb1096ef47e16904745443c3f18f670cf597f9841" gracePeriod=30
Jul 26 18:37:31.827404 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.827348    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"]
Jul 26 18:37:31.827902 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.827884    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a98fbc00-794d-44d9-b2b0-3efb754380c3" containerName="maas-api"
Jul 26 18:37:31.827958 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.827905    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a98fbc00-794d-44d9-b2b0-3efb754380c3" containerName="maas-api"
Jul 26 18:37:31.827958 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.827923    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy"
Jul 26 18:37:31.827958 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.827928    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy"
Jul 26 18:37:31.827958 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.827936    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy"
Jul 26 18:37:31.827958 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.827942    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy"
Jul 26 18:37:31.827958 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.827955    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1217d2-f913-455c-adc1-10923fb13a93" containerName="maas-api"
Jul 26 18:37:31.828148 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.827960    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1217d2-f913-455c-adc1-10923fb13a93" containerName="maas-api"
Jul 26 18:37:31.828148 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.828032    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy"
Jul 26 18:37:31.828148 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.828039    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1217d2-f913-455c-adc1-10923fb13a93" containerName="maas-api"
Jul 26 18:37:31.828148 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.828045    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="a98fbc00-794d-44d9-b2b0-3efb754380c3" containerName="maas-api"
Jul 26 18:37:31.831016 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.831000    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:31.834329 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.834306    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-37e93d-openshift-default-dockercfg-ml6s8\""
Jul 26 18:37:31.843805 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.843774    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"]
Jul 26 18:37:31.977727 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.977682    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tntjl\" (UniqueName: \"kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-kube-api-access-tntjl\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:31.977943 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.977735    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-credential-socket\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:31.977943 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.977812    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-data\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:31.977943 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.977930    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-certs\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:31.978134 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.977971    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-istio-token\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:31.978134 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.978062    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/859e89b0-ff33-49c9-8330-f462a996228d-istio-podinfo\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:31.978279 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.978159    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-envoy\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:31.978279 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.978260    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/859e89b0-ff33-49c9-8330-f462a996228d-istiod-ca-cert\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:31.978380 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:31.978286    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-socket\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.079225 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.079090    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-envoy\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.079225 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.079150    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/859e89b0-ff33-49c9-8330-f462a996228d-istiod-ca-cert\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.079225 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.079179    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-socket\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.079841 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.079237    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tntjl\" (UniqueName: \"kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-kube-api-access-tntjl\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.079841 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.079257    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-credential-socket\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.079841 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.079278    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-data\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.079841 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.079352    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-certs\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.079841 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.079379    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-istio-token\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.079841 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.079405    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/859e89b0-ff33-49c9-8330-f462a996228d-istio-podinfo\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.080153 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.079902    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-credential-socket\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.080350 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.080320    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-socket\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.080350 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.080343    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-data\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.080701 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.080661    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-certs\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.081017 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.080963    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/859e89b0-ff33-49c9-8330-f462a996228d-istiod-ca-cert\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.082207 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.082042    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-envoy\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.082708 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.082687    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/859e89b0-ff33-49c9-8330-f462a996228d-istio-podinfo\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.088670 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.088641    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-istio-token\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.088959 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.088938    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tntjl\" (UniqueName: \"kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-kube-api-access-tntjl\") pod \"e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") " pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.123037 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.122995    2548 patch_prober.go:28] interesting pod/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 26 18:37:32.123225 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.123055    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 26 18:37:32.141632 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.141600    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:32.288840 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.288814    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"]
Jul 26 18:37:32.290350 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:37:32.290323    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859e89b0_ff33_49c9_8330_f462a996228d.slice/crio-2b4fd29fa1a31fb8afc9e1190f74aabc6d9ac4b55ab0ae0e01d9c2e4900babde WatchSource:0}: Error finding container 2b4fd29fa1a31fb8afc9e1190f74aabc6d9ac4b55ab0ae0e01d9c2e4900babde: Status 404 returned error can't find the container with id 2b4fd29fa1a31fb8afc9e1190f74aabc6d9ac4b55ab0ae0e01d9c2e4900babde
Jul 26 18:37:32.292632 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.292601    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:32.292737 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.292668    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:32.292737 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:32.292707    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:33.138324 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:33.138283    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" event={"ID":"859e89b0-ff33-49c9-8330-f462a996228d","Type":"ContainerStarted","Data":"0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d"}
Jul 26 18:37:33.138747 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:33.138346    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" event={"ID":"859e89b0-ff33-49c9-8330-f462a996228d","Type":"ContainerStarted","Data":"2b4fd29fa1a31fb8afc9e1190f74aabc6d9ac4b55ab0ae0e01d9c2e4900babde"}
Jul 26 18:37:33.142095 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:33.142073    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:33.147515 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:33.147489    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:33.167624 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:33.167558    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" podStartSLOduration=2.167541922 podStartE2EDuration="2.167541922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:37:33.165935487 +0000 UTC m=+2410.266188389" watchObservedRunningTime="2026-07-26 18:37:33.167541922 +0000 UTC m=+2410.267794808"
Jul 26 18:37:34.143277 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:34.143244    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:34.144376 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:34.144358    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:35.179102 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.179058    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"]
Jul 26 18:37:35.179750 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.179730    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="be300bd8-25f4-4836-b2ed-6bd4f4b3fcf9" containerName="istio-proxy"
Jul 26 18:37:35.192016 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.191986    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:35.196226 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.196171    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"]
Jul 26 18:37:35.197263 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.197239    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-37e93d-serving-cert\""
Jul 26 18:37:35.311941 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.311885    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/224b5954-cea8-4d28-b3fe-3de3ace04fd3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:35.312297 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.312261    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4bw8\" (UniqueName: \"kubernetes.io/projected/224b5954-cea8-4d28-b3fe-3de3ace04fd3-kube-api-access-d4bw8\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:35.312485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.312372    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:35.413344 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.413308    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/224b5954-cea8-4d28-b3fe-3de3ace04fd3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:35.413560 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.413371    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4bw8\" (UniqueName: \"kubernetes.io/projected/224b5954-cea8-4d28-b3fe-3de3ace04fd3-kube-api-access-d4bw8\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:35.413560 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.413434    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:35.413681 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:37:35.413589    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-serving-cert: secret "maas-api-e2e-shared-a-37e93d-serving-cert" not found
Jul 26 18:37:35.413681 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:37:35.413666    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls podName:224b5954-cea8-4d28-b3fe-3de3ace04fd3 nodeName:}" failed. No retries permitted until 2026-07-26 18:37:35.913644791 +0000 UTC m=+2413.013897660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls") pod "maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9" (UID: "224b5954-cea8-4d28-b3fe-3de3ace04fd3") : secret "maas-api-e2e-shared-a-37e93d-serving-cert" not found
Jul 26 18:37:35.413994 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.413972    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/224b5954-cea8-4d28-b3fe-3de3ace04fd3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:35.423870 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.423841    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4bw8\" (UniqueName: \"kubernetes.io/projected/224b5954-cea8-4d28-b3fe-3de3ace04fd3-kube-api-access-d4bw8\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:35.918293 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:35.918247    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:35.918573 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:37:35.918396    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-serving-cert: secret "maas-api-e2e-shared-a-37e93d-serving-cert" not found
Jul 26 18:37:35.918573 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:37:35.918476    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls podName:224b5954-cea8-4d28-b3fe-3de3ace04fd3 nodeName:}" failed. No retries permitted until 2026-07-26 18:37:36.918460353 +0000 UTC m=+2414.018713217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls") pod "maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9" (UID: "224b5954-cea8-4d28-b3fe-3de3ace04fd3") : secret "maas-api-e2e-shared-a-37e93d-serving-cert" not found
Jul 26 18:37:36.157180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.157096    2548 generic.go:356] "Generic (PLEG): container finished" podID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerID="8331c9c91e0a784d08ced7ecb1096ef47e16904745443c3f18f670cf597f9841" exitCode=0
Jul 26 18:37:36.157431 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.157156    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" event={"ID":"a6cbc19a-18f6-44df-9e2e-69fec40f50c6","Type":"ContainerDied","Data":"8331c9c91e0a784d08ced7ecb1096ef47e16904745443c3f18f670cf597f9841"}
Jul 26 18:37:36.157431 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.157288    2548 scope.go:117] "RemoveContainer" containerID="14ddbfb977e58e8001b95bfacdb5dac3c00262938283afdba4aac62839934405"
Jul 26 18:37:36.293297 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.293271    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:37:36.429272 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429152    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-envoy\") pod \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") "
Jul 26 18:37:36.429272 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429221    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-certs\") pod \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") "
Jul 26 18:37:36.429272 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429263    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istiod-ca-cert\") pod \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") "
Jul 26 18:37:36.429549 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429311    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl2rm\" (UniqueName: \"kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-kube-api-access-bl2rm\") pod \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") "
Jul 26 18:37:36.429549 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429358    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-token\") pod \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") "
Jul 26 18:37:36.429549 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429395    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-socket\") pod \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") "
Jul 26 18:37:36.429549 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429440    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-data\") pod \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") "
Jul 26 18:37:36.429549 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429501    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-credential-socket\") pod \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") "
Jul 26 18:37:36.429549 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429534    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6cbc19a-18f6-44df-9e2e-69fec40f50c6" (UID: "a6cbc19a-18f6-44df-9e2e-69fec40f50c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:37:36.429549 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429551    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-podinfo\") pod \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\" (UID: \"a6cbc19a-18f6-44df-9e2e-69fec40f50c6\") "
Jul 26 18:37:36.429925 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429657    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6cbc19a-18f6-44df-9e2e-69fec40f50c6" (UID: "a6cbc19a-18f6-44df-9e2e-69fec40f50c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:37:36.429925 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429756    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6cbc19a-18f6-44df-9e2e-69fec40f50c6" (UID: "a6cbc19a-18f6-44df-9e2e-69fec40f50c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:37:36.430041 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429940    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6cbc19a-18f6-44df-9e2e-69fec40f50c6" (UID: "a6cbc19a-18f6-44df-9e2e-69fec40f50c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:37:36.430041 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429977    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:36.430041 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.429998    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:36.430041 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.430015    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:36.430482 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.430456    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6cbc19a-18f6-44df-9e2e-69fec40f50c6" (UID: "a6cbc19a-18f6-44df-9e2e-69fec40f50c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:37:36.431675 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.431640    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6cbc19a-18f6-44df-9e2e-69fec40f50c6" (UID: "a6cbc19a-18f6-44df-9e2e-69fec40f50c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:37:36.431780 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.431707    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-kube-api-access-bl2rm" (OuterVolumeSpecName: "kube-api-access-bl2rm") pod "a6cbc19a-18f6-44df-9e2e-69fec40f50c6" (UID: "a6cbc19a-18f6-44df-9e2e-69fec40f50c6"). InnerVolumeSpecName "kube-api-access-bl2rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:37:36.431869 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.431850    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6cbc19a-18f6-44df-9e2e-69fec40f50c6" (UID: "a6cbc19a-18f6-44df-9e2e-69fec40f50c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:37:36.431925 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.431862    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6cbc19a-18f6-44df-9e2e-69fec40f50c6" (UID: "a6cbc19a-18f6-44df-9e2e-69fec40f50c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:37:36.531403 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.531362    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl2rm\" (UniqueName: \"kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-kube-api-access-bl2rm\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:36.531403 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.531393    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:36.531403 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.531402    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:36.531403 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.531410    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:36.531692 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.531422    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:36.531692 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.531437    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6cbc19a-18f6-44df-9e2e-69fec40f50c6-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:37:36.935149 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.935110    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:36.937596 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:36.937568    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls\") pod \"maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:37.011688 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:37.011645    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:37.157370 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:37.157331    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"]
Jul 26 18:37:37.159213 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:37:37.159163    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224b5954_cea8_4d28_b3fe_3de3ace04fd3.slice/crio-0eec105304cd87ab637bb8e264d3dd53b091d4a7423b37d0b0a3b57aeb2806a6 WatchSource:0}: Error finding container 0eec105304cd87ab637bb8e264d3dd53b091d4a7423b37d0b0a3b57aeb2806a6: Status 404 returned error can't find the container with id 0eec105304cd87ab637bb8e264d3dd53b091d4a7423b37d0b0a3b57aeb2806a6
Jul 26 18:37:37.166576 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:37.166557    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"
Jul 26 18:37:37.166686 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:37.166564    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m" event={"ID":"a6cbc19a-18f6-44df-9e2e-69fec40f50c6","Type":"ContainerDied","Data":"b19def5f263e853b8787911fecabad8bf451c46cebd317a1326949226c882da1"}
Jul 26 18:37:37.166686 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:37.166642    2548 scope.go:117] "RemoveContainer" containerID="8331c9c91e0a784d08ced7ecb1096ef47e16904745443c3f18f670cf597f9841"
Jul 26 18:37:37.191136 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:37.191047    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"]
Jul 26 18:37:37.193475 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:37.193447    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f349a2-openshift-default-5b4b9658d4-x8s7m"]
Jul 26 18:37:37.415238 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:37.415186    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" path="/var/lib/kubelet/pods/a6cbc19a-18f6-44df-9e2e-69fec40f50c6/volumes"
Jul 26 18:37:38.174847 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:38.174809    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9" event={"ID":"224b5954-cea8-4d28-b3fe-3de3ace04fd3","Type":"ContainerStarted","Data":"495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f"}
Jul 26 18:37:38.175063 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:38.174865    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9" event={"ID":"224b5954-cea8-4d28-b3fe-3de3ace04fd3","Type":"ContainerStarted","Data":"0eec105304cd87ab637bb8e264d3dd53b091d4a7423b37d0b0a3b57aeb2806a6"}
Jul 26 18:37:38.175063 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:38.174922    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:38.193675 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:38.193622    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9" podStartSLOduration=2.801065944 podStartE2EDuration="3.193605565s" totalImagesPullingTime="392.539621ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:37:38.192249028 +0000 UTC m=+2415.292501924" watchObservedRunningTime="2026-07-26 18:37:38.193605565 +0000 UTC m=+2415.293858450"
Jul 26 18:37:40.167963 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.167924    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"]
Jul 26 18:37:40.168544 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.168520    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy"
Jul 26 18:37:40.168544 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.168542    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy"
Jul 26 18:37:40.168773 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.168556    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy"
Jul 26 18:37:40.168773 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.168561    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy"
Jul 26 18:37:40.168773 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.168641    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy"
Jul 26 18:37:40.168773 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.168650    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6cbc19a-18f6-44df-9e2e-69fec40f50c6" containerName="istio-proxy"
Jul 26 18:37:40.171934 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.171912    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.174763 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.174746    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d112e4-openshift-default-dockercfg-2ntgn\""
Jul 26 18:37:40.187053 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.187021    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"]
Jul 26 18:37:40.276348 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.276302    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-envoy\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.276558 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.276355    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kmqx\" (UniqueName: \"kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-kube-api-access-4kmqx\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.276558 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.276438    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-istio-token\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.276558 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.276478    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-certs\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.276558 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.276532    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-credential-socket\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.276874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.276571    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-data\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.276874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.276598    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/443f653b-e8e0-43be-a76a-38df00d766f6-istiod-ca-cert\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.276874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.276647    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/443f653b-e8e0-43be-a76a-38df00d766f6-istio-podinfo\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.276874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.276682    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-socket\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378042 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378001    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/443f653b-e8e0-43be-a76a-38df00d766f6-istio-podinfo\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378042 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378048    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-socket\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378324 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378159    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-envoy\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378324 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378237    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kmqx\" (UniqueName: \"kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-kube-api-access-4kmqx\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378324 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378304    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-istio-token\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378494 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378340    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-certs\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378494 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378392    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-credential-socket\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378494 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378434    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-data\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378494 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378463    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/443f653b-e8e0-43be-a76a-38df00d766f6-istiod-ca-cert\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378689 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378494    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-socket\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378776 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378755    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-credential-socket\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378848 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378816    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-data\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.378923 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.378861    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-certs\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.379328 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.379305    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/443f653b-e8e0-43be-a76a-38df00d766f6-istiod-ca-cert\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.380483 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.380461    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-envoy\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.381034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.381011    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/443f653b-e8e0-43be-a76a-38df00d766f6-istio-podinfo\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.387147 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.387115    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-istio-token\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.387357 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.387338    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kmqx\" (UniqueName: \"kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-kube-api-access-4kmqx\") pod \"e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") " pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.482508 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.482408    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:40.636583 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.636546    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"]
Jul 26 18:37:40.643260 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.643229    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:40.643341 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.643301    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:40.643341 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:40.643330    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:41.191240 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:41.191171    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" event={"ID":"443f653b-e8e0-43be-a76a-38df00d766f6","Type":"ContainerStarted","Data":"6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404"}
Jul 26 18:37:41.191644 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:41.191263    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" event={"ID":"443f653b-e8e0-43be-a76a-38df00d766f6","Type":"ContainerStarted","Data":"8c6eb16c1ff6de8082a093e679879c866881742d5dce6e956d984a5b0cde6ed0"}
Jul 26 18:37:41.224680 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:41.224627    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" podStartSLOduration=1.2246085 podStartE2EDuration="1.2246085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:37:41.224073088 +0000 UTC m=+2418.324326005" watchObservedRunningTime="2026-07-26 18:37:41.2246085 +0000 UTC m=+2418.324861479"
Jul 26 18:37:41.482852 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:41.482758    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:41.488017 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:41.487990    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:42.196734 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:42.196698    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:42.197860 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:42.197836    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:37:43.245958 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.245897    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"]
Jul 26 18:37:43.250489 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.250463    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:43.253864 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.253840    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-d112e4-serving-cert\""
Jul 26 18:37:43.271168 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.271133    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"]
Jul 26 18:37:43.410808 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.410766    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnd6z\" (UniqueName: \"kubernetes.io/projected/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-kube-api-access-wnd6z\") pod \"maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:43.411004 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.410971    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:43.411089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.411063    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:43.512866 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.512769    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:43.512866 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.512825    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnd6z\" (UniqueName: \"kubernetes.io/projected/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-kube-api-access-wnd6z\") pod \"maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:43.513113 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:37:43.512929    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-serving-cert: secret "maas-api-e2e-shared-b-d112e4-serving-cert" not found
Jul 26 18:37:43.513395 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:37:43.513376    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-maas-api-tls podName:1c889d60-54da-4860-ae4b-0b0a6c25bb6e nodeName:}" failed. No retries permitted until 2026-07-26 18:37:44.012984117 +0000 UTC m=+2421.113236985 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-maas-api-tls") pod "maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4" (UID: "1c889d60-54da-4860-ae4b-0b0a6c25bb6e") : secret "maas-api-e2e-shared-b-d112e4-serving-cert" not found
Jul 26 18:37:43.513493 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.513478    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:43.514185 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.514168    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:43.526348 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:43.526319    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnd6z\" (UniqueName: \"kubernetes.io/projected/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-kube-api-access-wnd6z\") pod \"maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:44.019866 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:44.019825    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:44.023087 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:44.023054    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-maas-api-tls\") pod \"maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:44.162957 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:44.162912    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:44.189648 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:44.189611    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:37:44.402609 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:44.402447    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"]
Jul 26 18:37:44.414840 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:37:44.414801    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c889d60_54da_4860_ae4b_0b0a6c25bb6e.slice/crio-456949059f5949a5cd5f8af71835e1011415f2c9762bc3c96b00fee2ec2dcd98 WatchSource:0}: Error finding container 456949059f5949a5cd5f8af71835e1011415f2c9762bc3c96b00fee2ec2dcd98: Status 404 returned error can't find the container with id 456949059f5949a5cd5f8af71835e1011415f2c9762bc3c96b00fee2ec2dcd98
Jul 26 18:37:45.215160 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:45.215074    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4" event={"ID":"1c889d60-54da-4860-ae4b-0b0a6c25bb6e","Type":"ContainerStarted","Data":"3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71"}
Jul 26 18:37:45.215328 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:45.215170    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4" event={"ID":"1c889d60-54da-4860-ae4b-0b0a6c25bb6e","Type":"ContainerStarted","Data":"456949059f5949a5cd5f8af71835e1011415f2c9762bc3c96b00fee2ec2dcd98"}
Jul 26 18:37:45.215328 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:45.215218    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:45.234347 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:45.234293    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4" podStartSLOduration=1.919079475 podStartE2EDuration="2.234275941s" totalImagesPullingTime="315.196466ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:37:45.233382314 +0000 UTC m=+2422.333635220" watchObservedRunningTime="2026-07-26 18:37:45.234275941 +0000 UTC m=+2422.334528826"
Jul 26 18:37:50.185391 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:50.185340    2548 patch_prober.go:28] interesting pod/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 18:37:50.185944 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:50.185410    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 26 18:37:51.226157 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:51.226058    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:37:51.249702 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:51.249668    2548 generic.go:356] "Generic (PLEG): container finished" podID="859e89b0-ff33-49c9-8330-f462a996228d" containerID="0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d" exitCode=0
Jul 26 18:37:51.249873 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:51.249757    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" event={"ID":"859e89b0-ff33-49c9-8330-f462a996228d","Type":"ContainerDied","Data":"0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d"}
Jul 26 18:37:51.250250 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:51.250233    2548 scope.go:117] "RemoveContainer" containerID="0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d"
Jul 26 18:37:51.251380 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:51.251352    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:51.251469 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:51.251413    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:51.251469 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:51.251448    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:52.256922 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:52.256878    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" event={"ID":"859e89b0-ff33-49c9-8330-f462a996228d","Type":"ContainerStarted","Data":"303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa"}
Jul 26 18:37:53.142457 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:53.142426    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:53.142796 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:53.142768    2548 patch_prober.go:28] interesting pod/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 18:37:53.142913 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:53.142814    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 18:37:54.142994 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:54.142959    2548 patch_prober.go:28] interesting pod/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 18:37:54.143453 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:54.143317    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 18:37:55.142870 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:55.142823    2548 patch_prober.go:28] interesting pod/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 18:37:55.143066 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:55.142895    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 18:37:56.142269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:56.142227    2548 patch_prober.go:28] interesting pod/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 26 18:37:56.142478 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:56.142305    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 26 18:37:57.145782 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:57.145747    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:57.146379 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:57.146111    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:57.146838 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:57.146819    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:37:58.238389 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:58.238334    2548 patch_prober.go:28] interesting pod/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 26 18:37:58.238817 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:58.238426    2548 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 26 18:37:59.304751 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:59.304716    2548 generic.go:356] "Generic (PLEG): container finished" podID="443f653b-e8e0-43be-a76a-38df00d766f6" containerID="6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404" exitCode=0
Jul 26 18:37:59.305237 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:59.304789    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" event={"ID":"443f653b-e8e0-43be-a76a-38df00d766f6","Type":"ContainerDied","Data":"6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404"}
Jul 26 18:37:59.305237 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:59.305224    2548 scope.go:117] "RemoveContainer" containerID="6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404"
Jul 26 18:37:59.306294 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:59.306266    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:59.306362 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:59.306342    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:37:59.306398 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:37:59.306381    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:38:00.318337 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:00.318299    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" event={"ID":"443f653b-e8e0-43be-a76a-38df00d766f6","Type":"ContainerStarted","Data":"add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9"}
Jul 26 18:38:00.483064 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:00.483008    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:38:00.483383 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:00.483356    2548 patch_prober.go:28] interesting pod/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 26 18:38:00.483450 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:00.483420    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 26 18:38:01.483262 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:01.483184    2548 patch_prober.go:28] interesting pod/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 26 18:38:01.483700 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:01.483291    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 26 18:38:02.483314 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:02.483261    2548 patch_prober.go:28] interesting pod/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 26 18:38:02.483847 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:02.483339    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 26 18:38:03.483003 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:03.482969    2548 patch_prober.go:28] interesting pod/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Jul 26 18:38:03.483322 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:03.483287    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Jul 26 18:38:04.486847 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:04.486815    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:38:04.487254 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:04.487177    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:38:04.487784 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:04.487764    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:38:17.541436 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.541397    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"]
Jul 26 18:38:17.546452 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.546430    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.550524 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.550465    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d112e4\"/\"openshift-service-ca.crt\""
Jul 26 18:38:17.550789 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.550760    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d112e4\"/\"kube-root-ca.crt\""
Jul 26 18:38:17.560056 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.551562    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d112e4\"/\"default-dockercfg-5h9xv\""
Jul 26 18:38:17.560056 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.551901    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d112e4\"/\"auth-test-model-d112e4-kserve-self-signed-certs\""
Jul 26 18:38:17.560056 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.557344    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"]
Jul 26 18:38:17.568961 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.568931    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-tmp-dir\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.568961 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.568965    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7864becf-0b9c-42be-9cc5-74678cb32745-tls-certs\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.569221 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.568989    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-dshm\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.569221 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.569035    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-home\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.569221 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.569095    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwv9m\" (UniqueName: \"kubernetes.io/projected/7864becf-0b9c-42be-9cc5-74678cb32745-kube-api-access-mwv9m\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.569404 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.569288    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-model-cache\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.670244 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.670174    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwv9m\" (UniqueName: \"kubernetes.io/projected/7864becf-0b9c-42be-9cc5-74678cb32745-kube-api-access-mwv9m\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.670456 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.670315    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-model-cache\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.670456 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.670376    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-tmp-dir\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.670456 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.670405    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7864becf-0b9c-42be-9cc5-74678cb32745-tls-certs\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.670631 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.670477    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-dshm\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.670631 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.670535    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-home\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.670898 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.670874    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-model-cache\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.671001 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.670932    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-tmp-dir\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.671001 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.670972    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-home\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.672909 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.672885    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-dshm\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.673070 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.673051    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7864becf-0b9c-42be-9cc5-74678cb32745-tls-certs\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.679391 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.679368    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwv9m\" (UniqueName: \"kubernetes.io/projected/7864becf-0b9c-42be-9cc5-74678cb32745-kube-api-access-mwv9m\") pod \"auth-test-model-d112e4-kserve-7dc8657475-vgwgl\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") " pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:17.865257 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:17.865227    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:18.015134 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:18.015107    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"]
Jul 26 18:38:18.017858 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:38:18.017833    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7864becf_0b9c_42be_9cc5_74678cb32745.slice/crio-dfebc5717620f3ead2f52171d917e2e6a062a8670a482e80773f65f0e5abb8dd WatchSource:0}: Error finding container dfebc5717620f3ead2f52171d917e2e6a062a8670a482e80773f65f0e5abb8dd: Status 404 returned error can't find the container with id dfebc5717620f3ead2f52171d917e2e6a062a8670a482e80773f65f0e5abb8dd
Jul 26 18:38:18.411422 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:18.411385    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl" event={"ID":"7864becf-0b9c-42be-9cc5-74678cb32745","Type":"ContainerStarted","Data":"dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c"}
Jul 26 18:38:18.411422 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:18.411428    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl" event={"ID":"7864becf-0b9c-42be-9cc5-74678cb32745","Type":"ContainerStarted","Data":"dfebc5717620f3ead2f52171d917e2e6a062a8670a482e80773f65f0e5abb8dd"}
Jul 26 18:38:18.451068 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:18.451010    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl" podStartSLOduration=1.4509941849999999 podStartE2EDuration="1.450994185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:38:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:38:18.449868269 +0000 UTC m=+2455.550121154" watchObservedRunningTime="2026-07-26 18:38:18.450994185 +0000 UTC m=+2455.551247070"
Jul 26 18:38:27.865567 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:27.865525    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:27.866038 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:27.865581    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:27.879474 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:27.879442    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:38:28.473114 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:38:28.473085    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:42:49.915051 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:42:49.914952    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"]
Jul 26 18:43:04.934387 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:04.934325    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl" podUID="7864becf-0b9c-42be-9cc5-74678cb32745" containerName="main" containerID="cri-o://dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c" gracePeriod=45
Jul 26 18:43:05.206837 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.206810    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:43:05.302066 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302026    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7864becf-0b9c-42be-9cc5-74678cb32745-tls-certs\") pod \"7864becf-0b9c-42be-9cc5-74678cb32745\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") "
Jul 26 18:43:05.302269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302145    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-tmp-dir\") pod \"7864becf-0b9c-42be-9cc5-74678cb32745\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") "
Jul 26 18:43:05.302269 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302249    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-dshm\") pod \"7864becf-0b9c-42be-9cc5-74678cb32745\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") "
Jul 26 18:43:05.302374 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302281    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-model-cache\") pod \"7864becf-0b9c-42be-9cc5-74678cb32745\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") "
Jul 26 18:43:05.302374 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302313    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-home\") pod \"7864becf-0b9c-42be-9cc5-74678cb32745\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") "
Jul 26 18:43:05.302471 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302390    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwv9m\" (UniqueName: \"kubernetes.io/projected/7864becf-0b9c-42be-9cc5-74678cb32745-kube-api-access-mwv9m\") pod \"7864becf-0b9c-42be-9cc5-74678cb32745\" (UID: \"7864becf-0b9c-42be-9cc5-74678cb32745\") "
Jul 26 18:43:05.302471 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302442    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7864becf-0b9c-42be-9cc5-74678cb32745" (UID: "7864becf-0b9c-42be-9cc5-74678cb32745"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:43:05.302601 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302575    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-model-cache" (OuterVolumeSpecName: "model-cache") pod "7864becf-0b9c-42be-9cc5-74678cb32745" (UID: "7864becf-0b9c-42be-9cc5-74678cb32745"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:43:05.302662 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302614    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-home" (OuterVolumeSpecName: "home") pod "7864becf-0b9c-42be-9cc5-74678cb32745" (UID: "7864becf-0b9c-42be-9cc5-74678cb32745"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:43:05.302862 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302844    2548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-tmp-dir\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:43:05.302949 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302866    2548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-model-cache\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:43:05.302949 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.302878    2548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-home\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:43:05.304474 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.304453    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7864becf-0b9c-42be-9cc5-74678cb32745-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7864becf-0b9c-42be-9cc5-74678cb32745" (UID: "7864becf-0b9c-42be-9cc5-74678cb32745"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:43:05.304549 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.304479    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-dshm" (OuterVolumeSpecName: "dshm") pod "7864becf-0b9c-42be-9cc5-74678cb32745" (UID: "7864becf-0b9c-42be-9cc5-74678cb32745"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:43:05.304832 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.304809    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7864becf-0b9c-42be-9cc5-74678cb32745-kube-api-access-mwv9m" (OuterVolumeSpecName: "kube-api-access-mwv9m") pod "7864becf-0b9c-42be-9cc5-74678cb32745" (UID: "7864becf-0b9c-42be-9cc5-74678cb32745"). InnerVolumeSpecName "kube-api-access-mwv9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:43:05.403992 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.403959    2548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7864becf-0b9c-42be-9cc5-74678cb32745-dshm\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:43:05.403992 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.403988    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwv9m\" (UniqueName: \"kubernetes.io/projected/7864becf-0b9c-42be-9cc5-74678cb32745-kube-api-access-mwv9m\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:43:05.403992 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.404000    2548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7864becf-0b9c-42be-9cc5-74678cb32745-tls-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:43:05.907089 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.907051    2548 generic.go:356] "Generic (PLEG): container finished" podID="7864becf-0b9c-42be-9cc5-74678cb32745" containerID="dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c" exitCode=0
Jul 26 18:43:05.907293 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.907106    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"
Jul 26 18:43:05.907293 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.907123    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl" event={"ID":"7864becf-0b9c-42be-9cc5-74678cb32745","Type":"ContainerDied","Data":"dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c"}
Jul 26 18:43:05.907293 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.907164    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl" event={"ID":"7864becf-0b9c-42be-9cc5-74678cb32745","Type":"ContainerDied","Data":"dfebc5717620f3ead2f52171d917e2e6a062a8670a482e80773f65f0e5abb8dd"}
Jul 26 18:43:05.907293 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.907185    2548 scope.go:117] "RemoveContainer" containerID="dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c"
Jul 26 18:43:05.916653 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.916637    2548 scope.go:117] "RemoveContainer" containerID="dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c"
Jul 26 18:43:05.916945 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:43:05.916927    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c\": container with ID starting with dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c not found: ID does not exist" containerID="dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c"
Jul 26 18:43:05.916994 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.916955    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c"} err="failed to get container status \"dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c\": rpc error: code = NotFound desc = could not find container \"dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c\": container with ID starting with dd623b75d98e22b8c3b47406f52da2303e3712a53224b83884ba2aaa0a09637c not found: ID does not exist"
Jul 26 18:43:05.923536 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.923505    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"]
Jul 26 18:43:05.928584 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:05.928558    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d112e4/auth-test-model-d112e4-kserve-7dc8657475-vgwgl"]
Jul 26 18:43:07.414078 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:43:07.414045    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7864becf-0b9c-42be-9cc5-74678cb32745" path="/var/lib/kubelet/pods/7864becf-0b9c-42be-9cc5-74678cb32745/volumes"
Jul 26 18:47:04.326883 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.326847    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"]
Jul 26 18:47:04.327377 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.327261    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7864becf-0b9c-42be-9cc5-74678cb32745" containerName="main"
Jul 26 18:47:04.327377 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.327272    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="7864becf-0b9c-42be-9cc5-74678cb32745" containerName="main"
Jul 26 18:47:04.327377 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.327341    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="7864becf-0b9c-42be-9cc5-74678cb32745" containerName="main"
Jul 26 18:47:04.330445 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.330428    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:04.332630 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.332612    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-33964c-serving-cert\""
Jul 26 18:47:04.338517 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.338495    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"]
Jul 26 18:47:04.502349 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.502315    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1908925-71d4-4b18-9720-2aaaeffc5d79-maas-api-tls\") pod \"maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:04.502560 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.502405    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rkwl\" (UniqueName: \"kubernetes.io/projected/e1908925-71d4-4b18-9720-2aaaeffc5d79-kube-api-access-2rkwl\") pod \"maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:04.502560 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.502454    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1908925-71d4-4b18-9720-2aaaeffc5d79-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:04.603928 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.603834    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rkwl\" (UniqueName: \"kubernetes.io/projected/e1908925-71d4-4b18-9720-2aaaeffc5d79-kube-api-access-2rkwl\") pod \"maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:04.603928 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.603896    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1908925-71d4-4b18-9720-2aaaeffc5d79-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:04.604162 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.604020    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1908925-71d4-4b18-9720-2aaaeffc5d79-maas-api-tls\") pod \"maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:04.604240 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:47:04.604156    2548 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-serving-cert: secret "maas-api-e2e-ipp-a-33964c-serving-cert" not found
Jul 26 18:47:04.604293 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:47:04.604241    2548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1908925-71d4-4b18-9720-2aaaeffc5d79-maas-api-tls podName:e1908925-71d4-4b18-9720-2aaaeffc5d79 nodeName:}" failed. No retries permitted until 2026-07-26 18:47:05.104225345 +0000 UTC m=+2982.204478210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e1908925-71d4-4b18-9720-2aaaeffc5d79-maas-api-tls") pod "maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d" (UID: "e1908925-71d4-4b18-9720-2aaaeffc5d79") : secret "maas-api-e2e-ipp-a-33964c-serving-cert" not found
Jul 26 18:47:04.604605 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.604586    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1908925-71d4-4b18-9720-2aaaeffc5d79-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:04.612257 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:04.612234    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rkwl\" (UniqueName: \"kubernetes.io/projected/e1908925-71d4-4b18-9720-2aaaeffc5d79-kube-api-access-2rkwl\") pod \"maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:05.109748 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:05.109707    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1908925-71d4-4b18-9720-2aaaeffc5d79-maas-api-tls\") pod \"maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:05.112633 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:05.112609    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1908925-71d4-4b18-9720-2aaaeffc5d79-maas-api-tls\") pod \"maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:05.241591 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:05.241560    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:05.404834 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:05.404782    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"]
Jul 26 18:47:05.407616 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:47:05.407574    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1908925_71d4_4b18_9720_2aaaeffc5d79.slice/crio-25b3acb153cb333bb6cfb2b92fc9e3a259ea1f78383bd78d2392c2a3dd8442e9 WatchSource:0}: Error finding container 25b3acb153cb333bb6cfb2b92fc9e3a259ea1f78383bd78d2392c2a3dd8442e9: Status 404 returned error can't find the container with id 25b3acb153cb333bb6cfb2b92fc9e3a259ea1f78383bd78d2392c2a3dd8442e9
Jul 26 18:47:05.409241 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:05.409221    2548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 26 18:47:06.103302 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:06.103212    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d" event={"ID":"e1908925-71d4-4b18-9720-2aaaeffc5d79","Type":"ContainerStarted","Data":"5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9"}
Jul 26 18:47:06.103302 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:06.103263    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d" event={"ID":"e1908925-71d4-4b18-9720-2aaaeffc5d79","Type":"ContainerStarted","Data":"25b3acb153cb333bb6cfb2b92fc9e3a259ea1f78383bd78d2392c2a3dd8442e9"}
Jul 26 18:47:06.103302 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:06.103292    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:06.120547 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:06.120495    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d" podStartSLOduration=1.7028635680000002 podStartE2EDuration="2.120479818s" totalImagesPullingTime="417.61625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:47:06.118144356 +0000 UTC m=+2983.218397268" watchObservedRunningTime="2026-07-26 18:47:06.120479818 +0000 UTC m=+2983.220732703"
Jul 26 18:47:12.115602 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:12.115564    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:47:19.838669 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.838631    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"]
Jul 26 18:47:19.843367 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.843341    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:19.845522 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.845498    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-f6bce0-openshift-default-dockercfg-kxjp7\""
Jul 26 18:47:19.853430 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.853405    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"]
Jul 26 18:47:19.948366 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.948247    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-data\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:19.948589 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.948467    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-istio-token\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:19.948589 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.948507    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-envoy\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:19.948745 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.948606    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-credential-socket\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:19.948745 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.948682    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-socket\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:19.948745 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.948712    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btb7j\" (UniqueName: \"kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-kube-api-access-btb7j\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:19.948745 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.948742    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10c47fef-747b-4266-8170-313f4f0787db-istiod-ca-cert\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:19.948967 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.948819    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-certs\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:19.948967 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:19.948890    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10c47fef-747b-4266-8170-313f4f0787db-istio-podinfo\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050261 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050185    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-data\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050478 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050279    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-istio-token\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050478 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050309    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-envoy\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050478 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050348    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-credential-socket\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050478 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050388    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-socket\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050478 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050410    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btb7j\" (UniqueName: \"kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-kube-api-access-btb7j\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050478 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050438    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10c47fef-747b-4266-8170-313f4f0787db-istiod-ca-cert\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050478 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050474    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-certs\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050803 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050527    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10c47fef-747b-4266-8170-313f4f0787db-istio-podinfo\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050803 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050684    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-data\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050872 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050805    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-credential-socket\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.050872 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.050831    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-socket\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.051321 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.051298    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-certs\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.051453 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.051435    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10c47fef-747b-4266-8170-313f4f0787db-istiod-ca-cert\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.052811 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.052783    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-envoy\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.053618 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.053597    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10c47fef-747b-4266-8170-313f4f0787db-istio-podinfo\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.057943 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.057918    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-istio-token\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.058341 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.058317    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btb7j\" (UniqueName: \"kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-kube-api-access-btb7j\") pod \"e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") " pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.162472 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.162436    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:20.317010 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.316984    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"]
Jul 26 18:47:20.318585 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:47:20.318556    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c47fef_747b_4266_8170_313f4f0787db.slice/crio-90defc6baf94166b6f875ef4264ffbb58e04f3230527b28def518597094cf9f4 WatchSource:0}: Error finding container 90defc6baf94166b6f875ef4264ffbb58e04f3230527b28def518597094cf9f4: Status 404 returned error can't find the container with id 90defc6baf94166b6f875ef4264ffbb58e04f3230527b28def518597094cf9f4
Jul 26 18:47:20.320878 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.320845    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:47:20.320965 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.320908    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:47:20.320965 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:20.320938    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:47:21.183681 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:21.183641    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" event={"ID":"10c47fef-747b-4266-8170-313f4f0787db","Type":"ContainerStarted","Data":"bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3"}
Jul 26 18:47:21.184080 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:21.183704    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" event={"ID":"10c47fef-747b-4266-8170-313f4f0787db","Type":"ContainerStarted","Data":"90defc6baf94166b6f875ef4264ffbb58e04f3230527b28def518597094cf9f4"}
Jul 26 18:47:21.205187 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:21.205135    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" podStartSLOduration=2.205120079 podStartE2EDuration="2.205120079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:47:21.202312583 +0000 UTC m=+2998.302565494" watchObservedRunningTime="2026-07-26 18:47:21.205120079 +0000 UTC m=+2998.305372965"
Jul 26 18:47:22.163448 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:22.163410    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:22.169383 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:22.169356    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:22.190136 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:22.190098    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:22.191757 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:22.191737    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:41.299833 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:41.299801    2548 generic.go:356] "Generic (PLEG): container finished" podID="10c47fef-747b-4266-8170-313f4f0787db" containerID="bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3" exitCode=0
Jul 26 18:47:41.300424 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:41.299872    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" event={"ID":"10c47fef-747b-4266-8170-313f4f0787db","Type":"ContainerDied","Data":"bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3"}
Jul 26 18:47:41.300424 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:41.300353    2548 scope.go:117] "RemoveContainer" containerID="bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3"
Jul 26 18:47:41.301560 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:41.301535    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:47:41.301638 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:41.301621    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:47:41.301683 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:41.301651    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:47:42.307345 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:42.307309    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" event={"ID":"10c47fef-747b-4266-8170-313f4f0787db","Type":"ContainerStarted","Data":"45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef"}
Jul 26 18:47:43.163153 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:43.163114    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:43.163447 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:43.163266    2548 patch_prober.go:28] interesting pod/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Jul 26 18:47:43.163447 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:43.163314    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" podUID="10c47fef-747b-4266-8170-313f4f0787db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Jul 26 18:47:44.163399 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:44.163360    2548 patch_prober.go:28] interesting pod/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Jul 26 18:47:44.164508 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:44.164472    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" podUID="10c47fef-747b-4266-8170-313f4f0787db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Jul 26 18:47:44.633798 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:44.633768    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dk9v8_cd3aa98a-31bf-49c6-b800-1f62983a6d45/payload-processing/0.log"
Jul 26 18:47:45.163630 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:45.163594    2548 patch_prober.go:28] interesting pod/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Jul 26 18:47:45.164270 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:45.164229    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" podUID="10c47fef-747b-4266-8170-313f4f0787db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Jul 26 18:47:46.163598 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:46.163560    2548 patch_prober.go:28] interesting pod/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Jul 26 18:47:46.163879 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:46.163852    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" podUID="10c47fef-747b-4266-8170-313f4f0787db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Jul 26 18:47:47.166984 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:47.166950    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:47.167498 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:47.167364    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:47:47.168049 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:47:47.168030    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:48:39.767452 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:39.767383    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dk9v8_cd3aa98a-31bf-49c6-b800-1f62983a6d45/payload-processing/0.log"
Jul 26 18:48:40.422482 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.422447    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"]
Jul 26 18:48:40.426506 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.426482    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.431861 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.431639    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-786276-openshift-default-dockercfg-9tmq5\""
Jul 26 18:48:40.437850 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.437826    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"]
Jul 26 18:48:40.551892 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.551844    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-credential-socket\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.552294 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.552259    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m65hm\" (UniqueName: \"kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-kube-api-access-m65hm\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.552508 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.552468    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-envoy\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.552668 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.552653    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-data\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.552921 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.552895    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-socket\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.553045 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.553026    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-podinfo\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.553115 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.553056    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-certs\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.553228 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.553175    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.553339 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.553254    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-token\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.653961 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.653934    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m65hm\" (UniqueName: \"kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-kube-api-access-m65hm\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.654120 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.653972    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-envoy\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.654120 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.654089    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-data\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.654288 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.654133    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-socket\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.654288 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.654172    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-podinfo\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.654288 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.654228    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-certs\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.654288 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.654285    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.654499 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.654324    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-token\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.654855 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.654825    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-credential-socket\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.655158 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.655136    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-certs\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.655378 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.655150    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-data\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.655491 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.655373    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-socket\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.655961 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.655941    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-credential-socket\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.659243 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.656001    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.659378 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.657336    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-envoy\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.666325 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.665979    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-podinfo\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.668747 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.668724    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-token\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.668878 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.668850    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m65hm\" (UniqueName: \"kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-kube-api-access-m65hm\") pod \"e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") " pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.748555 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.748490    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:40.898451 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.898421    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"]
Jul 26 18:48:40.899928 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:48:40.899895    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc44f8d_c957_496e_8b60_a20d4273b8d0.slice/crio-eb3c604bf6ce02ccc8cb2aa95402f39f69792a1440decafd59792be8420a8a62 WatchSource:0}: Error finding container eb3c604bf6ce02ccc8cb2aa95402f39f69792a1440decafd59792be8420a8a62: Status 404 returned error can't find the container with id eb3c604bf6ce02ccc8cb2aa95402f39f69792a1440decafd59792be8420a8a62
Jul 26 18:48:40.902166 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.902130    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:48:40.902289 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.902269    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:48:40.902340 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:40.902313    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:48:41.610620 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:41.610582    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" event={"ID":"1fc44f8d-c957-496e-8b60-a20d4273b8d0","Type":"ContainerStarted","Data":"7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d"}
Jul 26 18:48:41.610804 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:41.610638    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" event={"ID":"1fc44f8d-c957-496e-8b60-a20d4273b8d0","Type":"ContainerStarted","Data":"eb3c604bf6ce02ccc8cb2aa95402f39f69792a1440decafd59792be8420a8a62"}
Jul 26 18:48:41.629472 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:41.629418    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" podStartSLOduration=1.629403175 podStartE2EDuration="1.629403175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-26 18:48:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:48:41.628406783 +0000 UTC m=+3078.728659669" watchObservedRunningTime="2026-07-26 18:48:41.629403175 +0000 UTC m=+3078.729656061"
Jul 26 18:48:41.749659 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:41.749625    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:41.754824 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:41.754802    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:42.616798 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:42.616760    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:42.617892 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:42.617873    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:56.694480 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:56.694448    2548 generic.go:356] "Generic (PLEG): container finished" podID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerID="7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d" exitCode=0
Jul 26 18:48:56.694917 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:56.694520    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" event={"ID":"1fc44f8d-c957-496e-8b60-a20d4273b8d0","Type":"ContainerDied","Data":"7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d"}
Jul 26 18:48:56.694917 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:56.694880    2548 scope.go:117] "RemoveContainer" containerID="7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d"
Jul 26 18:48:56.695927 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:56.695902    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:48:56.695997 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:56.695968    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:48:56.696036 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:56.696001    2548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 26 18:48:57.617212 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:57.617153    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:57.701432 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:57.701398    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" event={"ID":"1fc44f8d-c957-496e-8b60-a20d4273b8d0","Type":"ContainerStarted","Data":"2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709"}
Jul 26 18:48:57.748872 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:57.748841    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:48:57.749806 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:57.749784    2548 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 26 18:48:57.749914 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:57.749837    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" podUID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 26 18:48:58.749028 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:58.748997    2548 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 26 18:48:58.749465 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:58.749060    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" podUID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 26 18:48:59.749572 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:59.749539    2548 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 26 18:48:59.750046 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:48:59.749611    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" podUID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 26 18:49:00.749696 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:00.749665    2548 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Jul 26 18:49:00.750099 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:00.749726    2548 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" podUID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Jul 26 18:49:01.753115 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:01.753086    2548 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:49:01.753575 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:01.753477    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:49:01.754077 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:01.754062    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:49:20.363175 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:20.363141    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"]
Jul 26 18:49:20.363790 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:20.363436    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" podUID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerName="istio-proxy" containerID="cri-o://2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709" gracePeriod=30
Jul 26 18:49:25.615893 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.615869    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:49:25.738646 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738511    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-certs\") pod \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") "
Jul 26 18:49:25.738646 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738639    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-socket\") pod \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") "
Jul 26 18:49:25.738827 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738664    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-data\") pod \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") "
Jul 26 18:49:25.738827 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738693    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fc44f8d-c957-496e-8b60-a20d4273b8d0" (UID: "1fc44f8d-c957-496e-8b60-a20d4273b8d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:49:25.738827 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738762    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-credential-socket\") pod \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") "
Jul 26 18:49:25.738827 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738814    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-podinfo\") pod \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") "
Jul 26 18:49:25.738968 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738865    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-token\") pod \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") "
Jul 26 18:49:25.738968 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738892    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m65hm\" (UniqueName: \"kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-kube-api-access-m65hm\") pod \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") "
Jul 26 18:49:25.738968 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738943    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istiod-ca-cert\") pod \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") "
Jul 26 18:49:25.738968 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738936    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fc44f8d-c957-496e-8b60-a20d4273b8d0" (UID: "1fc44f8d-c957-496e-8b60-a20d4273b8d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:49:25.739174 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738969    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fc44f8d-c957-496e-8b60-a20d4273b8d0" (UID: "1fc44f8d-c957-496e-8b60-a20d4273b8d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:49:25.739174 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.738974    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-envoy\") pod \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\" (UID: \"1fc44f8d-c957-496e-8b60-a20d4273b8d0\") "
Jul 26 18:49:25.739375 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.739345    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fc44f8d-c957-496e-8b60-a20d4273b8d0" (UID: "1fc44f8d-c957-496e-8b60-a20d4273b8d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:49:25.739504 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.739409    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:25.739504 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.739429    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:25.739504 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.739442    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:25.739670 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.739649    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fc44f8d-c957-496e-8b60-a20d4273b8d0" (UID: "1fc44f8d-c957-496e-8b60-a20d4273b8d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:49:25.741309 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.741277    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-kube-api-access-m65hm" (OuterVolumeSpecName: "kube-api-access-m65hm") pod "1fc44f8d-c957-496e-8b60-a20d4273b8d0" (UID: "1fc44f8d-c957-496e-8b60-a20d4273b8d0"). InnerVolumeSpecName "kube-api-access-m65hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:49:25.741309 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.741289    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fc44f8d-c957-496e-8b60-a20d4273b8d0" (UID: "1fc44f8d-c957-496e-8b60-a20d4273b8d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:49:25.741468 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.741456    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fc44f8d-c957-496e-8b60-a20d4273b8d0" (UID: "1fc44f8d-c957-496e-8b60-a20d4273b8d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:49:25.741512 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.741484    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fc44f8d-c957-496e-8b60-a20d4273b8d0" (UID: "1fc44f8d-c957-496e-8b60-a20d4273b8d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:49:25.840779 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.840753    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:25.840779 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.840775    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m65hm\" (UniqueName: \"kubernetes.io/projected/1fc44f8d-c957-496e-8b60-a20d4273b8d0-kube-api-access-m65hm\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:25.840779 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.840783    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:25.841030 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.840791    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:25.841030 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.840799    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:25.841030 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.840805    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc44f8d-c957-496e-8b60-a20d4273b8d0-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:25.843295 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.843263    2548 generic.go:356] "Generic (PLEG): container finished" podID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerID="2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709" exitCode=0
Jul 26 18:49:25.843432 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.843317    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"
Jul 26 18:49:25.843432 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.843346    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" event={"ID":"1fc44f8d-c957-496e-8b60-a20d4273b8d0","Type":"ContainerDied","Data":"2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709"}
Jul 26 18:49:25.843432 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.843410    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh" event={"ID":"1fc44f8d-c957-496e-8b60-a20d4273b8d0","Type":"ContainerDied","Data":"eb3c604bf6ce02ccc8cb2aa95402f39f69792a1440decafd59792be8420a8a62"}
Jul 26 18:49:25.843432 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.843434    2548 scope.go:117] "RemoveContainer" containerID="2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709"
Jul 26 18:49:25.852609 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.852584    2548 scope.go:117] "RemoveContainer" containerID="7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d"
Jul 26 18:49:25.860722 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.860704    2548 scope.go:117] "RemoveContainer" containerID="2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709"
Jul 26 18:49:25.860938 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:49:25.860920    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709\": container with ID starting with 2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709 not found: ID does not exist" containerID="2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709"
Jul 26 18:49:25.860994 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.860945    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709"} err="failed to get container status \"2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709\": rpc error: code = NotFound desc = could not find container \"2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709\": container with ID starting with 2aaed358473c3827649aee43b55f23cfb9913aab80f84e4c6a6167d6d30b5709 not found: ID does not exist"
Jul 26 18:49:25.860994 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.860962    2548 scope.go:117] "RemoveContainer" containerID="7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d"
Jul 26 18:49:25.861236 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:49:25.861210    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d\": container with ID starting with 7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d not found: ID does not exist" containerID="7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d"
Jul 26 18:49:25.861286 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.861246    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d"} err="failed to get container status \"7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d\": rpc error: code = NotFound desc = could not find container \"7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d\": container with ID starting with 7c2573e6e0895076cb085ec0e4facc9f6c437e3b34bac66e99724b020f76953d not found: ID does not exist"
Jul 26 18:49:25.866236 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.866214    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"]
Jul 26 18:49:25.870041 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:25.870011    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-786276-openshift-default-6bd4dc5c76-7sbsh"]
Jul 26 18:49:27.414499 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:27.414466    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" path="/var/lib/kubelet/pods/1fc44f8d-c957-496e-8b60-a20d4273b8d0/volumes"
Jul 26 18:49:39.354677 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.354646    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"]
Jul 26 18:49:39.355175 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.354875    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d" podUID="e1908925-71d4-4b18-9720-2aaaeffc5d79" containerName="maas-api" containerID="cri-o://5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9" gracePeriod=30
Jul 26 18:49:39.631119 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.631088    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:49:39.672781 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.672738    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rkwl\" (UniqueName: \"kubernetes.io/projected/e1908925-71d4-4b18-9720-2aaaeffc5d79-kube-api-access-2rkwl\") pod \"e1908925-71d4-4b18-9720-2aaaeffc5d79\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") "
Jul 26 18:49:39.672966 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.672828    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1908925-71d4-4b18-9720-2aaaeffc5d79-openshift-service-ca\") pod \"e1908925-71d4-4b18-9720-2aaaeffc5d79\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") "
Jul 26 18:49:39.672966 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.672952    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1908925-71d4-4b18-9720-2aaaeffc5d79-maas-api-tls\") pod \"e1908925-71d4-4b18-9720-2aaaeffc5d79\" (UID: \"e1908925-71d4-4b18-9720-2aaaeffc5d79\") "
Jul 26 18:49:39.673336 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.673299    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1908925-71d4-4b18-9720-2aaaeffc5d79-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e1908925-71d4-4b18-9720-2aaaeffc5d79" (UID: "e1908925-71d4-4b18-9720-2aaaeffc5d79"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:49:39.675522 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.675489    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1908925-71d4-4b18-9720-2aaaeffc5d79-kube-api-access-2rkwl" (OuterVolumeSpecName: "kube-api-access-2rkwl") pod "e1908925-71d4-4b18-9720-2aaaeffc5d79" (UID: "e1908925-71d4-4b18-9720-2aaaeffc5d79"). InnerVolumeSpecName "kube-api-access-2rkwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:49:39.675792 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.675762    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1908925-71d4-4b18-9720-2aaaeffc5d79-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e1908925-71d4-4b18-9720-2aaaeffc5d79" (UID: "e1908925-71d4-4b18-9720-2aaaeffc5d79"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:49:39.774158 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.774118    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1908925-71d4-4b18-9720-2aaaeffc5d79-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:39.774158 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.774149    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rkwl\" (UniqueName: \"kubernetes.io/projected/e1908925-71d4-4b18-9720-2aaaeffc5d79-kube-api-access-2rkwl\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:39.774158 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.774164    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1908925-71d4-4b18-9720-2aaaeffc5d79-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:49:39.923254 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.923221    2548 generic.go:356] "Generic (PLEG): container finished" podID="e1908925-71d4-4b18-9720-2aaaeffc5d79" containerID="5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9" exitCode=0
Jul 26 18:49:39.923420 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.923263    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d" event={"ID":"e1908925-71d4-4b18-9720-2aaaeffc5d79","Type":"ContainerDied","Data":"5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9"}
Jul 26 18:49:39.923420 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.923300    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d" event={"ID":"e1908925-71d4-4b18-9720-2aaaeffc5d79","Type":"ContainerDied","Data":"25b3acb153cb333bb6cfb2b92fc9e3a259ea1f78383bd78d2392c2a3dd8442e9"}
Jul 26 18:49:39.923420 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.923320    2548 scope.go:117] "RemoveContainer" containerID="5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9"
Jul 26 18:49:39.923420 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.923265    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"
Jul 26 18:49:39.932666 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.932647    2548 scope.go:117] "RemoveContainer" containerID="5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9"
Jul 26 18:49:39.932930 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:49:39.932909    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9\": container with ID starting with 5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9 not found: ID does not exist" containerID="5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9"
Jul 26 18:49:39.932970 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.932943    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9"} err="failed to get container status \"5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9\": rpc error: code = NotFound desc = could not find container \"5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9\": container with ID starting with 5b6ca216c118d8765fefa494162e67a4fbf938abee2d182b45ed72d61b5bb8f9 not found: ID does not exist"
Jul 26 18:49:39.943844 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.943818    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"]
Jul 26 18:49:39.947662 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:39.947638    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-33964c-954b8f4fc-2n58d"]
Jul 26 18:49:41.413837 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:49:41.413805    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1908925-71d4-4b18-9720-2aaaeffc5d79" path="/var/lib/kubelet/pods/e1908925-71d4-4b18-9720-2aaaeffc5d79/volumes"
Jul 26 18:50:54.462765 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:54.462724    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"]
Jul 26 18:50:54.463422 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:54.462986    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" podUID="10c47fef-747b-4266-8170-313f4f0787db" containerName="istio-proxy" containerID="cri-o://45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef" gracePeriod=30
Jul 26 18:50:59.725971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.725904    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:50:59.846099 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846065    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-envoy\") pod \"10c47fef-747b-4266-8170-313f4f0787db\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") "
Jul 26 18:50:59.846322 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846121    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-certs\") pod \"10c47fef-747b-4266-8170-313f4f0787db\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") "
Jul 26 18:50:59.846322 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846173    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10c47fef-747b-4266-8170-313f4f0787db-istio-podinfo\") pod \"10c47fef-747b-4266-8170-313f4f0787db\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") "
Jul 26 18:50:59.846322 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846255    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-data\") pod \"10c47fef-747b-4266-8170-313f4f0787db\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") "
Jul 26 18:50:59.846322 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846289    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btb7j\" (UniqueName: \"kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-kube-api-access-btb7j\") pod \"10c47fef-747b-4266-8170-313f4f0787db\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") "
Jul 26 18:50:59.846322 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846318    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-credential-socket\") pod \"10c47fef-747b-4266-8170-313f4f0787db\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") "
Jul 26 18:50:59.846672 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846358    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10c47fef-747b-4266-8170-313f4f0787db-istiod-ca-cert\") pod \"10c47fef-747b-4266-8170-313f4f0787db\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") "
Jul 26 18:50:59.846672 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846381    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-istio-token\") pod \"10c47fef-747b-4266-8170-313f4f0787db\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") "
Jul 26 18:50:59.846672 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846405    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-socket\") pod \"10c47fef-747b-4266-8170-313f4f0787db\" (UID: \"10c47fef-747b-4266-8170-313f4f0787db\") "
Jul 26 18:50:59.846672 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846471    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10c47fef-747b-4266-8170-313f4f0787db" (UID: "10c47fef-747b-4266-8170-313f4f0787db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:50:59.846881 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846677    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10c47fef-747b-4266-8170-313f4f0787db" (UID: "10c47fef-747b-4266-8170-313f4f0787db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:50:59.846881 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846791    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10c47fef-747b-4266-8170-313f4f0787db" (UID: "10c47fef-747b-4266-8170-313f4f0787db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:50:59.846881 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846839    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:50:59.846881 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846860    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:50:59.846881 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.846837    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10c47fef-747b-4266-8170-313f4f0787db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10c47fef-747b-4266-8170-313f4f0787db" (UID: "10c47fef-747b-4266-8170-313f4f0787db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:50:59.847303 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.847247    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-data" (OuterVolumeSpecName: "istio-data") pod "10c47fef-747b-4266-8170-313f4f0787db" (UID: "10c47fef-747b-4266-8170-313f4f0787db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:50:59.848746 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.848717    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-istio-token" (OuterVolumeSpecName: "istio-token") pod "10c47fef-747b-4266-8170-313f4f0787db" (UID: "10c47fef-747b-4266-8170-313f4f0787db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:50:59.848874 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.848776    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10c47fef-747b-4266-8170-313f4f0787db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10c47fef-747b-4266-8170-313f4f0787db" (UID: "10c47fef-747b-4266-8170-313f4f0787db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:50:59.848981 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.848954    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10c47fef-747b-4266-8170-313f4f0787db" (UID: "10c47fef-747b-4266-8170-313f4f0787db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:50:59.849062 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.849036    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-kube-api-access-btb7j" (OuterVolumeSpecName: "kube-api-access-btb7j") pod "10c47fef-747b-4266-8170-313f4f0787db" (UID: "10c47fef-747b-4266-8170-313f4f0787db"). InnerVolumeSpecName "kube-api-access-btb7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:50:59.947990 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.947948    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:50:59.947990 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.947981    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10c47fef-747b-4266-8170-313f4f0787db-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:50:59.947990 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.947992    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:50:59.948273 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.948001    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btb7j\" (UniqueName: \"kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-kube-api-access-btb7j\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:50:59.948273 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.948012    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10c47fef-747b-4266-8170-313f4f0787db-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:50:59.948273 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.948022    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10c47fef-747b-4266-8170-313f4f0787db-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:50:59.948273 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:50:59.948029    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10c47fef-747b-4266-8170-313f4f0787db-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:00.334884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.334852    2548 generic.go:356] "Generic (PLEG): container finished" podID="10c47fef-747b-4266-8170-313f4f0787db" containerID="45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef" exitCode=0
Jul 26 18:51:00.335083 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.334906    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" event={"ID":"10c47fef-747b-4266-8170-313f4f0787db","Type":"ContainerDied","Data":"45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef"}
Jul 26 18:51:00.335083 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.334943    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp" event={"ID":"10c47fef-747b-4266-8170-313f4f0787db","Type":"ContainerDied","Data":"90defc6baf94166b6f875ef4264ffbb58e04f3230527b28def518597094cf9f4"}
Jul 26 18:51:00.335083 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.334964    2548 scope.go:117] "RemoveContainer" containerID="45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef"
Jul 26 18:51:00.335083 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.334907    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"
Jul 26 18:51:00.344495 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.344469    2548 scope.go:117] "RemoveContainer" containerID="bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3"
Jul 26 18:51:00.353097 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.353076    2548 scope.go:117] "RemoveContainer" containerID="45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef"
Jul 26 18:51:00.353424 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:51:00.353402    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef\": container with ID starting with 45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef not found: ID does not exist" containerID="45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef"
Jul 26 18:51:00.353507 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.353431    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef"} err="failed to get container status \"45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef\": rpc error: code = NotFound desc = could not find container \"45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef\": container with ID starting with 45ab213a94fc7bcf84f93d6d02840e83f65bafe4853af856b83847ad6f2c51ef not found: ID does not exist"
Jul 26 18:51:00.353507 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.353450    2548 scope.go:117] "RemoveContainer" containerID="bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3"
Jul 26 18:51:00.353825 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:51:00.353748    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3\": container with ID starting with bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3 not found: ID does not exist" containerID="bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3"
Jul 26 18:51:00.353825 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.353782    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3"} err="failed to get container status \"bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3\": rpc error: code = NotFound desc = could not find container \"bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3\": container with ID starting with bce99a0cee0cda1eaebcdd109e6f7916c6f2d3bce6caa4603580e77ec2754bd3 not found: ID does not exist"
Jul 26 18:51:00.356462 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.356435    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"]
Jul 26 18:51:00.359961 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:00.359941    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-f6bce0-openshift-default-5b9567598d-lzczp"]
Jul 26 18:51:01.414324 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:01.414282    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10c47fef-747b-4266-8170-313f4f0787db" path="/var/lib/kubelet/pods/10c47fef-747b-4266-8170-313f4f0787db/volumes"
Jul 26 18:51:05.278171 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.278134    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"]
Jul 26 18:51:05.278640 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.278391    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9" podUID="224b5954-cea8-4d28-b3fe-3de3ace04fd3" containerName="maas-api" containerID="cri-o://495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f" gracePeriod=30
Jul 26 18:51:05.535714 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.535645    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:51:05.601921 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.601883    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4bw8\" (UniqueName: \"kubernetes.io/projected/224b5954-cea8-4d28-b3fe-3de3ace04fd3-kube-api-access-d4bw8\") pod \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") "
Jul 26 18:51:05.602105 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.601945    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls\") pod \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") "
Jul 26 18:51:05.602105 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.601970    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/224b5954-cea8-4d28-b3fe-3de3ace04fd3-openshift-service-ca\") pod \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\" (UID: \"224b5954-cea8-4d28-b3fe-3de3ace04fd3\") "
Jul 26 18:51:05.602487 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.602453    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/224b5954-cea8-4d28-b3fe-3de3ace04fd3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "224b5954-cea8-4d28-b3fe-3de3ace04fd3" (UID: "224b5954-cea8-4d28-b3fe-3de3ace04fd3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:51:05.604477 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.604446    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/224b5954-cea8-4d28-b3fe-3de3ace04fd3-kube-api-access-d4bw8" (OuterVolumeSpecName: "kube-api-access-d4bw8") pod "224b5954-cea8-4d28-b3fe-3de3ace04fd3" (UID: "224b5954-cea8-4d28-b3fe-3de3ace04fd3"). InnerVolumeSpecName "kube-api-access-d4bw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:51:05.604585 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.604454    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "224b5954-cea8-4d28-b3fe-3de3ace04fd3" (UID: "224b5954-cea8-4d28-b3fe-3de3ace04fd3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:51:05.703490 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.703439    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4bw8\" (UniqueName: \"kubernetes.io/projected/224b5954-cea8-4d28-b3fe-3de3ace04fd3-kube-api-access-d4bw8\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:05.703490 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.703484    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/224b5954-cea8-4d28-b3fe-3de3ace04fd3-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:05.703490 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:05.703495    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/224b5954-cea8-4d28-b3fe-3de3ace04fd3-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:06.369767 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:06.369732    2548 generic.go:356] "Generic (PLEG): container finished" podID="224b5954-cea8-4d28-b3fe-3de3ace04fd3" containerID="495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f" exitCode=0
Jul 26 18:51:06.370268 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:06.369797    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"
Jul 26 18:51:06.370268 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:06.369815    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9" event={"ID":"224b5954-cea8-4d28-b3fe-3de3ace04fd3","Type":"ContainerDied","Data":"495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f"}
Jul 26 18:51:06.370268 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:06.369900    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9" event={"ID":"224b5954-cea8-4d28-b3fe-3de3ace04fd3","Type":"ContainerDied","Data":"0eec105304cd87ab637bb8e264d3dd53b091d4a7423b37d0b0a3b57aeb2806a6"}
Jul 26 18:51:06.370268 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:06.369925    2548 scope.go:117] "RemoveContainer" containerID="495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f"
Jul 26 18:51:06.379658 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:06.379642    2548 scope.go:117] "RemoveContainer" containerID="495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f"
Jul 26 18:51:06.379916 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:51:06.379896    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f\": container with ID starting with 495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f not found: ID does not exist" containerID="495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f"
Jul 26 18:51:06.379985 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:06.379924    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f"} err="failed to get container status \"495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f\": rpc error: code = NotFound desc = could not find container \"495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f\": container with ID starting with 495c16492967fe482e993982cf2d8fd60cf768e1d8d7eb717a9a17cdb95f184f not found: ID does not exist"
Jul 26 18:51:06.391024 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:06.390983    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"]
Jul 26 18:51:06.394884 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:06.394862    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-37e93d-555f48cbbb-sxhh9"]
Jul 26 18:51:07.413670 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:07.413639    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="224b5954-cea8-4d28-b3fe-3de3ace04fd3" path="/var/lib/kubelet/pods/224b5954-cea8-4d28-b3fe-3de3ace04fd3/volumes"
Jul 26 18:51:16.584777 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:16.584686    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"]
Jul 26 18:51:16.585260 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:16.585036    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy" containerID="cri-o://303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa" gracePeriod=30
Jul 26 18:51:21.834205 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.834165    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:51:21.969309 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969272    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-socket\") pod \"859e89b0-ff33-49c9-8330-f462a996228d\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") "
Jul 26 18:51:21.969489 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969327    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-istio-token\") pod \"859e89b0-ff33-49c9-8330-f462a996228d\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") "
Jul 26 18:51:21.969489 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969413    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/859e89b0-ff33-49c9-8330-f462a996228d-istio-podinfo\") pod \"859e89b0-ff33-49c9-8330-f462a996228d\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") "
Jul 26 18:51:21.969489 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969437    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/859e89b0-ff33-49c9-8330-f462a996228d-istiod-ca-cert\") pod \"859e89b0-ff33-49c9-8330-f462a996228d\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") "
Jul 26 18:51:21.969489 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969487    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-envoy\") pod \"859e89b0-ff33-49c9-8330-f462a996228d\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") "
Jul 26 18:51:21.969730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969555    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-credential-socket\") pod \"859e89b0-ff33-49c9-8330-f462a996228d\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") "
Jul 26 18:51:21.969730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969613    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-data\") pod \"859e89b0-ff33-49c9-8330-f462a996228d\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") "
Jul 26 18:51:21.969730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969610    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "859e89b0-ff33-49c9-8330-f462a996228d" (UID: "859e89b0-ff33-49c9-8330-f462a996228d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:51:21.969730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969642    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tntjl\" (UniqueName: \"kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-kube-api-access-tntjl\") pod \"859e89b0-ff33-49c9-8330-f462a996228d\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") "
Jul 26 18:51:21.969730 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969674    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-certs\") pod \"859e89b0-ff33-49c9-8330-f462a996228d\" (UID: \"859e89b0-ff33-49c9-8330-f462a996228d\") "
Jul 26 18:51:21.969978 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969913    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "859e89b0-ff33-49c9-8330-f462a996228d" (UID: "859e89b0-ff33-49c9-8330-f462a996228d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:51:21.969978 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969916    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/859e89b0-ff33-49c9-8330-f462a996228d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "859e89b0-ff33-49c9-8330-f462a996228d" (UID: "859e89b0-ff33-49c9-8330-f462a996228d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:51:21.969978 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.969954    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "859e89b0-ff33-49c9-8330-f462a996228d" (UID: "859e89b0-ff33-49c9-8330-f462a996228d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:51:21.970299 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.970280    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/859e89b0-ff33-49c9-8330-f462a996228d-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:21.970299 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.970299    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:21.970468 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.970312    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:21.970468 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.970326    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:21.970593 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.970560    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-data" (OuterVolumeSpecName: "istio-data") pod "859e89b0-ff33-49c9-8330-f462a996228d" (UID: "859e89b0-ff33-49c9-8330-f462a996228d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:51:21.971751 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.971724    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/859e89b0-ff33-49c9-8330-f462a996228d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "859e89b0-ff33-49c9-8330-f462a996228d" (UID: "859e89b0-ff33-49c9-8330-f462a996228d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:51:21.972005 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.971966    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-kube-api-access-tntjl" (OuterVolumeSpecName: "kube-api-access-tntjl") pod "859e89b0-ff33-49c9-8330-f462a996228d" (UID: "859e89b0-ff33-49c9-8330-f462a996228d"). InnerVolumeSpecName "kube-api-access-tntjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:51:21.972097 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.972040    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-istio-token" (OuterVolumeSpecName: "istio-token") pod "859e89b0-ff33-49c9-8330-f462a996228d" (UID: "859e89b0-ff33-49c9-8330-f462a996228d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:51:21.972097 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:21.972047    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "859e89b0-ff33-49c9-8330-f462a996228d" (UID: "859e89b0-ff33-49c9-8330-f462a996228d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:51:22.071466 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.071438    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/859e89b0-ff33-49c9-8330-f462a996228d-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:22.071466 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.071463    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:22.071466 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.071474    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/859e89b0-ff33-49c9-8330-f462a996228d-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:22.071677 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.071482    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tntjl\" (UniqueName: \"kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-kube-api-access-tntjl\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:22.071677 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.071491    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/859e89b0-ff33-49c9-8330-f462a996228d-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:22.448076 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.448043    2548 generic.go:356] "Generic (PLEG): container finished" podID="859e89b0-ff33-49c9-8330-f462a996228d" containerID="303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa" exitCode=0
Jul 26 18:51:22.448305 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.448088    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"
Jul 26 18:51:22.448305 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.448127    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" event={"ID":"859e89b0-ff33-49c9-8330-f462a996228d","Type":"ContainerDied","Data":"303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa"}
Jul 26 18:51:22.448305 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.448179    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw" event={"ID":"859e89b0-ff33-49c9-8330-f462a996228d","Type":"ContainerDied","Data":"2b4fd29fa1a31fb8afc9e1190f74aabc6d9ac4b55ab0ae0e01d9c2e4900babde"}
Jul 26 18:51:22.448305 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.448224    2548 scope.go:117] "RemoveContainer" containerID="303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa"
Jul 26 18:51:22.458018 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.457995    2548 scope.go:117] "RemoveContainer" containerID="0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d"
Jul 26 18:51:22.465769 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.465754    2548 scope.go:117] "RemoveContainer" containerID="303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa"
Jul 26 18:51:22.466007 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:51:22.465986    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa\": container with ID starting with 303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa not found: ID does not exist" containerID="303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa"
Jul 26 18:51:22.466084 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.466019    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa"} err="failed to get container status \"303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa\": rpc error: code = NotFound desc = could not find container \"303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa\": container with ID starting with 303e7e8c27bd7babd44698b513a78ddf76cc355d7ecfde02954b47df5c5f8aaa not found: ID does not exist"
Jul 26 18:51:22.466084 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.466041    2548 scope.go:117] "RemoveContainer" containerID="0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d"
Jul 26 18:51:22.466409 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:51:22.466379    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d\": container with ID starting with 0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d not found: ID does not exist" containerID="0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d"
Jul 26 18:51:22.466468 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.466413    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d"} err="failed to get container status \"0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d\": rpc error: code = NotFound desc = could not find container \"0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d\": container with ID starting with 0d3f2490a27ba57182432dd6497057561ae7c8a8cbde3262f9d2592c6fbbd88d not found: ID does not exist"
Jul 26 18:51:22.470086 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.470062    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"]
Jul 26 18:51:22.473626 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:22.473608    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-37e93d-openshift-default-78574cf59b-qpkpw"]
Jul 26 18:51:23.413413 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:23.413384    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="859e89b0-ff33-49c9-8330-f462a996228d" path="/var/lib/kubelet/pods/859e89b0-ff33-49c9-8330-f462a996228d/volumes"
Jul 26 18:51:27.362370 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.362330    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"]
Jul 26 18:51:27.363016 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.362612    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4" podUID="1c889d60-54da-4860-ae4b-0b0a6c25bb6e" containerName="maas-api" containerID="cri-o://3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71" gracePeriod=30
Jul 26 18:51:27.622728 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.622660    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:51:27.624872 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.624852    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnd6z\" (UniqueName: \"kubernetes.io/projected/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-kube-api-access-wnd6z\") pod \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") "
Jul 26 18:51:27.624972 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.624915    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-openshift-service-ca\") pod \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") "
Jul 26 18:51:27.625035 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.624999    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-maas-api-tls\") pod \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\" (UID: \"1c889d60-54da-4860-ae4b-0b0a6c25bb6e\") "
Jul 26 18:51:27.625328 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.625302    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1c889d60-54da-4860-ae4b-0b0a6c25bb6e" (UID: "1c889d60-54da-4860-ae4b-0b0a6c25bb6e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:51:27.627034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.627012    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-kube-api-access-wnd6z" (OuterVolumeSpecName: "kube-api-access-wnd6z") pod "1c889d60-54da-4860-ae4b-0b0a6c25bb6e" (UID: "1c889d60-54da-4860-ae4b-0b0a6c25bb6e"). InnerVolumeSpecName "kube-api-access-wnd6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:51:27.627234 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.627216    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1c889d60-54da-4860-ae4b-0b0a6c25bb6e" (UID: "1c889d60-54da-4860-ae4b-0b0a6c25bb6e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 26 18:51:27.726474 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.726444    2548 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-maas-api-tls\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:27.726474 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.726473    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnd6z\" (UniqueName: \"kubernetes.io/projected/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-kube-api-access-wnd6z\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:27.726675 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:27.726487    2548 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c889d60-54da-4860-ae4b-0b0a6c25bb6e-openshift-service-ca\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:28.479255 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:28.479219    2548 generic.go:356] "Generic (PLEG): container finished" podID="1c889d60-54da-4860-ae4b-0b0a6c25bb6e" containerID="3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71" exitCode=0
Jul 26 18:51:28.479255 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:28.479254    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"
Jul 26 18:51:28.479782 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:28.479284    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4" event={"ID":"1c889d60-54da-4860-ae4b-0b0a6c25bb6e","Type":"ContainerDied","Data":"3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71"}
Jul 26 18:51:28.479782 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:28.479351    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4" event={"ID":"1c889d60-54da-4860-ae4b-0b0a6c25bb6e","Type":"ContainerDied","Data":"456949059f5949a5cd5f8af71835e1011415f2c9762bc3c96b00fee2ec2dcd98"}
Jul 26 18:51:28.479782 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:28.479381    2548 scope.go:117] "RemoveContainer" containerID="3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71"
Jul 26 18:51:28.489540 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:28.489523    2548 scope.go:117] "RemoveContainer" containerID="3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71"
Jul 26 18:51:28.489808 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:51:28.489789    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71\": container with ID starting with 3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71 not found: ID does not exist" containerID="3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71"
Jul 26 18:51:28.489877 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:28.489817    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71"} err="failed to get container status \"3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71\": rpc error: code = NotFound desc = could not find container \"3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71\": container with ID starting with 3ec47bbfb18a673c5946679410c8aac3192998f1e6b6089a1ee023baddcaac71 not found: ID does not exist"
Jul 26 18:51:28.501707 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:28.501687    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"]
Jul 26 18:51:28.509169 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:28.509149    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d112e4-66bc44db87-v25z4"]
Jul 26 18:51:29.417006 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:29.416974    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c889d60-54da-4860-ae4b-0b0a6c25bb6e" path="/var/lib/kubelet/pods/1c889d60-54da-4860-ae4b-0b0a6c25bb6e/volumes"
Jul 26 18:51:38.619283 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:38.619242    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"]
Jul 26 18:51:38.619764 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:38.619516    2548 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy" containerID="cri-o://add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9" gracePeriod=30
Jul 26 18:51:43.874875 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.874852    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:51:43.977277 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977169    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kmqx\" (UniqueName: \"kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-kube-api-access-4kmqx\") pod \"443f653b-e8e0-43be-a76a-38df00d766f6\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") "
Jul 26 18:51:43.977277 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977241    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-envoy\") pod \"443f653b-e8e0-43be-a76a-38df00d766f6\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") "
Jul 26 18:51:43.977509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977309    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-certs\") pod \"443f653b-e8e0-43be-a76a-38df00d766f6\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") "
Jul 26 18:51:43.977509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977337    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-istio-token\") pod \"443f653b-e8e0-43be-a76a-38df00d766f6\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") "
Jul 26 18:51:43.977509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977359    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/443f653b-e8e0-43be-a76a-38df00d766f6-istio-podinfo\") pod \"443f653b-e8e0-43be-a76a-38df00d766f6\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") "
Jul 26 18:51:43.977509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977381    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/443f653b-e8e0-43be-a76a-38df00d766f6-istiod-ca-cert\") pod \"443f653b-e8e0-43be-a76a-38df00d766f6\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") "
Jul 26 18:51:43.977509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977411    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-data\") pod \"443f653b-e8e0-43be-a76a-38df00d766f6\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") "
Jul 26 18:51:43.977509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977461    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-socket\") pod \"443f653b-e8e0-43be-a76a-38df00d766f6\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") "
Jul 26 18:51:43.977509 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977485    2548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-credential-socket\") pod \"443f653b-e8e0-43be-a76a-38df00d766f6\" (UID: \"443f653b-e8e0-43be-a76a-38df00d766f6\") "
Jul 26 18:51:43.977847 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977733    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "443f653b-e8e0-43be-a76a-38df00d766f6" (UID: "443f653b-e8e0-43be-a76a-38df00d766f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:51:43.977955 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977934    2548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-certs\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:43.978022 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977927    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "443f653b-e8e0-43be-a76a-38df00d766f6" (UID: "443f653b-e8e0-43be-a76a-38df00d766f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:51:43.978022 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.977857    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/443f653b-e8e0-43be-a76a-38df00d766f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "443f653b-e8e0-43be-a76a-38df00d766f6" (UID: "443f653b-e8e0-43be-a76a-38df00d766f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 26 18:51:43.978162 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.978140    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "443f653b-e8e0-43be-a76a-38df00d766f6" (UID: "443f653b-e8e0-43be-a76a-38df00d766f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:51:43.978977 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.978934    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "443f653b-e8e0-43be-a76a-38df00d766f6" (UID: "443f653b-e8e0-43be-a76a-38df00d766f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:51:43.979600 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.979578    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "443f653b-e8e0-43be-a76a-38df00d766f6" (UID: "443f653b-e8e0-43be-a76a-38df00d766f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 26 18:51:43.979687 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.979623    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "443f653b-e8e0-43be-a76a-38df00d766f6" (UID: "443f653b-e8e0-43be-a76a-38df00d766f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:51:43.979764 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.979749    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-kube-api-access-4kmqx" (OuterVolumeSpecName: "kube-api-access-4kmqx") pod "443f653b-e8e0-43be-a76a-38df00d766f6" (UID: "443f653b-e8e0-43be-a76a-38df00d766f6"). InnerVolumeSpecName "kube-api-access-4kmqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 26 18:51:43.980072 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:43.980047    2548 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/443f653b-e8e0-43be-a76a-38df00d766f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "443f653b-e8e0-43be-a76a-38df00d766f6" (UID: "443f653b-e8e0-43be-a76a-38df00d766f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 26 18:51:44.078885 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.078858    2548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-workload-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:44.078885 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.078886    2548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-credential-socket\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:44.079034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.078899    2548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kmqx\" (UniqueName: \"kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-kube-api-access-4kmqx\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:44.079034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.078912    2548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-envoy\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:44.079034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.078924    2548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/443f653b-e8e0-43be-a76a-38df00d766f6-istio-token\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:44.079034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.078935    2548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/443f653b-e8e0-43be-a76a-38df00d766f6-istio-podinfo\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:44.079034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.078946    2548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/443f653b-e8e0-43be-a76a-38df00d766f6-istiod-ca-cert\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:44.079034 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.078957    2548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/443f653b-e8e0-43be-a76a-38df00d766f6-istio-data\") on node \"ip-10-0-143-214.ec2.internal\" DevicePath \"\""
Jul 26 18:51:44.321395 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.321325    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dtzsn_d11c3a3a-0fde-47c3-95d4-6670128a6e89/manager/0.log"
Jul 26 18:51:44.554844 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.554816    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c849f48d4-hzlnm_d91b056f-8e96-44b8-97b1-ad05ddc9ec0a/manager/0.log"
Jul 26 18:51:44.555698 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.555675    2548 generic.go:356] "Generic (PLEG): container finished" podID="443f653b-e8e0-43be-a76a-38df00d766f6" containerID="add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9" exitCode=0
Jul 26 18:51:44.555774 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.555727    2548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"
Jul 26 18:51:44.555774 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.555759    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" event={"ID":"443f653b-e8e0-43be-a76a-38df00d766f6","Type":"ContainerDied","Data":"add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9"}
Jul 26 18:51:44.555849 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.555809    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb" event={"ID":"443f653b-e8e0-43be-a76a-38df00d766f6","Type":"ContainerDied","Data":"8c6eb16c1ff6de8082a093e679879c866881742d5dce6e956d984a5b0cde6ed0"}
Jul 26 18:51:44.555849 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.555833    2548 scope.go:117] "RemoveContainer" containerID="add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9"
Jul 26 18:51:44.565978 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.565964    2548 scope.go:117] "RemoveContainer" containerID="6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404"
Jul 26 18:51:44.573663 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.573646    2548 scope.go:117] "RemoveContainer" containerID="add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9"
Jul 26 18:51:44.573907 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:51:44.573887    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9\": container with ID starting with add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9 not found: ID does not exist" containerID="add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9"
Jul 26 18:51:44.573956 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.573917    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9"} err="failed to get container status \"add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9\": rpc error: code = NotFound desc = could not find container \"add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9\": container with ID starting with add4a84242b52944d890c482121a773c58db2720c0076cb47a6823069f6d03f9 not found: ID does not exist"
Jul 26 18:51:44.573956 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.573934    2548 scope.go:117] "RemoveContainer" containerID="6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404"
Jul 26 18:51:44.574144 ip-10-0-143-214 kubenswrapper[2548]: E0726 18:51:44.574125    2548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404\": container with ID starting with 6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404 not found: ID does not exist" containerID="6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404"
Jul 26 18:51:44.574187 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.574151    2548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404"} err="failed to get container status \"6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404\": rpc error: code = NotFound desc = could not find container \"6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404\": container with ID starting with 6beab5eda5630f5c2e742ffe19a624ec9e0149027d4b8218bb91319515483404 not found: ID does not exist"
Jul 26 18:51:44.578092 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.578069    2548 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"]
Jul 26 18:51:44.583799 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.583781    2548 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d112e4-openshift-default-cbc55f876-hvnlb"]
Jul 26 18:51:44.990151 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:44.990125    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cc94bb6c-ks5bd_f1fffcce-e18a-43de-91e6-6ab90db34e5c/copy-manifests/0.log"
Jul 26 18:51:45.002666 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:45.002647    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cc94bb6c-ks5bd_f1fffcce-e18a-43de-91e6-6ab90db34e5c/manager/0.log"
Jul 26 18:51:45.414672 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:45.414640    2548 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" path="/var/lib/kubelet/pods/443f653b-e8e0-43be-a76a-38df00d766f6/volumes"
Jul 26 18:51:45.467300 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:45.467270    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-d7b97ccf-k8gq9_5b139a0e-7c6c-4e54-9043-1d58616ca8e5/maas-api/0.log"
Jul 26 18:51:45.572721 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:45.572690    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29751495-dqh4k_d6149eaf-5ae9-472a-b280-7380fc06825f/cleanup/0.log"
Jul 26 18:51:45.894546 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:45.894520    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zbcrc_bc822562-859d-4c56-89a3-76e14426ec8a/postgres/0.log"
Jul 26 18:51:47.326746 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:47.326713    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hkm9t_85cb1bd4-9005-43f9-bff5-5475db5c2832/manager/0.log"
Jul 26 18:51:47.544137 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:47.544104    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cf7h8_19350b39-b55b-479c-a107-3307206ad382/registry-server/0.log"
Jul 26 18:51:47.658806 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:47.658780    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sgbz9_6be951ec-b464-4210-886f-5c90ac7f0e24/manager/0.log"
Jul 26 18:51:48.218946 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:48.218908    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp_19e6721e-f772-4160-ab4b-1d2695fec4ac/istio-proxy/0.log"
Jul 26 18:51:48.663321 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:48.663287    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-79jtn_040cdc62-332d-4b21-b893-0956b30523ab/istio-proxy/1.log"
Jul 26 18:51:48.779571 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:48.779537    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zfwwx_806c5996-5e66-41bd-84c0-38ca75e60474/payload-pre-processing/0.log"
Jul 26 18:51:48.890427 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:48.890393    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dk9v8_cd3aa98a-31bf-49c6-b800-1f62983a6d45/payload-processing/0.log"
Jul 26 18:51:49.529084 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:49.529057    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4tfp5_db98fe38-41d5-42e8-b868-fe172f14ce82/main/0.log"
Jul 26 18:51:49.637242 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:49.637214    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjvjq9_a88293c8-64eb-4bb7-84ba-fd6170a2720c/main/0.log"
Jul 26 18:51:57.752920 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:57.752891    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2t9x2_2070228b-2e6c-4333-932a-a1e47454dcd1/global-pull-secret-syncer/0.log"
Jul 26 18:51:57.927232 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:57.927177    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d49rb_7d4e0e33-7a18-4435-9763-c64fa9f936b6/konnectivity-agent/0.log"
Jul 26 18:51:58.034143 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:51:58.034062    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-214.ec2.internal_34dccaad402f98366bfe218c10feb14e/haproxy/0.log"
Jul 26 18:52:03.433394 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:03.433345    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-hkm9t_85cb1bd4-9005-43f9-bff5-5475db5c2832/manager/0.log"
Jul 26 18:52:03.507786 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:03.507754    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-cf7h8_19350b39-b55b-479c-a107-3307206ad382/registry-server/0.log"
Jul 26 18:52:03.677532 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:03.677497    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-sgbz9_6be951ec-b464-4210-886f-5c90ac7f0e24/manager/0.log"
Jul 26 18:52:05.677784 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:05.677751    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b8lj2_d15941df-e0a6-4a4b-891f-6b363d496661/kube-state-metrics/0.log"
Jul 26 18:52:05.698915 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:05.698887    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b8lj2_d15941df-e0a6-4a4b-891f-6b363d496661/kube-rbac-proxy-main/0.log"
Jul 26 18:52:05.723487 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:05.723458    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-b8lj2_d15941df-e0a6-4a4b-891f-6b363d496661/kube-rbac-proxy-self/0.log"
Jul 26 18:52:05.812415 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:05.812385    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6t67t_8b6d90cf-e881-4866-9f6d-90337c0d7b0a/node-exporter/0.log"
Jul 26 18:52:05.834679 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:05.834647    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6t67t_8b6d90cf-e881-4866-9f6d-90337c0d7b0a/kube-rbac-proxy/0.log"
Jul 26 18:52:05.861962 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:05.861935    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6t67t_8b6d90cf-e881-4866-9f6d-90337c0d7b0a/init-textfile/0.log"
Jul 26 18:52:06.173206 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:06.173163    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c387b6cd-dcb5-468d-8e6e-a860f827c957/prometheus/0.log"
Jul 26 18:52:06.197772 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:06.197742    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c387b6cd-dcb5-468d-8e6e-a860f827c957/config-reloader/0.log"
Jul 26 18:52:06.220793 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:06.220706    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c387b6cd-dcb5-468d-8e6e-a860f827c957/thanos-sidecar/0.log"
Jul 26 18:52:06.244710 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:06.244684    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c387b6cd-dcb5-468d-8e6e-a860f827c957/kube-rbac-proxy-web/0.log"
Jul 26 18:52:06.270339 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:06.270315    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c387b6cd-dcb5-468d-8e6e-a860f827c957/kube-rbac-proxy/0.log"
Jul 26 18:52:06.293437 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:06.293405    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c387b6cd-dcb5-468d-8e6e-a860f827c957/kube-rbac-proxy-thanos/0.log"
Jul 26 18:52:06.317091 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:06.317065    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c387b6cd-dcb5-468d-8e6e-a860f827c957/init-config-reloader/0.log"
Jul 26 18:52:06.348061 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:06.348026    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-pxp9l_c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8/prometheus-operator/0.log"
Jul 26 18:52:06.369979 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:06.369948    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-pxp9l_c88758b1-3fa8-4b1e-8c4a-74e3f5e01bc8/kube-rbac-proxy/0.log"
Jul 26 18:52:06.396120 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:06.396093    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-ck9qw_ad30a594-131c-4f24-8fff-86c10061ebd2/prometheus-operator-admission-webhook/0.log"
Jul 26 18:52:08.230868 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.230834    2548 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"]
Jul 26 18:52:08.231285 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231240    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="224b5954-cea8-4d28-b3fe-3de3ace04fd3" containerName="maas-api"
Jul 26 18:52:08.231285 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231253    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="224b5954-cea8-4d28-b3fe-3de3ace04fd3" containerName="maas-api"
Jul 26 18:52:08.231285 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231262    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerName="istio-proxy"
Jul 26 18:52:08.231285 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231267    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerName="istio-proxy"
Jul 26 18:52:08.231285 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231280    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy"
Jul 26 18:52:08.231285 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231287    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231294    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1908925-71d4-4b18-9720-2aaaeffc5d79" containerName="maas-api"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231300    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1908925-71d4-4b18-9720-2aaaeffc5d79" containerName="maas-api"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231307    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c47fef-747b-4266-8170-313f4f0787db" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231312    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c47fef-747b-4266-8170-313f4f0787db" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231327    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c889d60-54da-4860-ae4b-0b0a6c25bb6e" containerName="maas-api"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231333    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c889d60-54da-4860-ae4b-0b0a6c25bb6e" containerName="maas-api"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231340    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231345    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231356    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231361    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231368    2548 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231373    2548 state_mem.go:107] "Deleted CPUSet assignment" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231428    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="859e89b0-ff33-49c9-8330-f462a996228d" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231437    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231442    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c47fef-747b-4266-8170-313f4f0787db" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231448    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c889d60-54da-4860-ae4b-0b0a6c25bb6e" containerName="maas-api"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231454    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c47fef-747b-4266-8170-313f4f0787db" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231459    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231465    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1908925-71d4-4b18-9720-2aaaeffc5d79" containerName="maas-api"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231471    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="224b5954-cea8-4d28-b3fe-3de3ace04fd3" containerName="maas-api"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231476    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="443f653b-e8e0-43be-a76a-38df00d766f6" containerName="istio-proxy"
Jul 26 18:52:08.231485 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.231481    2548 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fc44f8d-c957-496e-8b60-a20d4273b8d0" containerName="istio-proxy"
Jul 26 18:52:08.234772 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.234754    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.237297 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.237279    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lz7b2\"/\"openshift-service-ca.crt\""
Jul 26 18:52:08.238155 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.238127    2548 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lz7b2\"/\"kube-root-ca.crt\""
Jul 26 18:52:08.238155 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.238138    2548 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lz7b2\"/\"default-dockercfg-chqtw\""
Jul 26 18:52:08.245822 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.245796    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"]
Jul 26 18:52:08.402623 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.402584    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-sys\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.402835 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.402644    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l752v\" (UniqueName: \"kubernetes.io/projected/99395530-2d6c-4f9a-b5b7-b173db18d32f-kube-api-access-l752v\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.402835 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.402688    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-lib-modules\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.402835 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.402711    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-proc\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.402835 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.402807    2548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-podres\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.504317 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.504214    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l752v\" (UniqueName: \"kubernetes.io/projected/99395530-2d6c-4f9a-b5b7-b173db18d32f-kube-api-access-l752v\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.504317 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.504257    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-lib-modules\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.504317 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.504286    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-proc\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.504646 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.504341    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-proc\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.504646 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.504473    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-lib-modules\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.504755 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.504646    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-podres\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.504755 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.504727    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-podres\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.504864 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.504781    2548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-sys\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.504864 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.504843    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99395530-2d6c-4f9a-b5b7-b173db18d32f-sys\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.514145 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.514114    2548 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l752v\" (UniqueName: \"kubernetes.io/projected/99395530-2d6c-4f9a-b5b7-b173db18d32f-kube-api-access-l752v\") pod \"perf-node-gather-daemonset-lwcch\" (UID: \"99395530-2d6c-4f9a-b5b7-b173db18d32f\") " pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.546131 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.546092    2548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:08.685017 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:08.684988    2548 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"]
Jul 26 18:52:08.686855 ip-10-0-143-214 kubenswrapper[2548]: W0726 18:52:08.686824    2548 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod99395530_2d6c_4f9a_b5b7_b173db18d32f.slice/crio-ea6023fd7b996c7fd501186db81369ffbb0ea3adf8adf1beef8db81ea11d04e3 WatchSource:0}: Error finding container ea6023fd7b996c7fd501186db81369ffbb0ea3adf8adf1beef8db81ea11d04e3: Status 404 returned error can't find the container with id ea6023fd7b996c7fd501186db81369ffbb0ea3adf8adf1beef8db81ea11d04e3
Jul 26 18:52:09.676477 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:09.676414    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch" event={"ID":"99395530-2d6c-4f9a-b5b7-b173db18d32f","Type":"ContainerStarted","Data":"193acfc867212131c798cdd5bb72c07a7f1171e1e8b46a000eb21c5b9cffb0d7"}
Jul 26 18:52:09.676971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:09.676507    2548 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch" event={"ID":"99395530-2d6c-4f9a-b5b7-b173db18d32f","Type":"ContainerStarted","Data":"ea6023fd7b996c7fd501186db81369ffbb0ea3adf8adf1beef8db81ea11d04e3"}
Jul 26 18:52:09.676971 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:09.676563    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:09.695514 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:09.695461    2548 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch" podStartSLOduration=1.6954451289999999 podStartE2EDuration="1.695445129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-26 18:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-26 18:52:09.693730546 +0000 UTC m=+3286.793983433" watchObservedRunningTime="2026-07-26 18:52:09.695445129 +0000 UTC m=+3286.795698060"
Jul 26 18:52:10.822656 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:10.822629    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l2phc_f22461aa-0b4f-4acd-988c-2740a8917fe2/dns/0.log"
Jul 26 18:52:10.845167 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:10.845139    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l2phc_f22461aa-0b4f-4acd-988c-2740a8917fe2/kube-rbac-proxy/0.log"
Jul 26 18:52:11.027395 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:11.027361    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m2knk_f0e6ef63-c5e9-42c8-a565-d3ef9c5d5e41/dns-node-resolver/0.log"
Jul 26 18:52:11.552147 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:11.552114    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-745cdf97bc-55rsk_445d0bba-b974-4b80-9272-1f09724a2e9f/registry/0.log"
Jul 26 18:52:11.604182 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:11.604141    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fxldw_4e53c488-9d7d-436a-b723-e574e127a89d/node-ca/0.log"
Jul 26 18:52:12.577051 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:12.577026    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp_19e6721e-f772-4160-ab4b-1d2695fec4ac/istio-proxy/0.log"
Jul 26 18:52:12.817391 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:12.817361    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-79jtn_040cdc62-332d-4b21-b893-0956b30523ab/istio-proxy/0.log"
Jul 26 18:52:12.845291 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:12.845173    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-79jtn_040cdc62-332d-4b21-b893-0956b30523ab/istio-proxy/1.log"
Jul 26 18:52:12.878180 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:12.878149    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zfwwx_806c5996-5e66-41bd-84c0-38ca75e60474/payload-pre-processing/0.log"
Jul 26 18:52:12.908357 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:12.908326    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dk9v8_cd3aa98a-31bf-49c6-b800-1f62983a6d45/payload-processing/0.log"
Jul 26 18:52:13.764786 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:13.764756    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jnt8g_2607b65c-acd1-4091-a34e-d40a67ff9ede/serve-healthcheck-canary/0.log"
Jul 26 18:52:14.441408 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:14.441376    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nb7c5_42c4fc8d-2501-47c6-aa2b-86938094f9d0/kube-rbac-proxy/0.log"
Jul 26 18:52:14.462650 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:14.462621    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nb7c5_42c4fc8d-2501-47c6-aa2b-86938094f9d0/exporter/0.log"
Jul 26 18:52:14.483587 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:14.483553    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nb7c5_42c4fc8d-2501-47c6-aa2b-86938094f9d0/extractor/0.log"
Jul 26 18:52:15.691928 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:15.691892    2548 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lz7b2/perf-node-gather-daemonset-lwcch"
Jul 26 18:52:16.673974 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:16.673940    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dtzsn_d11c3a3a-0fde-47c3-95d4-6670128a6e89/manager/0.log"
Jul 26 18:52:17.010247 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:17.010143    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5c849f48d4-hzlnm_d91b056f-8e96-44b8-97b1-ad05ddc9ec0a/manager/0.log"
Jul 26 18:52:17.286541 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:17.286459    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cc94bb6c-ks5bd_f1fffcce-e18a-43de-91e6-6ab90db34e5c/manager/0.log"
Jul 26 18:52:17.306120 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:17.306089    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cc94bb6c-ks5bd_f1fffcce-e18a-43de-91e6-6ab90db34e5c/copy-manifests/0.log"
Jul 26 18:52:18.773578 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:18.773548    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b54d88cb5-cwvmm_562f84a9-1611-4c8e-adf1-1b3957b2c48a/manager/0.log"
Jul 26 18:52:18.802808 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:18.802780    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ng7bq_2e693e1f-134c-45c3-9a8d-a92a1bbacc1d/openshift-lws-operator/0.log"
Jul 26 18:52:18.887145 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:18.887114    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp_19e6721e-f772-4160-ab4b-1d2695fec4ac/istio-proxy/0.log"
Jul 26 18:52:19.081073 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:19.080988    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-79jtn_040cdc62-332d-4b21-b893-0956b30523ab/istio-proxy/0.log"
Jul 26 18:52:19.107066 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:19.107035    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-79jtn_040cdc62-332d-4b21-b893-0956b30523ab/istio-proxy/1.log"
Jul 26 18:52:19.129410 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:19.129378    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zfwwx_806c5996-5e66-41bd-84c0-38ca75e60474/payload-pre-processing/0.log"
Jul 26 18:52:19.149217 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:19.149162    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dk9v8_cd3aa98a-31bf-49c6-b800-1f62983a6d45/payload-processing/0.log"
Jul 26 18:52:20.607560 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:20.607467    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-8hltp_19e6721e-f772-4160-ab4b-1d2695fec4ac/istio-proxy/0.log"
Jul 26 18:52:20.802150 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:20.802113    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-79jtn_040cdc62-332d-4b21-b893-0956b30523ab/istio-proxy/0.log"
Jul 26 18:52:20.828948 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:20.828912    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-79jtn_040cdc62-332d-4b21-b893-0956b30523ab/istio-proxy/1.log"
Jul 26 18:52:20.855234 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:20.855175    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zfwwx_806c5996-5e66-41bd-84c0-38ca75e60474/payload-pre-processing/0.log"
Jul 26 18:52:20.877088 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:20.877055    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dk9v8_cd3aa98a-31bf-49c6-b800-1f62983a6d45/payload-processing/0.log"
Jul 26 18:52:25.441839 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:25.441806    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsd6_c48ecf55-4a22-4d68-8455-a9226dc2f3c4/kube-multus-additional-cni-plugins/0.log"
Jul 26 18:52:25.464462 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:25.464431    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsd6_c48ecf55-4a22-4d68-8455-a9226dc2f3c4/egress-router-binary-copy/0.log"
Jul 26 18:52:25.487444 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:25.487410    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsd6_c48ecf55-4a22-4d68-8455-a9226dc2f3c4/cni-plugins/0.log"
Jul 26 18:52:25.509150 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:25.509121    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsd6_c48ecf55-4a22-4d68-8455-a9226dc2f3c4/bond-cni-plugin/0.log"
Jul 26 18:52:25.530142 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:25.530118    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsd6_c48ecf55-4a22-4d68-8455-a9226dc2f3c4/routeoverride-cni/0.log"
Jul 26 18:52:25.552166 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:25.552137    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsd6_c48ecf55-4a22-4d68-8455-a9226dc2f3c4/whereabouts-cni-bincopy/0.log"
Jul 26 18:52:25.573132 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:25.573104    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hqsd6_c48ecf55-4a22-4d68-8455-a9226dc2f3c4/whereabouts-cni/0.log"
Jul 26 18:52:25.776480 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:25.776402    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g8vg9_0e59a67a-2bd0-45fa-9d21-d8d4372f50b6/kube-multus/0.log"
Jul 26 18:52:25.873044 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:25.873016    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kc628_ee4620ff-6563-4f5b-beb1-35330cd2d74b/network-metrics-daemon/0.log"
Jul 26 18:52:25.897826 ip-10-0-143-214 kubenswrapper[2548]: I0726 18:52:25.897792    2548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kc628_ee4620ff-6563-4f5b-beb1-35330cd2d74b/kube-rbac-proxy/0.log"